-- Logs begin at Tue 2022-05-10 01:38:18 UTC, end at Tue 2022-05-10 03:33:29 UTC. -- May 10 02:58:47.056621 dv-cinder-830094-4-smb systemd[1]: Starting Devstack devstack@keystone.service... May 10 02:58:47.064983 dv-cinder-830094-4-smb devstack@keystone.service[80184]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 10 02:58:47.066956 dv-cinder-830094-4-smb devstack@keystone.service[80184]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 10 02:58:47 2022] *** May 10 02:58:47.066956 dv-cinder-830094-4-smb devstack@keystone.service[80184]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 10 02:58:47.066956 dv-cinder-830094-4-smb devstack@keystone.service[80184]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 10 02:58:47.066956 dv-cinder-830094-4-smb devstack@keystone.service[80184]: nodename: dv-cinder-830094-4-smb May 10 02:58:47.066956 dv-cinder-830094-4-smb devstack@keystone.service[80184]: machine: x86_64 May 10 02:58:47.066956 dv-cinder-830094-4-smb devstack@keystone.service[80184]: clock source: unix May 10 02:58:47.066956 dv-cinder-830094-4-smb devstack@keystone.service[80184]: pcre jit disabled May 10 02:58:47.066956 dv-cinder-830094-4-smb devstack@keystone.service[80184]: detected number of CPU cores: 4 May 10 02:58:47.066956 dv-cinder-830094-4-smb devstack@keystone.service[80184]: current working directory: / May 10 02:58:47.066956 dv-cinder-830094-4-smb devstack@keystone.service[80184]: detected binary path: /usr/bin/uwsgi-core May 10 02:58:47.066956 dv-cinder-830094-4-smb devstack@keystone.service[80184]: your processes number limit is 47680 May 10 02:58:47.066956 dv-cinder-830094-4-smb devstack@keystone.service[80184]: your memory page size is 4096 bytes May 10 02:58:47.067602 dv-cinder-830094-4-smb devstack@keystone.service[80184]: detected max file descriptor number: 2048 May 10 02:58:47.067602 dv-cinder-830094-4-smb devstack@keystone.service[80184]: lock engine: pthread robust mutexes May 10 02:58:47.067602 dv-cinder-830094-4-smb devstack@keystone.service[80184]: thunder lock: enabled May 10 02:58:47.067602 dv-cinder-830094-4-smb devstack@keystone.service[80184]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 10 02:58:47.067602 dv-cinder-830094-4-smb devstack@keystone.service[80184]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 10 02:58:47.111672 dv-cinder-830094-4-smb devstack@keystone.service[80184]: Python main interpreter initialized at 0x556efab4e9c0 May 10 02:58:47.111672 dv-cinder-830094-4-smb devstack@keystone.service[80184]: python threads support enabled May 10 02:58:47.111672 dv-cinder-830094-4-smb devstack@keystone.service[80184]: your server socket listen backlog is limited to 100 connections May 10 02:58:47.111672 dv-cinder-830094-4-smb devstack@keystone.service[80184]: your mercy for graceful operations on workers is 90 seconds May 10 02:58:47.112087 dv-cinder-830094-4-smb devstack@keystone.service[80184]: mapped 403077 bytes (393 KB) for 2 cores May 10 02:58:47.112168 dv-cinder-830094-4-smb devstack@keystone.service[80184]: *** Operational MODE: preforking *** May 10 02:58:47.112392 dv-cinder-830094-4-smb devstack@keystone.service[80184]: *** uWSGI is running in multiple interpreter mode *** May 10 02:58:47.112392 dv-cinder-830094-4-smb devstack@keystone.service[80184]: spawned uWSGI master process (pid: 80184) May 10 02:58:47.112595 dv-cinder-830094-4-smb systemd[1]: Started Devstack devstack@keystone.service. May 10 02:58:47.116035 dv-cinder-830094-4-smb devstack@keystone.service[80184]: spawned uWSGI worker 1 (pid: 80197, cores: 1) May 10 02:58:47.116035 dv-cinder-830094-4-smb devstack@keystone.service[80184]: spawned uWSGI worker 2 (pid: 80198, cores: 1) May 10 02:58:47.116035 dv-cinder-830094-4-smb devstack@keystone.service[80184]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 10 02:58:52.890546 dv-cinder-830094-4-smb devstack@keystone.service[80198]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 02:58:52.890546 dv-cinder-830094-4-smb devstack@keystone.service[80198]: from cryptography.utils import int_from_bytes May 10 02:58:52.891893 dv-cinder-830094-4-smb devstack@keystone.service[80198]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 02:58:52.891893 dv-cinder-830094-4-smb devstack@keystone.service[80198]: from cryptography.utils import int_from_bytes May 10 02:58:52.917417 dv-cinder-830094-4-smb devstack@keystone.service[80197]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 02:58:52.917417 dv-cinder-830094-4-smb devstack@keystone.service[80197]: from cryptography.utils import int_from_bytes May 10 02:58:52.918838 dv-cinder-830094-4-smb devstack@keystone.service[80197]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 02:58:52.918838 dv-cinder-830094-4-smb devstack@keystone.service[80197]: from cryptography.utils import int_from_bytes May 10 02:58:52.941664 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 02:58:52.941859 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 02:58:52.942055 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] command line args: [] {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 02:58:52.942328 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 02:58:52.942529 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ================================================================================ {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 02:58:52.942764 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] admin_token = **** {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.943009 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] config_dir = [] {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.943196 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.943379 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] config_source = [] {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.943561 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] debug = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.943764 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.944992 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.944992 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.944992 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.944992 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.945255 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] list_limit = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.945255 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] log_config_append = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.945370 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.945539 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] log_dir = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.945709 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] log_file = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.945949 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.946199 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.946501 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.946751 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.946930 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.947108 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.947355 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.947598 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.947834 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.948093 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.948336 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.948571 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.948822 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.949068 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.949354 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.949853 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.65/identity {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.950031 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] publish_errors = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.950263 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.950606 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.950704 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.950906 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.951281 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.951384 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] standard_threads = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.952279 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.952279 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.952279 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.952279 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] use_journal = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.952640 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] use_json = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.952640 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] use_stderr = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.952787 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] use_syslog = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.952906 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.953165 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.953405 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.953664 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.953906 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.954153 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.954394 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.954642 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.954878 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.955734 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.955734 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.955734 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.956027 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.956103 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.956320 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.956567 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.963422 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.963422 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.963422 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.963422 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.963422 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.963422 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.963422 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.963422 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.963422 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.964172 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.964172 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.964172 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.964172 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.964172 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.964172 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.964172 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.964172 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.964172 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.964810 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.964810 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.964810 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.964810 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.964810 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.964810 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.964810 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.964810 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.964810 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.965330 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.965330 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.965330 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.965330 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.965330 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.965330 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.965330 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.965330 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.965803 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.965803 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.965926 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.966072 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.966312 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.966554 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.966795 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.967035 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.967266 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.967516 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.967753 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.967992 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.968246 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.968509 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.968753 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.968987 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.969227 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.969464 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.969735 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.969972 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.970219 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.970465 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.970760 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.970996 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.971234 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.971607 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.971853 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.972120 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.972368 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.972609 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.972751 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 02:58:52.972852 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.972936 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 02:58:52.973091 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.973169 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] command line args: [] {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 02:58:52.973332 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.973416 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 02:58:52.973558 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] ================================================================================ {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 02:58:52.973635 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.973815 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] admin_token = **** {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.973893 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.974111 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.974205 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] config_dir = [] {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.974282 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.974352 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.974428 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] config_source = [] {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.974532 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.975532 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] debug = True {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.975532 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.975705 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.975777 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.975857 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.975929 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.976025 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.976110 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.976183 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.976251 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.976327 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.976398 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] list_limit = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.976466 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.976533 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] log_config_append = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.976606 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.976775 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.976775 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] log_dir = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.976923 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.976923 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.977047 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] log_file = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.977115 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.977115 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.977245 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.977316 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.977445 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.977524 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.978309 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.978482 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.978574 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.979301 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.979433 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.979540 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.979640 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] auth.external = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.979736 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.979849 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.979968 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.980072 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.980145 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.980268 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.980394 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.980472 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] auth.password = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.980625 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.980688 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] auth.token = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.980802 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.980888 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.981015 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.981092 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.981171 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.981248 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.981366 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.981447 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.981447 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.981640 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.981729 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.981894 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.982131 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] credential.caching = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.982379 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.982496 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.65/identity {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.982632 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.982835 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] publish_errors = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.982918 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.983108 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.983255 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.983343 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.983576 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.983707 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.983830 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.983992 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.984168 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.984334 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.984490 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.984614 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.984860 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.984990 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.985121 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.985361 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.985485 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] standard_threads = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.985608 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.985757 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.985885 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.986088 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.986215 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] federation.caching = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.986356 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.986356 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] use_journal = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.986600 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.986726 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] use_json = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.986864 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.986990 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] use_stderr = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.987116 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.987244 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] use_syslog = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.987371 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.987522 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:58:52.987673 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.987757 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.987917 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.988080 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.988204 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.988331 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.988467 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.988595 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.988723 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.988857 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.988990 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.989117 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.989259 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.989394 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.989528 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] identity.caching = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.989653 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.989780 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.989914 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.990041 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.990168 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.990303 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.990430 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.990562 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.990697 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.990823 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.990957 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.991088 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.991214 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.991338 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.991484 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.991626 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.991757 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.991887 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.992092 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.992216 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.992342 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.992468 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.992603 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.992729 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.992856 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.992982 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.993107 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.993247 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.993383 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.993525 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.993651 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.993778 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.993906 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.994032 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.994166 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.994295 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.994453 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.994532 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.994646 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.994726 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.994806 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.994878 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.994954 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.995025 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.995095 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.995164 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.995241 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.995318 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.995389 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.995458 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.995533 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.995603 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.995680 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.995752 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.995820 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.995889 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.995966 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.996053 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.997888 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.997983 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.998078 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.998150 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.998213 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.998272 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.998332 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.998396 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.998463 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.998524 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.998582 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.998640 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.998703 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.998769 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.998836 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.998895 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.998953 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.999011 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.999069 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.999126 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.999192 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.999251 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.999309 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.999367 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.999425 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.999425 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.999542 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.999603 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.999661 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.999724 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.999784 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.999842 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.999995 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:52.999995 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.000154 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.000213 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.000213 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.000316 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.000388 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.000484 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.001237 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.001378 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.user = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.001459 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.001544 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.001626 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.001699 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.001771 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.001842 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.001913 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.001993 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.001993 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.002130 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.002203 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.002280 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.002352 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.002431 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.002541 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.002631 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.002777 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.002856 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.003010 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.003088 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.003249 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.003331 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.003480 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.003679 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.003758 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.003962 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.004192 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.004276 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.004468 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.004627 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.004705 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.005035 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.005131 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.005234 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.005477 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.005556 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.005718 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.005913 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.006003 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.006183 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.006357 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.006437 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.006667 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.006800 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.007008 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.007153 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.007269 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.007387 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.007632 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.007764 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.007870 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.008059 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.008145 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.008321 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.008400 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.008564 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.008647 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.008821 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.009078 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.009237 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.009429 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.009545 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.009668 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.009924 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.010033 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.010175 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] resource.caching = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.010274 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.010433 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.010514 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.010745 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.010824 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.011030 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.011108 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.011286 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.011368 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.011522 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.011599 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.011758 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.011838 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.011987 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.012096 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.012238 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.012318 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.012467 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.012547 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.012703 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.012786 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] role.caching = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.012932 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.013012 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] role.driver = sql {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.013172 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.013250 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.013402 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.013482 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.013646 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.013725 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.013883 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.013962 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.014132 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.014212 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.014380 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.014460 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.014614 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.014692 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.014842 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] auth.external = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.014924 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.015069 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.015148 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.015315 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.015393 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.015562 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.015643 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.015788 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] auth.password = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.015866 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.016075 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] auth.token = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.016161 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.016294 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.016377 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.016526 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.016766 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.016844 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.016994 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.017075 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.017237 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.017317 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.017483 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.017567 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.017711 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.017810 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.017969 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.018049 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] credential.caching = True {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.019354 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.020031 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.020136 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.020221 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.020297 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.020368 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.020439 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.020510 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.020590 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.020664 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.021584 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.021684 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.021759 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.021832 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.021920 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.021996 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.022068 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.022139 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.022210 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.022281 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.022360 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.022434 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.022505 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.022582 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.022655 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.022726 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.022804 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] token.caching = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.022878 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.022949 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.023019 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.023090 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.023090 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.023342 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] federation.caching = True {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.023426 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.023499 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.023570 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.023570 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.023700 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.023780 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.023780 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.023911 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.023981 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.024101 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.024175 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.024326 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.024403 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.024988 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.025062 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.025133 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.025204 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.025284 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.025357 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.025429 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.025500 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.025571 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.025642 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.025721 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.025839 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.025921 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] identity.caching = True {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.026090 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.026169 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] database.connection = **** {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.026336 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.026426 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.026568 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.026649 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.026800 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.026881 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.027040 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.027117 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.027271 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.027350 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.027506 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.027587 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.027744 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.027823 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.027984 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.028101 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.028236 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.028316 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.028469 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.028548 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.028698 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.028779 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.028934 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.029013 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.029173 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.029251 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.029406 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.029487 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.029653 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.029732 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.029886 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.029965 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.030127 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.030208 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.030363 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.030442 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.030535 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 02:58:53.030616 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.030809 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.031043 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.031270 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.031500 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.031737 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.031972 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.032239 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.032715 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.032963 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.033205 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.033441 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.033682 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.033924 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.034148 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.034383 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.034607 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.034844 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.035079 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.035316 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.035550 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.035786 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.036044 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.036290 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.036517 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.036742 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.036984 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.037227 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.037457 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.037686 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.038833 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.038833 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.user = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.038833 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.038833 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.038833 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.041245 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.041245 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.041245 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.041245 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.041245 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.041245 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.041245 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.041245 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.043881 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.043881 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.043881 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.043881 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.043881 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.043881 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.043881 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.043881 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.043881 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.045944 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.045944 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.045944 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.045944 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.045944 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.045944 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.045944 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.045944 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.045944 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.046996 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.046996 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.046996 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.047349 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.047670 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.048124 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.048560 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.049000 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] resource.caching = True {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.049443 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.049884 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.050313 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.050775 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.051239 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.051683 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.052184 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.052662 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.053138 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.053601 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] role.caching = True {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.054080 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] role.driver = sql {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.054500 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.054915 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.055389 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.055807 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.056092 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.056350 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.056602 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.056852 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.057101 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.057334 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.057580 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.057827 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.058090 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.058461 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.058900 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.059137 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.059508 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.059757 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.060033 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.060270 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.060504 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.060757 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.061010 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.061341 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.061576 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.061806 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.062035 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.062233 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:58:53.062367 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.062496 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:58:53.062627 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.062756 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:58:53.062887 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.063025 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.063194 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.063424 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.063656 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] token.caching = True {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.063889 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.064155 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.064389 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.064639 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.064881 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.065114 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.065355 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.065592 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.065836 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.066070 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.066304 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.066532 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.066877 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.067125 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.067353 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.067590 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.067929 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.068216 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] database.connection = **** {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.068387 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.068628 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.068862 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.069098 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.069328 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.069561 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.069793 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.070026 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.070267 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.070500 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.070739 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.070969 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.071211 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.071467 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.071597 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:58:53.071864 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.072303 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.072741 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.073178 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:58:53.073488 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 02:58:53.100478 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:58:53.100763 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:58:53.105802 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:58:53.106122 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:58:53.106352 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:58:53.115110 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:58:53.138058 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:58:53.138058 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:58:53.154841 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:58:53.181872 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:58:53.210664 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:58:53.210946 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:58:53.227248 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:58:53.227479 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:58:53.278085 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:58:53.278332 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:58:53.278527 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:58:53.278753 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:58:53.278975 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:58:53.279193 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:58:53.281608 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:58:53.281987 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:58:53.282348 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:58:53.282981 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:58:53.283300 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:58:53.283527 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:58:53.303369 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:58:53.303369 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:58:53.303369 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:58:53.303369 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:58:53.303369 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:58:53.304794 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:58:53.304794 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:58:53.306874 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:58:53.307274 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:58:53.307555 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:58:53.308428 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:58:53.308428 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:58:53.308428 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:58:53.308428 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:58:53.316867 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:58:53.319518 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:58:53.331665 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:58:53.331893 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:58:53.332151 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:58:53.332375 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:58:53.332594 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:58:53.332809 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:58:53.332905 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:58:53.333024 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:58:53.333142 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:58:53.333456 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:58:53.333829 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:58:53.334212 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:58:53.334592 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:58:53.334972 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 02:58:53.350466 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.350607 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.350751 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 10 02:58:53.350854 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 10 02:58:53.350998 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.351133 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.351220 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 10 02:58:53.351396 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 10 02:58:53.351501 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.351579 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.351703 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.351829 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.351967 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.352106 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.353723 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.353831 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.363843 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.364149 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.364424 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.364709 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.367367 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.367643 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.367907 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.368797 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.373443 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:58:53.376790 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:58:53.377070 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.377175 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:58:53.377353 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.377744 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.378024 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.378288 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.378562 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.378840 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.379114 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.379390 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.379664 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.381236 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:58:53.381509 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.381784 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.382167 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.382442 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.382698 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.382962 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.383228 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.383492 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.383756 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.384685 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.407435 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.409293 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:58:53.409573 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.412829 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.414439 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:58:53.414710 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.414891 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:58:53.415199 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.415482 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.420040 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:58:53.420317 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.420591 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.422824 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:58:53.423108 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.427767 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:58:53.427853 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:58:53.428078 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.428162 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.428365 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.428649 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.428927 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.429199 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.429470 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.429737 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.432793 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:58:53.433074 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.433348 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.433622 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.433892 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.434159 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.434426 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.434688 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.449287 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.449565 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.453816 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.454090 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.454182 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:58:53.457892 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.458191 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.458603 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:58:53.462847 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.463132 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.463815 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:58:53.467473 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:58:53.468110 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:58:53.471251 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.471551 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.471642 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:58:53.471839 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.472169 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.472452 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.472730 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.475354 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.475646 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.475923 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.476231 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.476503 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.476776 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.491795 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:58:53.492201 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.492477 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.492740 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.495714 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:58:53.496113 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.496380 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.496637 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.500696 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.502429 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.502708 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.504496 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.505797 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:58:53.506081 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.506221 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.506373 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.506499 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.506666 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.506943 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.510092 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:58:53.510368 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.510643 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.510924 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.511195 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.521002 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:58:53.521282 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.521563 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.521856 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.522136 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.522420 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.522696 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.525141 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:58:53.525412 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.525686 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.525960 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.526234 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.526515 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.526794 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.541622 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:58:53.544940 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:58:53.545240 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:58:53.548296 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.548533 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:58:53.549911 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.551559 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:58:53.551785 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.551866 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.552161 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.553413 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.555012 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:58:53.555287 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.555574 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.560162 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.561780 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:58:53.563525 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.565069 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.565164 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:58:53.565358 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.565647 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.565925 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.568353 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.568637 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.568915 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.569193 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.575798 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:58:53.576113 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.576400 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.578969 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:58:53.579250 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.579526 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.584417 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:58:53.584694 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.584971 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.585244 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.585515 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.585801 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.586073 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.586349 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.586618 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.586886 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.587182 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.587463 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.587619 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 02:58:53.587728 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.587892 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.587981 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.588190 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.588461 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.588737 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.589015 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.589280 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.589546 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.589804 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.590061 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.590331 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.590596 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.590854 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.591105 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 02:58:53.627234 dv-cinder-830094-4-smb devstack@keystone.service[80198]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556efab4e9c0 pid: 80198 (default app) May 10 02:58:53.630000 dv-cinder-830094-4-smb devstack@keystone.service[80197]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556efab4e9c0 pid: 80197 (default app) May 10 02:58:53.630580 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0f2ff-33d9-4fef-a319-5aeebf793c08 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:58:53.630885 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0f2ff-33d9-4fef-a319-5aeebf793c08 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:58:53.631171 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0f2ff-33d9-4fef-a319-5aeebf793c08 None None] PATH_INFO: `/v3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:58:53.636615 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1/1] 10.222.0.65 () {50 vars in 791 bytes} [Tue May 10 02:58:53 2022] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:02.457898 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910766e-1509-4ee2-a6d2-57eeeadcf90b None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:02.458369 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910766e-1509-4ee2-a6d2-57eeeadcf90b None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:02.458634 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910766e-1509-4ee2-a6d2-57eeeadcf90b None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:02.462951 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1/2] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 02:59:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 02:59:02.468394 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97015406-5d67-4de5-add6-1a4eceeb8b26 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:02.468813 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97015406-5d67-4de5-add6-1a4eceeb8b26 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:02.468954 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97015406-5d67-4de5-add6-1a4eceeb8b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:02.499807 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG oslo_db.sqlalchemy.engines [None req-97015406-5d67-4de5-add6-1a4eceeb8b26 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80198) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 02:59:02.690226 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG passlib.handlers.bcrypt [None req-97015406-5d67-4de5-add6-1a4eceeb8b26 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80198) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 10 02:59:02.690638 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG passlib.handlers.bcrypt [None req-97015406-5d67-4de5-add6-1a4eceeb8b26 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80198) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 10 02:59:02.745604 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-97015406-5d67-4de5-add6-1a4eceeb8b26 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 02:59:02.747152 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-97015406-5d67-4de5-add6-1a4eceeb8b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 02:59:02.867103 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 2/3] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 02:59:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 10 02:59:03.058206 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d910766e-1509-4ee2-a6d2-57eeeadcf90b None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:03.091114 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG oslo_db.sqlalchemy.engines [None req-d910766e-1509-4ee2-a6d2-57eeeadcf90b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80197) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 02:59:03.215040 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d910766e-1509-4ee2-a6d2-57eeeadcf90b None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:03.219256 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0bee9a-d458-46b7-b6fa-0e3a12de5884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:03.219911 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0bee9a-d458-46b7-b6fa-0e3a12de5884 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:03.220234 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0bee9a-d458-46b7-b6fa-0e3a12de5884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:03.220507 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0bee9a-d458-46b7-b6fa-0e3a12de5884 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:03.228870 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0bee9a-d458-46b7-b6fa-0e3a12de5884 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:03.280092 dv-cinder-830094-4-smb devstack@keystone.service[80197]: WARNING keystone.common.rbac_enforcer.enforcer [None req-0c0bee9a-d458-46b7-b6fa-0e3a12de5884 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 10 02:59:03.280432 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0bee9a-d458-46b7-b6fa-0e3a12de5884 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:03.289837 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 2/4] 10.222.0.65 () {58 vars in 1324 bytes} [Tue May 10 02:59:03 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 10 02:59:03.296359 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97015406-5d67-4de5-add6-1a4eceeb8b26 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:03.310617 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97015406-5d67-4de5-add6-1a4eceeb8b26 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:03.314966 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce7e2ae-d566-4000-a475-3bec52a9761e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:03.316125 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7e2ae-d566-4000-a475-3bec52a9761e admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:03.316414 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7e2ae-d566-4000-a475-3bec52a9761e admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:03.316690 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7e2ae-d566-4000-a475-3bec52a9761e admin admin] PATH_INFO: `/v3/projects/b2907edfa2f14a3b85299455266c251c` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:03.318208 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce7e2ae-d566-4000-a475-3bec52a9761e admin admin] RBAC: Authorizing `identity:get_project(project_id=b2907edfa2f14a3b85299455266c251c)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:03.370237 dv-cinder-830094-4-smb devstack@keystone.service[80198]: WARNING keystone.common.rbac_enforcer.enforcer [None req-fce7e2ae-d566-4000-a475-3bec52a9761e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 10 02:59:03.370586 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce7e2ae-d566-4000-a475-3bec52a9761e admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:03.375113 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 3/5] 10.222.0.65 () {56 vars in 1207 bytes} [Tue May 10 02:59:03 2022] GET /identity/v3/projects/b2907edfa2f14a3b85299455266c251c => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:05.562221 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73428b0-031b-412e-8499-a0be22c2a2cc None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:05.562743 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73428b0-031b-412e-8499-a0be22c2a2cc None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:05.562833 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73428b0-031b-412e-8499-a0be22c2a2cc None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:05.566834 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 3/6] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 02:59:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 02:59:05.572764 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81dac2-c4be-4400-986a-ef0450424f57 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:05.573225 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81dac2-c4be-4400-986a-ef0450424f57 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:05.573319 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81dac2-c4be-4400-986a-ef0450424f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:05.593075 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-9e81dac2-c4be-4400-986a-ef0450424f57 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 02:59:05.594599 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-9e81dac2-c4be-4400-986a-ef0450424f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 02:59:05.602524 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 4/7] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 02:59:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 10 02:59:05.624327 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73428b0-031b-412e-8499-a0be22c2a2cc None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:05.636608 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73428b0-031b-412e-8499-a0be22c2a2cc None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:05.640725 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1465498-c18f-4208-85fc-bb20801fec5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:05.641346 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1465498-c18f-4208-85fc-bb20801fec5e admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:05.641628 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1465498-c18f-4208-85fc-bb20801fec5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:05.641901 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1465498-c18f-4208-85fc-bb20801fec5e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:05.649332 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1465498-c18f-4208-85fc-bb20801fec5e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:05.651083 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1465498-c18f-4208-85fc-bb20801fec5e admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:05.659767 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 4/8] 10.222.0.65 () {58 vars in 1324 bytes} [Tue May 10 02:59:05 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 10 02:59:05.665000 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e81dac2-c4be-4400-986a-ef0450424f57 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:05.673766 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e81dac2-c4be-4400-986a-ef0450424f57 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:05.678145 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa46645-1bc4-48c3-b3bf-dcb7adcc1ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:05.679001 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa46645-1bc4-48c3-b3bf-dcb7adcc1ec8 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:05.679289 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa46645-1bc4-48c3-b3bf-dcb7adcc1ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:05.679570 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa46645-1bc4-48c3-b3bf-dcb7adcc1ec8 admin admin] PATH_INFO: `/v3/users/3229265247eb495190623e424798942d` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:05.681487 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa46645-1bc4-48c3-b3bf-dcb7adcc1ec8 admin admin] RBAC: Authorizing `identity:get_user(user_id=3229265247eb495190623e424798942d)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:05.683318 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa46645-1bc4-48c3-b3bf-dcb7adcc1ec8 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:05.684918 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 5/9] 10.222.0.65 () {56 vars in 1198 bytes} [Tue May 10 02:59:05 2022] GET /identity/v3/users/3229265247eb495190623e424798942d => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 02:59:07.966659 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549043f5-60e2-4e1a-b57b-fa2a7bb87632 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:07.967200 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549043f5-60e2-4e1a-b57b-fa2a7bb87632 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:07.967200 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549043f5-60e2-4e1a-b57b-fa2a7bb87632 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:07.968668 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 5/10] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 02:59:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 02:59:07.969589 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a386e-b047-4182-928a-d71052906a55 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:07.969986 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a386e-b047-4182-928a-d71052906a55 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:07.970147 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a386e-b047-4182-928a-d71052906a55 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:07.971642 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 6/11] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 02:59:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 02:59:07.973918 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6406e2a-bf3b-4c20-89bf-ad756c23fc05 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:07.974210 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6406e2a-bf3b-4c20-89bf-ad756c23fc05 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:07.974494 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6406e2a-bf3b-4c20-89bf-ad756c23fc05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:07.976582 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec43c231-b2c0-44d4-ba00-51091fefe0d9 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:07.976875 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec43c231-b2c0-44d4-ba00-51091fefe0d9 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:07.977154 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec43c231-b2c0-44d4-ba00-51091fefe0d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:08.015520 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG passlib.handlers.bcrypt [None req-c6406e2a-bf3b-4c20-89bf-ad756c23fc05 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80197) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 10 02:59:08.015943 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG passlib.handlers.bcrypt [None req-c6406e2a-bf3b-4c20-89bf-ad756c23fc05 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80197) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 10 02:59:08.064057 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-c6406e2a-bf3b-4c20-89bf-ad756c23fc05 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 02:59:08.065735 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-c6406e2a-bf3b-4c20-89bf-ad756c23fc05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 02:59:08.103380 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-ec43c231-b2c0-44d4-ba00-51091fefe0d9 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 02:59:08.104632 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-ec43c231-b2c0-44d4-ba00-51091fefe0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 02:59:08.183199 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 7/12] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 02:59:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 02:59:08.188727 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 6/13] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 02:59:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 02:59:08.204692 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec43c231-b2c0-44d4-ba00-51091fefe0d9 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:08.212176 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6406e2a-bf3b-4c20-89bf-ad756c23fc05 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:08.299152 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec43c231-b2c0-44d4-ba00-51091fefe0d9 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:08.307674 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6406e2a-bf3b-4c20-89bf-ad756c23fc05 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:08.331176 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca6c9ac-3aaa-40b7-8ea9-b63d1769737a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:08.331829 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6c9ac-3aaa-40b7-8ea9-b63d1769737a None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:08.332146 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6c9ac-3aaa-40b7-8ea9-b63d1769737a None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:08.332428 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6c9ac-3aaa-40b7-8ea9-b63d1769737a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:08.339882 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e0803b-b054-476f-a5d3-1500a3c31acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:08.340958 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e0803b-b054-476f-a5d3-1500a3c31acb None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:08.341248 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e0803b-b054-476f-a5d3-1500a3c31acb None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:08.341526 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e0803b-b054-476f-a5d3-1500a3c31acb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:08.353802 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e0803b-b054-476f-a5d3-1500a3c31acb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 02:59:08.364941 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-e5e0803b-b054-476f-a5d3-1500a3c31acb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 02:59:08.364941 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 02:59:08.364941 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 02:59:08.364941 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 02:59:08.364941 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 02:59:08.364941 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 02:59:08.364941 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 02:59:08.364941 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 02:59:08.364941 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 02:59:08.364941 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 02:59:08.364941 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 02:59:08.364941 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 02:59:08.364941 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 02:59:08.364941 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 02:59:08.364941 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 02:59:08.364941 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 02:59:08.366025 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 02:59:08.366025 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 02:59:08.366025 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 02:59:08.366025 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 02:59:08.366025 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 02:59:08.366025 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 02:59:08.366025 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 02:59:08.366025 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 02:59:08.366025 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 02:59:08.366025 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 02:59:08.366025 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 02:59:08.366025 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 02:59:08.366025 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 02:59:08.366025 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 02:59:08.366025 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 02:59:08.366025 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 02:59:08.366936 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 02:59:08.366936 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 02:59:08.366936 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 02:59:08.366936 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 02:59:08.366936 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 02:59:08.366936 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 02:59:08.366936 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 02:59:08.366936 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 02:59:08.366936 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 02:59:08.366936 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 02:59:08.366936 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 02:59:08.366936 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 02:59:08.366936 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 7/14] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 10 02:59:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 02:59:08.372444 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e0803b-b054-476f-a5d3-1500a3c31acb None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:08.397014 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca6c9ac-3aaa-40b7-8ea9-b63d1769737a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:08.398502 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca6c9ac-3aaa-40b7-8ea9-b63d1769737a None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:08.467219 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e0803b-b054-476f-a5d3-1500a3c31acb None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:08.497033 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 8/15] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 10 02:59:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 02:59:08.502787 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca6c9ac-3aaa-40b7-8ea9-b63d1769737a None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:08.601472 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca6c9ac-3aaa-40b7-8ea9-b63d1769737a None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:08.607872 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a1645-10e7-45c1-9975-5b15ca4b81d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:08.608631 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a1645-10e7-45c1-9975-5b15ca4b81d5 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:08.608918 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a1645-10e7-45c1-9975-5b15ca4b81d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:08.609193 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a1645-10e7-45c1-9975-5b15ca4b81d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:08.609947 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160a1645-10e7-45c1-9975-5b15ca4b81d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 02:59:08.610257 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160a1645-10e7-45c1-9975-5b15ca4b81d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:08.611665 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160a1645-10e7-45c1-9975-5b15ca4b81d5 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:08.623077 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 8/16] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 10 02:59:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 02:59:08.628506 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a1645-10e7-45c1-9975-5b15ca4b81d5 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:08.634088 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6aac18-48e0-4507-9291-d4b44ab1d213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:08.634970 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6aac18-48e0-4507-9291-d4b44ab1d213 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:08.635253 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6aac18-48e0-4507-9291-d4b44ab1d213 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:08.635524 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6aac18-48e0-4507-9291-d4b44ab1d213 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:08.645642 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6aac18-48e0-4507-9291-d4b44ab1d213 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:08.647113 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6aac18-48e0-4507-9291-d4b44ab1d213 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:08.668541 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-dd6aac18-48e0-4507-9291-d4b44ab1d213 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 02:59:08.668541 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 02:59:08.668541 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 02:59:08.668541 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 02:59:08.668541 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 02:59:08.668541 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 02:59:08.668541 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 02:59:08.668541 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 02:59:08.668541 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 02:59:08.668541 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 02:59:08.668541 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 02:59:08.668541 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 02:59:08.668541 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 02:59:08.668541 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 02:59:08.668541 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 02:59:08.669531 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 02:59:08.669531 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 02:59:08.669531 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 02:59:08.669531 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 02:59:08.669531 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 02:59:08.669531 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 02:59:08.669531 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 02:59:08.669531 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 02:59:08.669531 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 02:59:08.669531 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 02:59:08.669531 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 02:59:08.669531 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 02:59:08.669531 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 02:59:08.669531 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 02:59:08.669531 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 02:59:08.669531 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 02:59:08.669531 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 02:59:08.670378 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 02:59:08.670378 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 02:59:08.670378 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 02:59:08.670378 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 02:59:08.670378 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 9/17] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 02:59:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 02:59:08.675421 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6aac18-48e0-4507-9291-d4b44ab1d213 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:08.724338 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a1645-10e7-45c1-9975-5b15ca4b81d5 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:08.755832 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69113e-7e87-4d45-9a82-a75234181591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:08.756729 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69113e-7e87-4d45-9a82-a75234181591 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:08.757015 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69113e-7e87-4d45-9a82-a75234181591 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:08.757292 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69113e-7e87-4d45-9a82-a75234181591 None admin] PATH_INFO: `/v3/users/3229265247eb495190623e424798942d` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:08.758856 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e69113e-7e87-4d45-9a82-a75234181591 None admin] RBAC: Authorizing `identity:get_user(user_id=3229265247eb495190623e424798942d)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:08.760340 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e69113e-7e87-4d45-9a82-a75234181591 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:08.761947 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 9/18] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 10 02:59:08 2022] GET /identity/v3/users/3229265247eb495190623e424798942d => generated 247 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 02:59:08.767301 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69113e-7e87-4d45-9a82-a75234181591 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:08.768689 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6aac18-48e0-4507-9291-d4b44ab1d213 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:08.801121 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17aaf7e-578d-40fb-a6f1-d5a597151462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:08.801776 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17aaf7e-578d-40fb-a6f1-d5a597151462 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:08.802059 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17aaf7e-578d-40fb-a6f1-d5a597151462 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:08.802335 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17aaf7e-578d-40fb-a6f1-d5a597151462 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:08.803056 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17aaf7e-578d-40fb-a6f1-d5a597151462 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 02:59:08.803361 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17aaf7e-578d-40fb-a6f1-d5a597151462 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:08.804767 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17aaf7e-578d-40fb-a6f1-d5a597151462 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:08.821178 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 10/19] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 02:59:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 02:59:08.865447 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69113e-7e87-4d45-9a82-a75234181591 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:08.901650 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b62d8-15c1-474b-a8a8-53d2e9324ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:08.902466 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b62d8-15c1-474b-a8a8-53d2e9324ee7 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:08.902751 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b62d8-15c1-474b-a8a8-53d2e9324ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:08.903029 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b62d8-15c1-474b-a8a8-53d2e9324ee7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:08.904313 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5b62d8-15c1-474b-a8a8-53d2e9324ee7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:08.905796 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5b62d8-15c1-474b-a8a8-53d2e9324ee7 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:08.907722 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 10/20] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 02:59:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 02:59:08.913813 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17aaf7e-578d-40fb-a6f1-d5a597151462 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:09.015851 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17aaf7e-578d-40fb-a6f1-d5a597151462 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:09.048405 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dab330-2d9a-4180-b75b-7198e1ed4145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:09.049073 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dab330-2d9a-4180-b75b-7198e1ed4145 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:09.049362 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dab330-2d9a-4180-b75b-7198e1ed4145 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:09.049653 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dab330-2d9a-4180-b75b-7198e1ed4145 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:09.050496 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dab330-2d9a-4180-b75b-7198e1ed4145 None admin] RBAC: Adding query filter params (role.id=43105000610f402ca2486e7648018cca, scope.domain.id=default, user.id=3229265247eb495190623e424798942d) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 02:59:09.050805 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dab330-2d9a-4180-b75b-7198e1ed4145 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:09.052378 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dab330-2d9a-4180-b75b-7198e1ed4145 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:09.059107 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 11/21] 10.222.0.65 () {56 vars in 1322 bytes} [Tue May 10 02:59:08 2022] GET /identity/v3/role_assignments?user.id=3229265247eb495190623e424798942d&scope.domain.id=default&role.id=43105000610f402ca2486e7648018cca => generated 233 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:11.627385 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeca799-ba36-47fc-a4d5-1663fb21f54f None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:11.627385 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeca799-ba36-47fc-a4d5-1663fb21f54f None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:11.627385 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeca799-ba36-47fc-a4d5-1663fb21f54f None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:11.628371 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 11/22] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 02:59:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 02:59:11.633585 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc06a3-d7f9-466c-b983-efe445df8ae2 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:11.635012 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc06a3-d7f9-466c-b983-efe445df8ae2 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:11.635480 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc06a3-d7f9-466c-b983-efe445df8ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:11.652582 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-e8dc06a3-d7f9-466c-b983-efe445df8ae2 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 02:59:11.654107 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-e8dc06a3-d7f9-466c-b983-efe445df8ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 02:59:11.727062 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 12/23] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 02:59:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 02:59:11.744237 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11886b83-efc6-41b5-b245-de528c4734f1 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:11.744830 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11886b83-efc6-41b5-b245-de528c4734f1 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:11.745327 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11886b83-efc6-41b5-b245-de528c4734f1 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:11.746891 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 12/24] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 02:59:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 02:59:11.752353 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e71e97-1f12-4a87-8d4b-6321de5feda9 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:11.752867 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e71e97-1f12-4a87-8d4b-6321de5feda9 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:11.753337 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e71e97-1f12-4a87-8d4b-6321de5feda9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:11.767856 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11886b83-efc6-41b5-b245-de528c4734f1 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:11.773711 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-41e71e97-1f12-4a87-8d4b-6321de5feda9 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 02:59:11.774944 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-41e71e97-1f12-4a87-8d4b-6321de5feda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 02:59:11.842334 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 13/25] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 02:59:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 02:59:11.843913 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a250e-f822-4abc-8dd0-d341d8136e36 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:11.844381 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a250e-f822-4abc-8dd0-d341d8136e36 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:11.844830 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a250e-f822-4abc-8dd0-d341d8136e36 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:11.846749 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 14/26] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 02:59:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 02:59:11.853739 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8f960-2480-45d3-b8d8-6ad20c08b7ca None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:11.854229 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8f960-2480-45d3-b8d8-6ad20c08b7ca None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:11.854645 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8f960-2480-45d3-b8d8-6ad20c08b7ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:11.872263 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-35c8f960-2480-45d3-b8d8-6ad20c08b7ca None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 02:59:11.873721 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-35c8f960-2480-45d3-b8d8-6ad20c08b7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 02:59:11.905719 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11886b83-efc6-41b5-b245-de528c4734f1 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:11.940111 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68083125-7153-41fb-9a80-58265c1b07e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:11.941009 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68083125-7153-41fb-9a80-58265c1b07e0 None admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:11.941468 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68083125-7153-41fb-9a80-58265c1b07e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:11.941889 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68083125-7153-41fb-9a80-58265c1b07e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:11.942196 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 15/27] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 02:59:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 02:59:11.942955 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68083125-7153-41fb-9a80-58265c1b07e0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:11.943522 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249eb2c-4a66-4639-9484-d4222d0609af None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:11.943809 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249eb2c-4a66-4639-9484-d4222d0609af None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:11.944848 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68083125-7153-41fb-9a80-58265c1b07e0 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:11.951663 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249eb2c-4a66-4639-9484-d4222d0609af None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:11.953429 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 16/28] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 02:59:11 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 02:59:11.954378 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a249eb2c-4a66-4639-9484-d4222d0609af None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:12.064554 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a249eb2c-4a66-4639-9484-d4222d0609af None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:12.107889 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c73e28d-3b08-48cc-9f5f-61a72384f6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:12.108780 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73e28d-3b08-48cc-9f5f-61a72384f6e7 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:12.109081 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73e28d-3b08-48cc-9f5f-61a72384f6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:12.109430 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73e28d-3b08-48cc-9f5f-61a72384f6e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:12.121047 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c73e28d-3b08-48cc-9f5f-61a72384f6e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 02:59:12.130155 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-4c73e28d-3b08-48cc-9f5f-61a72384f6e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 02:59:12.130155 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 02:59:12.130155 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 02:59:12.130155 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 02:59:12.130155 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 02:59:12.130155 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 02:59:12.130155 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 02:59:12.130155 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 02:59:12.130155 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 02:59:12.130155 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 02:59:12.130155 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 02:59:12.130155 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 02:59:12.130155 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 02:59:12.130155 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 02:59:12.130155 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 02:59:12.130155 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 02:59:12.131146 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 02:59:12.131146 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 02:59:12.131146 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 02:59:12.131146 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 02:59:12.131146 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 02:59:12.131146 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 02:59:12.131146 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 02:59:12.131146 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 02:59:12.131146 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 02:59:12.131146 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 02:59:12.131146 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 02:59:12.131146 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 02:59:12.131146 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 02:59:12.131146 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 02:59:12.131146 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 02:59:12.131146 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 02:59:12.132175 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 02:59:12.132175 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 02:59:12.132175 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 02:59:12.132175 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 02:59:12.132175 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 02:59:12.132175 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 02:59:12.132175 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 02:59:12.132175 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 02:59:12.132175 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 02:59:12.132175 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 02:59:12.132175 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 02:59:12.132175 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 02:59:12.139434 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 17/29] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 10 02:59:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 02:59:12.140925 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8f2d8-f0bd-4e57-9797-405be806afeb None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:12.141357 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8f2d8-f0bd-4e57-9797-405be806afeb None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:12.141809 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8f2d8-f0bd-4e57-9797-405be806afeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:12.161688 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-96a8f2d8-f0bd-4e57-9797-405be806afeb None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 02:59:12.163109 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-96a8f2d8-f0bd-4e57-9797-405be806afeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 02:59:12.184356 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 13/30] 10.222.0.65 () {60 vars in 1131 bytes} [Tue May 10 02:59:11 2022] POST /identity/v3/roles => generated 219 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 02:59:12.185354 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68083125-7153-41fb-9a80-58265c1b07e0 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:12.251587 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 18/31] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 02:59:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 02:59:12.259596 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a8f2d8-f0bd-4e57-9797-405be806afeb None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:12.309581 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68083125-7153-41fb-9a80-58265c1b07e0 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:12.344627 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a5aa4-2416-4ad5-9f55-2a210da411a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:12.345371 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a5aa4-2416-4ad5-9f55-2a210da411a7 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:12.345663 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a5aa4-2416-4ad5-9f55-2a210da411a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:12.346136 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a5aa4-2416-4ad5-9f55-2a210da411a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:12.365621 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a5aa4-2416-4ad5-9f55-2a210da411a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:12.367306 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a5aa4-2416-4ad5-9f55-2a210da411a7 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:12.390757 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-dd5a5aa4-2416-4ad5-9f55-2a210da411a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 02:59:12.390757 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 02:59:12.390757 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 02:59:12.390757 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 02:59:12.390757 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 02:59:12.390757 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 02:59:12.390757 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 02:59:12.390757 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 02:59:12.390757 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 02:59:12.390757 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 02:59:12.390757 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 02:59:12.390757 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 02:59:12.390757 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 02:59:12.390757 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 02:59:12.390757 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 02:59:12.391609 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 02:59:12.391609 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 02:59:12.391609 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 02:59:12.391609 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 02:59:12.391609 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 02:59:12.391609 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 02:59:12.391609 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 02:59:12.391609 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 02:59:12.391609 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 02:59:12.391609 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 02:59:12.391609 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 02:59:12.391609 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 02:59:12.391609 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 02:59:12.391609 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 02:59:12.391609 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 02:59:12.391609 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 02:59:12.391609 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 02:59:12.392433 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 02:59:12.392433 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 02:59:12.392433 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 02:59:12.392433 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 02:59:12.392433 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 14/32] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 02:59:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 02:59:12.393124 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a5aa4-2416-4ad5-9f55-2a210da411a7 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:12.396138 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a8f2d8-f0bd-4e57-9797-405be806afeb None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:12.439763 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d9a11f-7b6d-4f53-81d4-24bc6a608959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:12.440840 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9a11f-7b6d-4f53-81d4-24bc6a608959 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:12.441363 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9a11f-7b6d-4f53-81d4-24bc6a608959 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:12.441854 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9a11f-7b6d-4f53-81d4-24bc6a608959 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:12.442815 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d9a11f-7b6d-4f53-81d4-24bc6a608959 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 02:59:12.443319 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d9a11f-7b6d-4f53-81d4-24bc6a608959 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:12.450938 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d9a11f-7b6d-4f53-81d4-24bc6a608959 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:12.471527 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 19/33] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 10 02:59:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:12.477967 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d9a11f-7b6d-4f53-81d4-24bc6a608959 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:12.534922 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a5aa4-2416-4ad5-9f55-2a210da411a7 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:12.576776 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0b16d7-6b60-4e6d-a5e6-8554a53bdb3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:12.577470 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b16d7-6b60-4e6d-a5e6-8554a53bdb3e None admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:12.577765 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b16d7-6b60-4e6d-a5e6-8554a53bdb3e None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:12.578053 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b16d7-6b60-4e6d-a5e6-8554a53bdb3e None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:12.579260 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0b16d7-6b60-4e6d-a5e6-8554a53bdb3e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:12.580897 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0b16d7-6b60-4e6d-a5e6-8554a53bdb3e None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:12.608830 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d9a11f-7b6d-4f53-81d4-24bc6a608959 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:12.643469 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a8e6cb-de82-4696-8efb-4ff7b5756b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:12.644172 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a8e6cb-de82-4696-8efb-4ff7b5756b68 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:12.646109 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a8e6cb-de82-4696-8efb-4ff7b5756b68 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:12.646109 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a8e6cb-de82-4696-8efb-4ff7b5756b68 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:12.646109 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a8e6cb-de82-4696-8efb-4ff7b5756b68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 02:59:12.646109 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a8e6cb-de82-4696-8efb-4ff7b5756b68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:12.647111 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a8e6cb-de82-4696-8efb-4ff7b5756b68 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:12.659447 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 20/34] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 02:59:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:12.660397 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a8e6cb-de82-4696-8efb-4ff7b5756b68 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:12.671580 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 15/35] 10.222.0.65 () {60 vars in 1131 bytes} [Tue May 10 02:59:12 2022] POST /identity/v3/roles => generated 225 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 02:59:12.675080 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0b16d7-6b60-4e6d-a5e6-8554a53bdb3e None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:12.788863 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0b16d7-6b60-4e6d-a5e6-8554a53bdb3e None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:12.801613 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a8e6cb-de82-4696-8efb-4ff7b5756b68 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:12.833670 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d043df3-ef3f-413c-9518-029e24186c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:12.834360 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d043df3-ef3f-413c-9518-029e24186c2e None admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:12.834653 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d043df3-ef3f-413c-9518-029e24186c2e None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:12.835386 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d043df3-ef3f-413c-9518-029e24186c2e None admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:12.836434 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d043df3-ef3f-413c-9518-029e24186c2e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:12.838257 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d043df3-ef3f-413c-9518-029e24186c2e None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:12.840666 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1561d5-35ed-48de-89d8-abed595f50b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:12.841801 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1561d5-35ed-48de-89d8-abed595f50b4 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:12.842280 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1561d5-35ed-48de-89d8-abed595f50b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:12.842794 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1561d5-35ed-48de-89d8-abed595f50b4 None admin] PATH_INFO: `/v3/users/3229265247eb495190623e424798942d` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:12.844270 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1561d5-35ed-48de-89d8-abed595f50b4 None admin] RBAC: Authorizing `identity:get_user(user_id=3229265247eb495190623e424798942d)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:12.846067 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1561d5-35ed-48de-89d8-abed595f50b4 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:12.848154 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 21/36] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 10 02:59:12 2022] GET /identity/v3/users/3229265247eb495190623e424798942d => generated 247 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:12.854774 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1561d5-35ed-48de-89d8-abed595f50b4 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:12.971939 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 16/37] 10.222.0.65 () {60 vars in 1141 bytes} [Tue May 10 02:59:12 2022] POST /identity/v3/projects => generated 301 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 02:59:12.984280 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1561d5-35ed-48de-89d8-abed595f50b4 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:13.029170 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e699fa-dae6-480a-a8f3-8ea6d4794dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:13.030374 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e699fa-dae6-480a-a8f3-8ea6d4794dfc None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:13.030856 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e699fa-dae6-480a-a8f3-8ea6d4794dfc None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:13.031328 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e699fa-dae6-480a-a8f3-8ea6d4794dfc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:13.033132 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e699fa-dae6-480a-a8f3-8ea6d4794dfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:13.034931 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e699fa-dae6-480a-a8f3-8ea6d4794dfc None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:13.037204 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 22/38] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 02:59:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:13.043156 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d043df3-ef3f-413c-9518-029e24186c2e None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:13.135224 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c53e2-44f9-41d6-a49b-f645565b7b70 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:13.135224 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c53e2-44f9-41d6-a49b-f645565b7b70 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:13.135224 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c53e2-44f9-41d6-a49b-f645565b7b70 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:13.135224 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 23/39] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 02:59:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 02:59:13.142301 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8532ee3-78f9-481f-8dfb-b60af14bdd1d None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:13.142587 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8532ee3-78f9-481f-8dfb-b60af14bdd1d None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:13.142965 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8532ee3-78f9-481f-8dfb-b60af14bdd1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:13.164678 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-a8532ee3-78f9-481f-8dfb-b60af14bdd1d None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 02:59:13.166542 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-a8532ee3-78f9-481f-8dfb-b60af14bdd1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 02:59:13.194469 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d043df3-ef3f-413c-9518-029e24186c2e None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:13.233729 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacd8868-ed68-46cf-8a17-c40e9e936b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:13.234933 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd8868-ed68-46cf-8a17-c40e9e936b2a None admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:13.235434 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd8868-ed68-46cf-8a17-c40e9e936b2a None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:13.235917 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd8868-ed68-46cf-8a17-c40e9e936b2a None admin] PATH_INFO: `/v3/domains/default/users/3229265247eb495190623e424798942d/roles/43105000610f402ca2486e7648018cca` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:13.239462 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacd8868-ed68-46cf-8a17-c40e9e936b2a None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=3229265247eb495190623e424798942d, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:13.241248 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacd8868-ed68-46cf-8a17-c40e9e936b2a None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:13.256411 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 24/40] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 02:59:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 02:59:13.279436 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8532ee3-78f9-481f-8dfb-b60af14bdd1d None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:13.343122 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 17/41] 10.222.0.65 () {58 vars in 1361 bytes} [Tue May 10 02:59:13 2022] PUT /identity/v3/domains/default/users/3229265247eb495190623e424798942d/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 02:59:13.379988 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8532ee3-78f9-481f-8dfb-b60af14bdd1d None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:13.417475 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c0f5a-e75f-4419-96f6-c61281dd3c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:13.418166 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c0f5a-e75f-4419-96f6-c61281dd3c86 None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:13.418452 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c0f5a-e75f-4419-96f6-c61281dd3c86 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:13.418730 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c0f5a-e75f-4419-96f6-c61281dd3c86 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:13.419520 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76c0f5a-e75f-4419-96f6-c61281dd3c86 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:13.420987 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76c0f5a-e75f-4419-96f6-c61281dd3c86 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:13.451338 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0257b9-4e32-4b52-86cd-5a72b98fc9ff None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:13.451687 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0257b9-4e32-4b52-86cd-5a72b98fc9ff None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:13.451916 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0257b9-4e32-4b52-86cd-5a72b98fc9ff None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:13.453619 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 18/42] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 02:59:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 02:59:13.459390 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae81cc7-5e3a-4626-a703-558054ca07c7 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:13.459687 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae81cc7-5e3a-4626-a703-558054ca07c7 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:13.459975 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae81cc7-5e3a-4626-a703-558054ca07c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:13.478683 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-0ae81cc7-5e3a-4626-a703-558054ca07c7 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 02:59:13.480297 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-0ae81cc7-5e3a-4626-a703-558054ca07c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 02:59:13.556137 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 19/43] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 02:59:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 02:59:13.579207 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae81cc7-5e3a-4626-a703-558054ca07c7 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:13.608867 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 25/44] 10.222.0.65 () {60 vars in 1131 bytes} [Tue May 10 02:59:13 2022] POST /identity/v3/roles => generated 223 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 02:59:13.682032 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae81cc7-5e3a-4626-a703-558054ca07c7 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:13.718042 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba942dd7-5f7c-43bc-b365-7c7d6f409e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:13.718855 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba942dd7-5f7c-43bc-b365-7c7d6f409e8d None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:13.719140 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba942dd7-5f7c-43bc-b365-7c7d6f409e8d None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:13.719415 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba942dd7-5f7c-43bc-b365-7c7d6f409e8d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:13.720691 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba942dd7-5f7c-43bc-b365-7c7d6f409e8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:13.722166 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba942dd7-5f7c-43bc-b365-7c7d6f409e8d None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:13.723829 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 20/45] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 02:59:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 02:59:13.729936 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c0f5a-e75f-4419-96f6-c61281dd3c86 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:13.833199 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c0f5a-e75f-4419-96f6-c61281dd3c86 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:13.871322 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f2937-aa67-4bbd-82ad-a2c2b6da69ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:13.872012 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f2937-aa67-4bbd-82ad-a2c2b6da69ec None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:13.872310 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f2937-aa67-4bbd-82ad-a2c2b6da69ec None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:13.872587 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f2937-aa67-4bbd-82ad-a2c2b6da69ec None admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:13.873312 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829f2937-aa67-4bbd-82ad-a2c2b6da69ec None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:13.874893 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829f2937-aa67-4bbd-82ad-a2c2b6da69ec None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:13.974420 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 26/46] 10.222.0.65 () {60 vars in 1141 bytes} [Tue May 10 02:59:13 2022] POST /identity/v3/projects => generated 312 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 02:59:15.599051 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b82f3-3c79-4786-9cca-6f001a605359 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:15.599547 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b82f3-3c79-4786-9cca-6f001a605359 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:15.599627 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b82f3-3c79-4786-9cca-6f001a605359 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:15.601005 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 21/47] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 02:59:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 02:59:15.607050 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a208a2a-cd80-4e97-b726-bbdef307cbd2 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:15.607438 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a208a2a-cd80-4e97-b726-bbdef307cbd2 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:15.607617 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a208a2a-cd80-4e97-b726-bbdef307cbd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:15.624073 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-2a208a2a-cd80-4e97-b726-bbdef307cbd2 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 02:59:15.625578 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-2a208a2a-cd80-4e97-b726-bbdef307cbd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 02:59:15.688902 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 27/48] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 02:59:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 02:59:15.711752 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b82f3-3c79-4786-9cca-6f001a605359 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:15.808740 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b82f3-3c79-4786-9cca-6f001a605359 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:15.841907 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280a07c-0979-4206-8538-6e281e03de1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:15.842697 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280a07c-0979-4206-8538-6e281e03de1f None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:15.842984 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280a07c-0979-4206-8538-6e281e03de1f None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:15.843265 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280a07c-0979-4206-8538-6e281e03de1f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:15.852904 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5280a07c-0979-4206-8538-6e281e03de1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 02:59:15.860484 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-5280a07c-0979-4206-8538-6e281e03de1f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 02:59:15.860484 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 02:59:15.860484 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 02:59:15.860484 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 02:59:15.860484 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 02:59:15.860484 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 02:59:15.860484 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 02:59:15.860484 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 02:59:15.860484 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 02:59:15.860484 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 02:59:15.860484 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 02:59:15.860484 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 02:59:15.860484 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 02:59:15.860484 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 02:59:15.860484 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 02:59:15.860484 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 02:59:15.861284 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 02:59:15.861284 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 02:59:15.861284 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 02:59:15.861284 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 02:59:15.861284 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 02:59:15.861284 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 02:59:15.861284 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 02:59:15.861284 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 02:59:15.861284 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 02:59:15.861284 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 02:59:15.861284 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 02:59:15.861284 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 02:59:15.861284 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 02:59:15.861284 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 02:59:15.861284 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 02:59:15.861284 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 02:59:15.862014 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 02:59:15.862014 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 02:59:15.862014 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 02:59:15.862014 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 02:59:15.862014 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 02:59:15.862014 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 02:59:15.862014 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 02:59:15.862014 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 02:59:15.862014 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 02:59:15.862014 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 02:59:15.862014 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 02:59:15.862014 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 02:59:15.862014 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 22/49] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 10 02:59:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 02:59:15.867481 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a208a2a-cd80-4e97-b726-bbdef307cbd2 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:15.960805 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a208a2a-cd80-4e97-b726-bbdef307cbd2 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:15.994980 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01006a1-bd9c-41b5-985a-878eed20b870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:15.995597 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01006a1-bd9c-41b5-985a-878eed20b870 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:15.995883 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01006a1-bd9c-41b5-985a-878eed20b870 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:15.996194 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01006a1-bd9c-41b5-985a-878eed20b870 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:15.996975 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01006a1-bd9c-41b5-985a-878eed20b870 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 02:59:15.997285 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01006a1-bd9c-41b5-985a-878eed20b870 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:15.998728 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01006a1-bd9c-41b5-985a-878eed20b870 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:16.008066 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 28/50] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 10 02:59:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:16.014342 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280a07c-0979-4206-8538-6e281e03de1f None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:16.108757 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280a07c-0979-4206-8538-6e281e03de1f None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:16.141553 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b7ef32-ed62-4967-9cce-b3f9200808da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:16.142420 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7ef32-ed62-4967-9cce-b3f9200808da None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:16.142703 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7ef32-ed62-4967-9cce-b3f9200808da None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:16.142979 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7ef32-ed62-4967-9cce-b3f9200808da None admin] PATH_INFO: `/v3/users/3229265247eb495190623e424798942d` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:16.144188 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b7ef32-ed62-4967-9cce-b3f9200808da None admin] RBAC: Authorizing `identity:get_user(user_id=3229265247eb495190623e424798942d)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:16.145635 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b7ef32-ed62-4967-9cce-b3f9200808da None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:16.147419 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 23/51] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 10 02:59:16 2022] GET /identity/v3/users/3229265247eb495190623e424798942d => generated 247 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:16.152582 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01006a1-bd9c-41b5-985a-878eed20b870 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:16.174736 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a795e-835e-4936-9433-8242567bcf06 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:16.175029 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a795e-835e-4936-9433-8242567bcf06 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:16.175318 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a795e-835e-4936-9433-8242567bcf06 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:16.176718 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 24/52] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 02:59:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 02:59:16.183757 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9086e-f872-4763-a7de-e3bb7e7beb3a None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:16.184073 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9086e-f872-4763-a7de-e3bb7e7beb3a None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:16.184799 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9086e-f872-4763-a7de-e3bb7e7beb3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:16.210345 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-98b9086e-f872-4763-a7de-e3bb7e7beb3a None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 02:59:16.211563 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-98b9086e-f872-4763-a7de-e3bb7e7beb3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 02:59:16.250713 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01006a1-bd9c-41b5-985a-878eed20b870 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:16.277285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 25/53] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 02:59:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 02:59:16.283383 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b2a2e1-04f8-406f-aebf-15d33a2f1b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:16.284205 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b2a2e1-04f8-406f-aebf-15d33a2f1b7b None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:16.284494 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b2a2e1-04f8-406f-aebf-15d33a2f1b7b None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:16.284772 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b2a2e1-04f8-406f-aebf-15d33a2f1b7b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:16.285941 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b2a2e1-04f8-406f-aebf-15d33a2f1b7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:16.287400 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b2a2e1-04f8-406f-aebf-15d33a2f1b7b None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:16.289078 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 29/54] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 02:59:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:16.294751 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b9086e-f872-4763-a7de-e3bb7e7beb3a None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:16.300282 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b2a2e1-04f8-406f-aebf-15d33a2f1b7b None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:16.386624 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b9086e-f872-4763-a7de-e3bb7e7beb3a None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:16.393202 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b2a2e1-04f8-406f-aebf-15d33a2f1b7b None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:16.418604 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7697888c-c369-42ff-9377-75fcd13d8dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:16.419251 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697888c-c369-42ff-9377-75fcd13d8dac None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:16.419534 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697888c-c369-42ff-9377-75fcd13d8dac None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:16.419808 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697888c-c369-42ff-9377-75fcd13d8dac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:16.420674 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7697888c-c369-42ff-9377-75fcd13d8dac None admin] RBAC: Adding query filter params (role.id=43105000610f402ca2486e7648018cca, scope.domain.id=default, user.id=3229265247eb495190623e424798942d) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 02:59:16.420985 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7697888c-c369-42ff-9377-75fcd13d8dac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:16.422408 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7697888c-c369-42ff-9377-75fcd13d8dac None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:16.425390 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe795883-d7ea-4d94-80c2-c9f71cc982d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:16.426168 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe795883-d7ea-4d94-80c2-c9f71cc982d8 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:16.426454 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe795883-d7ea-4d94-80c2-c9f71cc982d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:16.426732 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe795883-d7ea-4d94-80c2-c9f71cc982d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:16.427894 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe795883-d7ea-4d94-80c2-c9f71cc982d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:16.429383 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe795883-d7ea-4d94-80c2-c9f71cc982d8 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:16.430132 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 26/55] 10.222.0.65 () {56 vars in 1322 bytes} [Tue May 10 02:59:16 2022] GET /identity/v3/role_assignments?user.id=3229265247eb495190623e424798942d&scope.domain.id=default&role.id=43105000610f402ca2486e7648018cca => generated 530 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 02:59:16.431657 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 30/56] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 02:59:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 02:59:16.437018 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7697888c-c369-42ff-9377-75fcd13d8dac None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:16.539319 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7697888c-c369-42ff-9377-75fcd13d8dac None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:16.573170 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bbc126-7d1b-48c8-9c5d-cd2a79368c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:16.573846 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bbc126-7d1b-48c8-9c5d-cd2a79368c58 None admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:16.574131 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bbc126-7d1b-48c8-9c5d-cd2a79368c58 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:16.574411 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bbc126-7d1b-48c8-9c5d-cd2a79368c58 None admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:16.575131 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bbc126-7d1b-48c8-9c5d-cd2a79368c58 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:16.576641 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bbc126-7d1b-48c8-9c5d-cd2a79368c58 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:16.659983 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 27/57] 10.222.0.65 () {60 vars in 1140 bytes} [Tue May 10 02:59:16 2022] POST /identity/v3/projects => generated 298 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 02:59:18.858103 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0d0d4-61d4-43d6-94b7-deaa3c9c76a6 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:18.858578 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0d0d4-61d4-43d6-94b7-deaa3c9c76a6 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:18.858578 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0d0d4-61d4-43d6-94b7-deaa3c9c76a6 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:18.859962 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 31/58] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 02:59:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 02:59:18.865214 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c53d67-bcd1-4c2a-adaa-311093184ac1 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:18.865569 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c53d67-bcd1-4c2a-adaa-311093184ac1 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:18.865781 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c53d67-bcd1-4c2a-adaa-311093184ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:18.882504 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-28c53d67-bcd1-4c2a-adaa-311093184ac1 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 02:59:18.883677 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-28c53d67-bcd1-4c2a-adaa-311093184ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 02:59:18.946281 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 28/59] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 02:59:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 02:59:18.969833 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb0d0d4-61d4-43d6-94b7-deaa3c9c76a6 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:19.065151 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb0d0d4-61d4-43d6-94b7-deaa3c9c76a6 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:19.096012 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9836cc10-6f2e-4a8e-b56b-fe44a97df7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:19.096813 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836cc10-6f2e-4a8e-b56b-fe44a97df7d7 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:19.097116 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836cc10-6f2e-4a8e-b56b-fe44a97df7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:19.097375 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836cc10-6f2e-4a8e-b56b-fe44a97df7d7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:19.098745 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9836cc10-6f2e-4a8e-b56b-fe44a97df7d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:19.100257 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9836cc10-6f2e-4a8e-b56b-fe44a97df7d7 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:19.101889 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 32/60] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 02:59:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:19.107923 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c53d67-bcd1-4c2a-adaa-311093184ac1 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:19.200613 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c53d67-bcd1-4c2a-adaa-311093184ac1 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:19.232239 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0238c25d-5fdf-4b15-a8ab-3e7d15377f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:19.232895 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0238c25d-5fdf-4b15-a8ab-3e7d15377f25 None admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:19.233178 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0238c25d-5fdf-4b15-a8ab-3e7d15377f25 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:19.233455 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0238c25d-5fdf-4b15-a8ab-3e7d15377f25 None admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:19.234162 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0238c25d-5fdf-4b15-a8ab-3e7d15377f25 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:19.235592 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0238c25d-5fdf-4b15-a8ab-3e7d15377f25 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:19.326899 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 29/61] 10.222.0.65 () {60 vars in 1132 bytes} [Tue May 10 02:59:19 2022] POST /identity/v3/users => generated 275 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 02:59:22.749222 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4bf62-8265-491e-a1b7-5773c865b34d None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:22.750056 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4bf62-8265-491e-a1b7-5773c865b34d None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:22.750478 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4bf62-8265-491e-a1b7-5773c865b34d None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:22.751976 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 33/62] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 02:59:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 02:59:22.757384 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e28299e-81b4-41e6-a65e-7f21452cee4b None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:22.758125 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e28299e-81b4-41e6-a65e-7f21452cee4b None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:22.759104 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e28299e-81b4-41e6-a65e-7f21452cee4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:22.785028 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-8e28299e-81b4-41e6-a65e-7f21452cee4b None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 02:59:22.786467 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-8e28299e-81b4-41e6-a65e-7f21452cee4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 02:59:22.873102 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 30/63] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 02:59:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 02:59:22.908890 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7f8dd-eeee-450b-8d38-280603d26f1c None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:22.909431 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7f8dd-eeee-450b-8d38-280603d26f1c None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:22.909853 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7f8dd-eeee-450b-8d38-280603d26f1c None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:22.911359 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 34/64] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 02:59:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 02:59:22.912522 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e28299e-81b4-41e6-a65e-7f21452cee4b None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:22.930038 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c8028-9066-4698-860b-9952cd658510 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:22.931107 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c8028-9066-4698-860b-9952cd658510 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:22.931523 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c8028-9066-4698-860b-9952cd658510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:22.957558 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-6a0c8028-9066-4698-860b-9952cd658510 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 02:59:22.959013 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-6a0c8028-9066-4698-860b-9952cd658510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 02:59:23.023796 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e28299e-81b4-41e6-a65e-7f21452cee4b None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:23.062776 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56d81c2-6f85-48b7-89c2-a7cab70711a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:23.063578 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d81c2-6f85-48b7-89c2-a7cab70711a0 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:23.081441 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d81c2-6f85-48b7-89c2-a7cab70711a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:23.081441 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d81c2-6f85-48b7-89c2-a7cab70711a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:23.082487 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56d81c2-6f85-48b7-89c2-a7cab70711a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 02:59:23.090134 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-f56d81c2-6f85-48b7-89c2-a7cab70711a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 02:59:23.090134 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 02:59:23.090134 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 02:59:23.090134 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 02:59:23.090134 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 02:59:23.090134 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 02:59:23.090134 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 02:59:23.090134 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 02:59:23.090134 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 02:59:23.090134 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 02:59:23.090134 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 02:59:23.090134 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 02:59:23.090134 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 02:59:23.090134 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 02:59:23.090134 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 02:59:23.090134 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 02:59:23.090979 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 02:59:23.090979 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 02:59:23.090979 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 02:59:23.090979 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 02:59:23.090979 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 02:59:23.090979 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 02:59:23.090979 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 02:59:23.090979 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 02:59:23.090979 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 02:59:23.090979 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 02:59:23.090979 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 02:59:23.090979 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 02:59:23.090979 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 02:59:23.090979 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 02:59:23.090979 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 02:59:23.090979 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 02:59:23.091888 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 02:59:23.091888 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 02:59:23.091888 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 02:59:23.091888 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 02:59:23.091888 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 02:59:23.091888 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 02:59:23.091888 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 02:59:23.091888 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 02:59:23.091888 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 02:59:23.091888 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 02:59:23.091888 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 02:59:23.091888 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 02:59:23.091888 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 31/65] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 10 02:59:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 02:59:23.102263 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56d81c2-6f85-48b7-89c2-a7cab70711a0 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:23.111279 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 35/66] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 02:59:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 10 02:59:23.167315 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0c8028-9066-4698-860b-9952cd658510 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:23.237600 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56d81c2-6f85-48b7-89c2-a7cab70711a0 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:23.271798 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653f193f-08f6-4548-ae7a-17bcfb2a8e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:23.272512 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f193f-08f6-4548-ae7a-17bcfb2a8e7e None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:23.272799 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f193f-08f6-4548-ae7a-17bcfb2a8e7e None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:23.273076 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f193f-08f6-4548-ae7a-17bcfb2a8e7e None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:23.273891 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653f193f-08f6-4548-ae7a-17bcfb2a8e7e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 02:59:23.274226 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653f193f-08f6-4548-ae7a-17bcfb2a8e7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:23.275621 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653f193f-08f6-4548-ae7a-17bcfb2a8e7e None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:23.284526 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 32/67] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 10 02:59:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:23.285786 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d2859-b3b0-4e0a-a817-50c8824fa8db None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:23.286076 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d2859-b3b0-4e0a-a817-50c8824fa8db None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:23.286354 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d2859-b3b0-4e0a-a817-50c8824fa8db None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:23.292637 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 33/68] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 02:59:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 02:59:23.293422 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d2859-b3b0-4e0a-a817-50c8824fa8db None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:23.299424 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0c8028-9066-4698-860b-9952cd658510 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:23.349700 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2dc995-59bb-4601-8a29-a1c42aa78f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:23.350794 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2dc995-59bb-4601-8a29-a1c42aa78f6c None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:23.351087 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2dc995-59bb-4601-8a29-a1c42aa78f6c None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:23.351367 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2dc995-59bb-4601-8a29-a1c42aa78f6c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:23.366827 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2dc995-59bb-4601-8a29-a1c42aa78f6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 02:59:23.377081 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-dd2dc995-59bb-4601-8a29-a1c42aa78f6c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 02:59:23.377081 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 02:59:23.377081 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 02:59:23.377081 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 02:59:23.377081 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 02:59:23.377081 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 02:59:23.377081 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 02:59:23.377081 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 02:59:23.377081 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 02:59:23.377081 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 02:59:23.377081 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 02:59:23.377081 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 02:59:23.377081 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 02:59:23.377081 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 02:59:23.377081 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 02:59:23.377081 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 02:59:23.377942 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 02:59:23.377942 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 02:59:23.377942 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 02:59:23.377942 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 02:59:23.377942 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 02:59:23.377942 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 02:59:23.377942 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 02:59:23.377942 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 02:59:23.377942 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 02:59:23.377942 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 02:59:23.377942 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 02:59:23.377942 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 02:59:23.377942 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 02:59:23.377942 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 02:59:23.377942 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 02:59:23.377942 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 02:59:23.378692 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 02:59:23.378692 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 02:59:23.378692 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 02:59:23.378692 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 02:59:23.378692 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 02:59:23.378692 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 02:59:23.378692 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 02:59:23.378692 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 02:59:23.378692 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 02:59:23.378692 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 02:59:23.378692 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 02:59:23.378692 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 02:59:23.379262 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 36/69] 10.222.0.65 () {56 vars in 1114 bytes} [Tue May 10 02:59:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 02:59:23.383280 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3bb04-5054-449b-b73b-063f1190b653 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:23.383280 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3bb04-5054-449b-b73b-063f1190b653 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:23.383280 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3bb04-5054-449b-b73b-063f1190b653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:23.396438 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d2859-b3b0-4e0a-a817-50c8824fa8db None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:23.399319 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-9df3bb04-5054-449b-b73b-063f1190b653 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 02:59:23.400544 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-9df3bb04-5054-449b-b73b-063f1190b653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 02:59:23.429620 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dbdfe0-c218-4083-9dc4-fbbe35d0b1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:23.431064 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dbdfe0-c218-4083-9dc4-fbbe35d0b1db None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:23.431350 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dbdfe0-c218-4083-9dc4-fbbe35d0b1db None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:23.431624 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dbdfe0-c218-4083-9dc4-fbbe35d0b1db None admin] PATH_INFO: `/v3/users/3229265247eb495190623e424798942d` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:23.432850 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dbdfe0-c218-4083-9dc4-fbbe35d0b1db None admin] RBAC: Authorizing `identity:get_user(user_id=3229265247eb495190623e424798942d)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:23.434292 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dbdfe0-c218-4083-9dc4-fbbe35d0b1db None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:23.435927 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 34/70] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 10 02:59:23 2022] GET /identity/v3/users/3229265247eb495190623e424798942d => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:23.437176 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a6f6a-bcf1-4360-bb48-58904ef6a6f7 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:23.437466 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a6f6a-bcf1-4360-bb48-58904ef6a6f7 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:23.437745 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a6f6a-bcf1-4360-bb48-58904ef6a6f7 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:23.439106 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 35/71] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 02:59:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 02:59:23.439723 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326a6f6a-bcf1-4360-bb48-58904ef6a6f7 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:23.467042 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 37/72] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 02:59:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 02:59:23.468549 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7042f6-6dda-4469-a33f-a1b2b8fb6af2 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:23.468845 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7042f6-6dda-4469-a33f-a1b2b8fb6af2 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:23.469136 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7042f6-6dda-4469-a33f-a1b2b8fb6af2 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:23.470404 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 38/73] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 02:59:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 02:59:23.474532 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7042f6-6dda-4469-a33f-a1b2b8fb6af2 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:23.542657 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326a6f6a-bcf1-4360-bb48-58904ef6a6f7 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:23.571850 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7042f6-6dda-4469-a33f-a1b2b8fb6af2 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:23.573858 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51276bf-4956-4cb3-a0fe-e0ca5bc624cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:23.574528 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51276bf-4956-4cb3-a0fe-e0ca5bc624cb None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:23.574815 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51276bf-4956-4cb3-a0fe-e0ca5bc624cb None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:23.575095 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51276bf-4956-4cb3-a0fe-e0ca5bc624cb None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:23.575854 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51276bf-4956-4cb3-a0fe-e0ca5bc624cb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 02:59:23.576200 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51276bf-4956-4cb3-a0fe-e0ca5bc624cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:23.577575 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51276bf-4956-4cb3-a0fe-e0ca5bc624cb None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:23.585131 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 36/74] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 10 02:59:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:23.586295 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5112d5-f60d-44fc-8b64-cba934d8fbb3 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:23.587134 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5112d5-f60d-44fc-8b64-cba934d8fbb3 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:23.587417 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5112d5-f60d-44fc-8b64-cba934d8fbb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:23.603178 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-ed5112d5-f60d-44fc-8b64-cba934d8fbb3 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 02:59:23.604414 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-ed5112d5-f60d-44fc-8b64-cba934d8fbb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 02:59:23.604732 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a4d209-d708-4330-a7cd-b1644a112ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:23.605388 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a4d209-d708-4330-a7cd-b1644a112ac1 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:23.605675 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a4d209-d708-4330-a7cd-b1644a112ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:23.605958 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a4d209-d708-4330-a7cd-b1644a112ac1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:23.666712 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 37/75] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 02:59:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 02:59:23.667960 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af394b-92d8-4f02-8f96-15eb7326f38e None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:23.668287 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af394b-92d8-4f02-8f96-15eb7326f38e None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:23.668573 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af394b-92d8-4f02-8f96-15eb7326f38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:23.669503 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a4d209-d708-4330-a7cd-b1644a112ac1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:23.670989 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a4d209-d708-4330-a7cd-b1644a112ac1 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:23.685803 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-85af394b-92d8-4f02-8f96-15eb7326f38e None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 02:59:23.687145 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-85af394b-92d8-4f02-8f96-15eb7326f38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 02:59:23.749130 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 38/76] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 02:59:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 02:59:23.750017 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af394b-92d8-4f02-8f96-15eb7326f38e None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:23.764671 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 39/77] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 10 02:59:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 02:59:23.766016 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a4d209-d708-4330-a7cd-b1644a112ac1 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:23.842538 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af394b-92d8-4f02-8f96-15eb7326f38e None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:23.859253 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a4d209-d708-4330-a7cd-b1644a112ac1 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:23.874340 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20df2e7-1948-4de8-bbed-a81815e893da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:23.875132 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20df2e7-1948-4de8-bbed-a81815e893da None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:23.875413 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20df2e7-1948-4de8-bbed-a81815e893da None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:23.875688 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20df2e7-1948-4de8-bbed-a81815e893da None admin] PATH_INFO: `/v3/roles/member` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:23.885347 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20df2e7-1948-4de8-bbed-a81815e893da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 02:59:23.890790 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b7c895-e104-4277-a503-8fb5728ac6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:23.891654 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7c895-e104-4277-a503-8fb5728ac6e8 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:23.891943 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7c895-e104-4277-a503-8fb5728ac6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:23.892251 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7c895-e104-4277-a503-8fb5728ac6e8 None admin] PATH_INFO: `/v3/users/80d1ae1ee3d6406ba9cfc944e06e2daa` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:23.892957 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-b20df2e7-1948-4de8-bbed-a81815e893da None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 02:59:23.892957 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 02:59:23.892957 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 02:59:23.892957 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 02:59:23.892957 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 02:59:23.892957 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 02:59:23.892957 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 02:59:23.892957 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 02:59:23.892957 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 02:59:23.892957 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 02:59:23.892957 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 02:59:23.892957 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 02:59:23.892957 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 02:59:23.892957 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 02:59:23.892957 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 02:59:23.892957 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 02:59:23.893871 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 02:59:23.893871 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 02:59:23.893871 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 02:59:23.893871 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 02:59:23.893871 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 02:59:23.893871 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 02:59:23.893871 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 02:59:23.893871 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 02:59:23.893871 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 02:59:23.893871 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 02:59:23.893871 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 02:59:23.893871 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 02:59:23.893871 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 02:59:23.893871 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 02:59:23.893871 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 02:59:23.893871 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 02:59:23.894693 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 02:59:23.894693 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 02:59:23.894693 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 02:59:23.894693 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 02:59:23.894693 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 02:59:23.894693 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 02:59:23.894693 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 02:59:23.894693 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 02:59:23.894693 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 02:59:23.894693 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 02:59:23.894693 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 02:59:23.894693 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 02:59:23.894693 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 39/78] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 10 02:59:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 02:59:23.895505 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20df2e7-1948-4de8-bbed-a81815e893da None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:23.906412 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b7c895-e104-4277-a503-8fb5728ac6e8 None admin] RBAC: Authorizing `identity:get_user(user_id=80d1ae1ee3d6406ba9cfc944e06e2daa)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:23.908187 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b7c895-e104-4277-a503-8fb5728ac6e8 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:23.914355 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 40/79] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 10 02:59:23 2022] GET /identity/v3/users/80d1ae1ee3d6406ba9cfc944e06e2daa => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:23.914355 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b7c895-e104-4277-a503-8fb5728ac6e8 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:23.992609 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20df2e7-1948-4de8-bbed-a81815e893da None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:24.002408 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b7c895-e104-4277-a503-8fb5728ac6e8 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:24.029133 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9429e5-0ced-47f3-8132-1e8ef4995436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:24.029930 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9429e5-0ced-47f3-8132-1e8ef4995436 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:24.030220 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9429e5-0ced-47f3-8132-1e8ef4995436 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:24.030501 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9429e5-0ced-47f3-8132-1e8ef4995436 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:24.039443 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5012283d-0dad-46ed-b33c-eb325c058791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:24.040345 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5012283d-0dad-46ed-b33c-eb325c058791 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:24.040633 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5012283d-0dad-46ed-b33c-eb325c058791 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:24.040788 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9429e5-0ced-47f3-8132-1e8ef4995436 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 02:59:24.040896 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5012283d-0dad-46ed-b33c-eb325c058791 None admin] PATH_INFO: `/v3/projects/2db4f8a4c66d4ca684aabd3e75eafbc2` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:24.042098 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5012283d-0dad-46ed-b33c-eb325c058791 None admin] RBAC: Authorizing `identity:get_project(project_id=2db4f8a4c66d4ca684aabd3e75eafbc2)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:24.043552 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5012283d-0dad-46ed-b33c-eb325c058791 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:24.045282 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 41/80] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 10 02:59:23 2022] GET /identity/v3/projects/2db4f8a4c66d4ca684aabd3e75eafbc2 => generated 298 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:24.046045 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5012283d-0dad-46ed-b33c-eb325c058791 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:24.048412 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-be9429e5-0ced-47f3-8132-1e8ef4995436 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 02:59:24.048412 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 02:59:24.048412 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 02:59:24.048412 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 02:59:24.048412 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 02:59:24.048412 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 02:59:24.048412 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 02:59:24.048412 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 02:59:24.048412 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 02:59:24.048412 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 02:59:24.048412 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 02:59:24.048412 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 02:59:24.048412 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 02:59:24.048412 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 02:59:24.048412 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 02:59:24.048412 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 02:59:24.049227 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 02:59:24.049227 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 02:59:24.049227 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 02:59:24.049227 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 02:59:24.049227 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 02:59:24.049227 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 02:59:24.049227 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 02:59:24.049227 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 02:59:24.049227 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 02:59:24.049227 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 02:59:24.049227 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 02:59:24.049227 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 02:59:24.049227 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 02:59:24.049227 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 02:59:24.049227 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 02:59:24.049227 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 02:59:24.049976 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 02:59:24.049976 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 02:59:24.049976 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 02:59:24.049976 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 02:59:24.049976 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 02:59:24.049976 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 02:59:24.049976 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 02:59:24.049976 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 02:59:24.049976 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 02:59:24.049976 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 02:59:24.049976 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 02:59:24.049976 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 02:59:24.049976 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 40/81] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 10 02:59:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 02:59:24.050597 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9429e5-0ced-47f3-8132-1e8ef4995436 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:24.141388 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5012283d-0dad-46ed-b33c-eb325c058791 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:24.143871 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9429e5-0ced-47f3-8132-1e8ef4995436 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:24.173969 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2d509-bb75-4dbd-ba32-cae83ca22906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:24.174763 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2d509-bb75-4dbd-ba32-cae83ca22906 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:24.175055 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2d509-bb75-4dbd-ba32-cae83ca22906 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:24.175337 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2d509-bb75-4dbd-ba32-cae83ca22906 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:24.175606 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f1a83d-7935-4c65-a3c6-7e2012c9f7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:24.176299 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1a83d-7935-4c65-a3c6-7e2012c9f7c9 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:24.176545 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a2d509-bb75-4dbd-ba32-cae83ca22906 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:24.176631 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1a83d-7935-4c65-a3c6-7e2012c9f7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:24.177017 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1a83d-7935-4c65-a3c6-7e2012c9f7c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:24.177811 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f1a83d-7935-4c65-a3c6-7e2012c9f7c9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 02:59:24.177900 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f1a83d-7935-4c65-a3c6-7e2012c9f7c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:24.178001 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a2d509-bb75-4dbd-ba32-cae83ca22906 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:24.179252 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f1a83d-7935-4c65-a3c6-7e2012c9f7c9 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:24.179629 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 42/82] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 02:59:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:24.180525 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2d509-bb75-4dbd-ba32-cae83ca22906 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:24.187489 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 41/83] 10.222.0.65 () {56 vars in 1101 bytes} [Tue May 10 02:59:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:24.188324 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f1a83d-7935-4c65-a3c6-7e2012c9f7c9 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:24.277662 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2d509-bb75-4dbd-ba32-cae83ca22906 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:24.291961 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f1a83d-7935-4c65-a3c6-7e2012c9f7c9 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:24.309764 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e2084b-ecfe-4c67-aa0f-bf491ef96e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:24.310414 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2084b-ecfe-4c67-aa0f-bf491ef96e89 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:24.310701 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2084b-ecfe-4c67-aa0f-bf491ef96e89 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:24.310985 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2084b-ecfe-4c67-aa0f-bf491ef96e89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:24.325943 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3fcb2c-e246-421a-8c48-6b3a41b2fcf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:24.326771 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3fcb2c-e246-421a-8c48-6b3a41b2fcf4 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:24.327256 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3fcb2c-e246-421a-8c48-6b3a41b2fcf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:24.327619 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3fcb2c-e246-421a-8c48-6b3a41b2fcf4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:24.328774 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3fcb2c-e246-421a-8c48-6b3a41b2fcf4 None admin] RBAC: Adding query filter params (role.id=43105000610f402ca2486e7648018cca, scope.project.id=2db4f8a4c66d4ca684aabd3e75eafbc2, user.id=3229265247eb495190623e424798942d) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 02:59:24.329156 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3fcb2c-e246-421a-8c48-6b3a41b2fcf4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:24.330955 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3fcb2c-e246-421a-8c48-6b3a41b2fcf4 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:24.337126 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 42/84] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 10 02:59:24 2022] GET /identity/v3/role_assignments?user.id=3229265247eb495190623e424798942d&scope.project.id=2db4f8a4c66d4ca684aabd3e75eafbc2&role.id=43105000610f402ca2486e7648018cca => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:24.338451 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3fcb2c-e246-421a-8c48-6b3a41b2fcf4 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:24.400595 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e2084b-ecfe-4c67-aa0f-bf491ef96e89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:24.402053 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e2084b-ecfe-4c67-aa0f-bf491ef96e89 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:24.462861 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3fcb2c-e246-421a-8c48-6b3a41b2fcf4 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:24.498605 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ddd53b-7903-4082-90b4-bfa18a4093ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:24.499288 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ddd53b-7903-4082-90b4-bfa18a4093ab None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:24.499578 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ddd53b-7903-4082-90b4-bfa18a4093ab None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:24.499969 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ddd53b-7903-4082-90b4-bfa18a4093ab None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:24.500783 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ddd53b-7903-4082-90b4-bfa18a4093ab None admin] RBAC: Adding query filter params (name=member) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 02:59:24.501088 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ddd53b-7903-4082-90b4-bfa18a4093ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:24.502500 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ddd53b-7903-4082-90b4-bfa18a4093ab None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:24.506903 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 43/85] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 10 02:59:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 02:59:24.512211 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e2084b-ecfe-4c67-aa0f-bf491ef96e89 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:24.516268 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 43/86] 10.222.0.65 () {56 vars in 1101 bytes} [Tue May 10 02:59:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:24.519332 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ddd53b-7903-4082-90b4-bfa18a4093ab None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:24.606558 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e2084b-ecfe-4c67-aa0f-bf491ef96e89 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:24.622000 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ddd53b-7903-4082-90b4-bfa18a4093ab None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:24.639833 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03065e80-365e-4dec-934f-e05d723614cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:24.640612 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03065e80-365e-4dec-934f-e05d723614cb None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:24.640895 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03065e80-365e-4dec-934f-e05d723614cb None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:24.641170 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03065e80-365e-4dec-934f-e05d723614cb None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:24.641879 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03065e80-365e-4dec-934f-e05d723614cb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:24.643330 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03065e80-365e-4dec-934f-e05d723614cb None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:24.657008 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f932d0b5-195a-4231-acc0-7e36ce580069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:24.658313 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f932d0b5-195a-4231-acc0-7e36ce580069 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:24.658744 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f932d0b5-195a-4231-acc0-7e36ce580069 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:24.659188 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f932d0b5-195a-4231-acc0-7e36ce580069 None admin] PATH_INFO: `/v3/users/80d1ae1ee3d6406ba9cfc944e06e2daa` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:24.660576 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f932d0b5-195a-4231-acc0-7e36ce580069 None admin] RBAC: Authorizing `identity:get_user(user_id=80d1ae1ee3d6406ba9cfc944e06e2daa)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:24.662002 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f932d0b5-195a-4231-acc0-7e36ce580069 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:24.663636 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 44/87] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 10 02:59:24 2022] GET /identity/v3/users/80d1ae1ee3d6406ba9cfc944e06e2daa => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:24.664422 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f932d0b5-195a-4231-acc0-7e36ce580069 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:24.737124 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 44/88] 10.222.0.65 () {60 vars in 1132 bytes} [Tue May 10 02:59:24 2022] POST /identity/v3/users => generated 289 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 02:59:24.737124 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03065e80-365e-4dec-934f-e05d723614cb None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:24.765413 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f932d0b5-195a-4231-acc0-7e36ce580069 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:24.802344 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f5f2c-61c9-4e05-9c12-79288dfd872b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:24.803237 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f5f2c-61c9-4e05-9c12-79288dfd872b None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:24.803525 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f5f2c-61c9-4e05-9c12-79288dfd872b None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:24.803807 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f5f2c-61c9-4e05-9c12-79288dfd872b None admin] PATH_INFO: `/v3/projects/2db4f8a4c66d4ca684aabd3e75eafbc2` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:24.805144 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101f5f2c-61c9-4e05-9c12-79288dfd872b None admin] RBAC: Authorizing `identity:get_project(project_id=2db4f8a4c66d4ca684aabd3e75eafbc2)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:24.807273 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101f5f2c-61c9-4e05-9c12-79288dfd872b None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:24.814191 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 45/89] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 10 02:59:24 2022] GET /identity/v3/projects/2db4f8a4c66d4ca684aabd3e75eafbc2 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:24.815185 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f5f2c-61c9-4e05-9c12-79288dfd872b None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:24.862752 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03065e80-365e-4dec-934f-e05d723614cb None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:24.907238 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e707165b-afc1-416d-a3c2-abcddfb2d89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:24.908359 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707165b-afc1-416d-a3c2-abcddfb2d89a None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:24.908692 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707165b-afc1-416d-a3c2-abcddfb2d89a None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:24.908977 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707165b-afc1-416d-a3c2-abcddfb2d89a None admin] PATH_INFO: `/v3/users/80d1ae1ee3d6406ba9cfc944e06e2daa` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:24.910260 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e707165b-afc1-416d-a3c2-abcddfb2d89a None admin] RBAC: Authorizing `identity:get_user(user_id=80d1ae1ee3d6406ba9cfc944e06e2daa)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:24.911773 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e707165b-afc1-416d-a3c2-abcddfb2d89a None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:24.913540 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 45/90] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 10 02:59:24 2022] GET /identity/v3/users/80d1ae1ee3d6406ba9cfc944e06e2daa => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:24.914346 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e707165b-afc1-416d-a3c2-abcddfb2d89a None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:24.926209 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f5f2c-61c9-4e05-9c12-79288dfd872b None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:24.960341 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829bef16-6d7c-489c-bb91-681c83b58586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:24.961006 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829bef16-6d7c-489c-bb91-681c83b58586 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:24.961294 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829bef16-6d7c-489c-bb91-681c83b58586 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:24.961620 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829bef16-6d7c-489c-bb91-681c83b58586 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:25.023044 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e707165b-afc1-416d-a3c2-abcddfb2d89a None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:25.038964 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829bef16-6d7c-489c-bb91-681c83b58586 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:25.041133 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829bef16-6d7c-489c-bb91-681c83b58586 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:25.073326 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e2bd0-ab2b-415b-b7cd-885e27792d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:25.074393 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e2bd0-ab2b-415b-b7cd-885e27792d23 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:25.076289 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e2bd0-ab2b-415b-b7cd-885e27792d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:25.076746 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e2bd0-ab2b-415b-b7cd-885e27792d23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:25.078413 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553e2bd0-ab2b-415b-b7cd-885e27792d23 None admin] RBAC: Adding query filter params (role.id=b2cf4d51cc0b4532adcb7021d474177e, scope.project.id=2db4f8a4c66d4ca684aabd3e75eafbc2, user.id=80d1ae1ee3d6406ba9cfc944e06e2daa) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 02:59:25.079534 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553e2bd0-ab2b-415b-b7cd-885e27792d23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:25.082329 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553e2bd0-ab2b-415b-b7cd-885e27792d23 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:25.088849 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 46/91] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 10 02:59:24 2022] GET /identity/v3/role_assignments?user.id=80d1ae1ee3d6406ba9cfc944e06e2daa&scope.project.id=2db4f8a4c66d4ca684aabd3e75eafbc2&role.id=b2cf4d51cc0b4532adcb7021d474177e => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:25.089948 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e2bd0-ab2b-415b-b7cd-885e27792d23 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:25.182302 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 46/92] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 10 02:59:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 02:59:25.187992 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829bef16-6d7c-489c-bb91-681c83b58586 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:25.242027 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e2bd0-ab2b-415b-b7cd-885e27792d23 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:25.289334 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffbb837-8e02-44a7-b34b-6f805438c47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:25.290575 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffbb837-8e02-44a7-b34b-6f805438c47b None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:25.290865 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffbb837-8e02-44a7-b34b-6f805438c47b None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:25.291613 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffbb837-8e02-44a7-b34b-6f805438c47b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:25.316126 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829bef16-6d7c-489c-bb91-681c83b58586 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:25.355122 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94c772d-0fc5-45e1-a518-a47adb801df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:25.356161 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c772d-0fc5-45e1-a518-a47adb801df9 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:25.356451 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c772d-0fc5-45e1-a518-a47adb801df9 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:25.356731 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c772d-0fc5-45e1-a518-a47adb801df9 None admin] PATH_INFO: `/v3/projects/2db4f8a4c66d4ca684aabd3e75eafbc2` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:25.359116 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94c772d-0fc5-45e1-a518-a47adb801df9 None admin] RBAC: Authorizing `identity:get_project(project_id=2db4f8a4c66d4ca684aabd3e75eafbc2)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:25.360657 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94c772d-0fc5-45e1-a518-a47adb801df9 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:25.362447 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 47/93] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 10 02:59:25 2022] GET /identity/v3/projects/2db4f8a4c66d4ca684aabd3e75eafbc2 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 02:59:25.369042 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94c772d-0fc5-45e1-a518-a47adb801df9 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:25.420388 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffbb837-8e02-44a7-b34b-6f805438c47b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:25.421884 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffbb837-8e02-44a7-b34b-6f805438c47b None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:25.553570 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 47/94] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 10 02:59:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 02:59:25.558641 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94c772d-0fc5-45e1-a518-a47adb801df9 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:25.559222 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffbb837-8e02-44a7-b34b-6f805438c47b None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:25.610851 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf9db5e-2454-42f8-a0b5-216847a83b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:25.611524 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9db5e-2454-42f8-a0b5-216847a83b4d None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:25.611810 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9db5e-2454-42f8-a0b5-216847a83b4d None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:25.612110 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9db5e-2454-42f8-a0b5-216847a83b4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:25.612961 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf9db5e-2454-42f8-a0b5-216847a83b4d None admin] RBAC: Adding query filter params (role.id=bab81fd8d58945b8a1ea63c93b3b4857, scope.project.id=2db4f8a4c66d4ca684aabd3e75eafbc2, user.id=80d1ae1ee3d6406ba9cfc944e06e2daa) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 02:59:25.613277 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf9db5e-2454-42f8-a0b5-216847a83b4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:25.614712 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf9db5e-2454-42f8-a0b5-216847a83b4d None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:25.624985 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 48/95] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 10 02:59:25 2022] GET /identity/v3/role_assignments?user.id=80d1ae1ee3d6406ba9cfc944e06e2daa&scope.project.id=2db4f8a4c66d4ca684aabd3e75eafbc2&role.id=bab81fd8d58945b8a1ea63c93b3b4857 => generated 259 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:25.690538 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffbb837-8e02-44a7-b34b-6f805438c47b None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:25.739609 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae986ba-c674-4510-a049-b594b2462203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:25.740514 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae986ba-c674-4510-a049-b594b2462203 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:25.740804 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae986ba-c674-4510-a049-b594b2462203 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:25.741082 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae986ba-c674-4510-a049-b594b2462203 None admin] PATH_INFO: `/v3/projects/bb7a7713f6074e938dcc6d7ded04ccc0` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:25.742442 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae986ba-c674-4510-a049-b594b2462203 None admin] RBAC: Authorizing `identity:get_project(project_id=bb7a7713f6074e938dcc6d7ded04ccc0)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:25.743991 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae986ba-c674-4510-a049-b594b2462203 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:25.746783 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 48/96] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 10 02:59:25 2022] GET /identity/v3/projects/bb7a7713f6074e938dcc6d7ded04ccc0 => generated 312 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 02:59:25.751643 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf9db5e-2454-42f8-a0b5-216847a83b4d None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:25.861573 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf9db5e-2454-42f8-a0b5-216847a83b4d None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:25.896911 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9fed04-38c0-47a6-bb0d-81ebfd9c7396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:25.897583 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9fed04-38c0-47a6-bb0d-81ebfd9c7396 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:25.897868 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9fed04-38c0-47a6-bb0d-81ebfd9c7396 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:25.898149 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9fed04-38c0-47a6-bb0d-81ebfd9c7396 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:25.899046 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9fed04-38c0-47a6-bb0d-81ebfd9c7396 None admin] RBAC: Adding query filter params (role.id=bab81fd8d58945b8a1ea63c93b3b4857, scope.project.id=bb7a7713f6074e938dcc6d7ded04ccc0, user.id=80d1ae1ee3d6406ba9cfc944e06e2daa) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 02:59:25.899365 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9fed04-38c0-47a6-bb0d-81ebfd9c7396 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:25.900822 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9fed04-38c0-47a6-bb0d-81ebfd9c7396 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:25.906924 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 49/97] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 10 02:59:25 2022] GET /identity/v3/role_assignments?user.id=80d1ae1ee3d6406ba9cfc944e06e2daa&scope.project.id=bb7a7713f6074e938dcc6d7ded04ccc0&role.id=bab81fd8d58945b8a1ea63c93b3b4857 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:26.943219 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae826645-c91c-4d87-8406-7a8217bcb3d4 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:26.943774 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae826645-c91c-4d87-8406-7a8217bcb3d4 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:26.943774 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae826645-c91c-4d87-8406-7a8217bcb3d4 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:26.945180 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 49/98] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 02:59:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 02:59:26.950571 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026143f8-6bc8-4506-8a14-96e3760e80ec None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:26.950981 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026143f8-6bc8-4506-8a14-96e3760e80ec None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:26.951151 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026143f8-6bc8-4506-8a14-96e3760e80ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:26.967891 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-026143f8-6bc8-4506-8a14-96e3760e80ec None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 02:59:26.969179 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-026143f8-6bc8-4506-8a14-96e3760e80ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 02:59:27.051699 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 50/99] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 02:59:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 02:59:27.086299 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae826645-c91c-4d87-8406-7a8217bcb3d4 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:27.211472 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae826645-c91c-4d87-8406-7a8217bcb3d4 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:27.255120 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02585c65-cf28-45f5-8890-97c29e3438cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:27.255934 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02585c65-cf28-45f5-8890-97c29e3438cc None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:27.256247 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02585c65-cf28-45f5-8890-97c29e3438cc None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:27.256525 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02585c65-cf28-45f5-8890-97c29e3438cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:27.273173 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02585c65-cf28-45f5-8890-97c29e3438cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 02:59:27.281714 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-02585c65-cf28-45f5-8890-97c29e3438cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 02:59:27.281714 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 02:59:27.281714 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 02:59:27.281714 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 02:59:27.281714 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 02:59:27.281714 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 02:59:27.281714 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 02:59:27.281714 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 02:59:27.281714 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 02:59:27.281714 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 02:59:27.281714 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 02:59:27.281714 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 02:59:27.281714 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 02:59:27.281714 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 02:59:27.281714 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 02:59:27.281714 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 02:59:27.282950 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 02:59:27.282950 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 02:59:27.282950 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 02:59:27.282950 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 02:59:27.282950 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 02:59:27.282950 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 02:59:27.282950 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 02:59:27.282950 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 02:59:27.282950 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 02:59:27.282950 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 02:59:27.282950 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 02:59:27.282950 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 02:59:27.282950 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 02:59:27.282950 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 02:59:27.282950 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 02:59:27.282950 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 02:59:27.283723 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 02:59:27.283723 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 02:59:27.283723 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 02:59:27.283723 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 02:59:27.283723 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 02:59:27.283723 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 02:59:27.283723 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 02:59:27.283723 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 02:59:27.283723 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 02:59:27.283723 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 02:59:27.283723 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 02:59:27.283723 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 02:59:27.283723 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 50/100] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 10 02:59:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 02:59:27.289407 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026143f8-6bc8-4506-8a14-96e3760e80ec None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:27.400302 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026143f8-6bc8-4506-8a14-96e3760e80ec None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:27.446103 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813babf-2af7-4217-b2cb-bd55ecca3da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:27.446785 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813babf-2af7-4217-b2cb-bd55ecca3da6 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:27.447073 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813babf-2af7-4217-b2cb-bd55ecca3da6 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:27.447357 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813babf-2af7-4217-b2cb-bd55ecca3da6 None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:27.453192 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3813babf-2af7-4217-b2cb-bd55ecca3da6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 02:59:27.453192 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3813babf-2af7-4217-b2cb-bd55ecca3da6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:27.454514 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3813babf-2af7-4217-b2cb-bd55ecca3da6 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:27.470639 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 51/101] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 10 02:59:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:27.475912 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02585c65-cf28-45f5-8890-97c29e3438cc None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:27.596882 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02585c65-cf28-45f5-8890-97c29e3438cc None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:27.635114 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1633825-20f0-4a91-947c-264313732115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:27.635999 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1633825-20f0-4a91-947c-264313732115 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:27.636306 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1633825-20f0-4a91-947c-264313732115 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:27.636587 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1633825-20f0-4a91-947c-264313732115 None admin] PATH_INFO: `/v3/users/3229265247eb495190623e424798942d` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:27.637805 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1633825-20f0-4a91-947c-264313732115 None admin] RBAC: Authorizing `identity:get_user(user_id=3229265247eb495190623e424798942d)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:27.639279 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1633825-20f0-4a91-947c-264313732115 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:27.641113 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 51/102] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 10 02:59:27 2022] GET /identity/v3/users/3229265247eb495190623e424798942d => generated 247 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:27.646509 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813babf-2af7-4217-b2cb-bd55ecca3da6 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:27.802898 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813babf-2af7-4217-b2cb-bd55ecca3da6 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:27.845211 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1115d4d7-0f5f-4e13-b3a7-4395e94eddc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:27.846110 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1115d4d7-0f5f-4e13-b3a7-4395e94eddc4 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:27.846374 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1115d4d7-0f5f-4e13-b3a7-4395e94eddc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:27.846657 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1115d4d7-0f5f-4e13-b3a7-4395e94eddc4 None admin] PATH_INFO: `/v3/projects/2db4f8a4c66d4ca684aabd3e75eafbc2` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:27.848782 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1115d4d7-0f5f-4e13-b3a7-4395e94eddc4 None admin] RBAC: Authorizing `identity:get_project(project_id=2db4f8a4c66d4ca684aabd3e75eafbc2)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:27.850737 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1115d4d7-0f5f-4e13-b3a7-4395e94eddc4 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:27.852732 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 52/103] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 10 02:59:27 2022] GET /identity/v3/projects/2db4f8a4c66d4ca684aabd3e75eafbc2 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:27.858446 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1633825-20f0-4a91-947c-264313732115 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:27.922029 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503d518-84ec-42fe-a493-8a95ce86843d None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:27.922677 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503d518-84ec-42fe-a493-8a95ce86843d None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:27.923175 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503d518-84ec-42fe-a493-8a95ce86843d None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:27.924899 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 53/104] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 02:59:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 02:59:27.932206 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787fb850-0a8b-440b-b925-544bedcd8f13 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:27.932845 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787fb850-0a8b-440b-b925-544bedcd8f13 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:27.933331 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787fb850-0a8b-440b-b925-544bedcd8f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:27.977578 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-787fb850-0a8b-440b-b925-544bedcd8f13 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 02:59:27.979573 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-787fb850-0a8b-440b-b925-544bedcd8f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 02:59:28.023766 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1633825-20f0-4a91-947c-264313732115 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:28.088149 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e479586-1fe9-41fd-990d-32a7dcb4ef69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:28.089292 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e479586-1fe9-41fd-990d-32a7dcb4ef69 None admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:28.089752 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e479586-1fe9-41fd-990d-32a7dcb4ef69 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:28.090178 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e479586-1fe9-41fd-990d-32a7dcb4ef69 None admin] PATH_INFO: `/v3/projects/2db4f8a4c66d4ca684aabd3e75eafbc2/users/3229265247eb495190623e424798942d/roles/43105000610f402ca2486e7648018cca` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:28.092398 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e479586-1fe9-41fd-990d-32a7dcb4ef69 None admin] RBAC: Authorizing `identity:create_grant(project_id=2db4f8a4c66d4ca684aabd3e75eafbc2, user_id=3229265247eb495190623e424798942d, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:28.094019 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e479586-1fe9-41fd-990d-32a7dcb4ef69 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:28.118392 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 54/105] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 02:59:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 02:59:28.156470 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787fb850-0a8b-440b-b925-544bedcd8f13 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:28.193034 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 52/106] 10.222.0.65 () {58 vars in 1439 bytes} [Tue May 10 02:59:27 2022] PUT /identity/v3/projects/2db4f8a4c66d4ca684aabd3e75eafbc2/users/3229265247eb495190623e424798942d/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 02:59:28.288723 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787fb850-0a8b-440b-b925-544bedcd8f13 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:28.338580 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c431e-e866-40a7-832f-e0e6bdacb0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:28.339312 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c431e-e866-40a7-832f-e0e6bdacb0c8 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:28.339600 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c431e-e866-40a7-832f-e0e6bdacb0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:28.339882 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c431e-e866-40a7-832f-e0e6bdacb0c8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:28.373120 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977c431e-e866-40a7-832f-e0e6bdacb0c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 02:59:28.381246 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-977c431e-e866-40a7-832f-e0e6bdacb0c8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 02:59:28.381246 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 02:59:28.381246 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 02:59:28.381246 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 02:59:28.381246 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 02:59:28.381246 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 02:59:28.381246 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 02:59:28.381246 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 02:59:28.381246 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 02:59:28.381246 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 02:59:28.381246 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 02:59:28.381246 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 02:59:28.381246 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 02:59:28.381246 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 02:59:28.381246 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 02:59:28.381246 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 02:59:28.382139 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 02:59:28.382139 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 02:59:28.382139 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 02:59:28.382139 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 02:59:28.382139 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 02:59:28.382139 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 02:59:28.382139 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 02:59:28.382139 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 02:59:28.382139 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 02:59:28.382139 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 02:59:28.382139 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 02:59:28.382139 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 02:59:28.382139 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 02:59:28.382139 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 02:59:28.382139 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 02:59:28.382139 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 02:59:28.382893 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 02:59:28.382893 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 02:59:28.382893 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 02:59:28.382893 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 02:59:28.382893 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 02:59:28.382893 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 02:59:28.382893 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 02:59:28.382893 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 02:59:28.382893 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 02:59:28.382893 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 02:59:28.382893 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 02:59:28.382893 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 02:59:28.382893 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 55/107] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 10 02:59:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 02:59:28.388887 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e479586-1fe9-41fd-990d-32a7dcb4ef69 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:28.531556 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e479586-1fe9-41fd-990d-32a7dcb4ef69 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:28.571282 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e1a10-731b-4c3a-a281-dde201769ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:28.571980 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e1a10-731b-4c3a-a281-dde201769ab3 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:28.572297 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e1a10-731b-4c3a-a281-dde201769ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:28.572578 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e1a10-731b-4c3a-a281-dde201769ab3 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:28.573347 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716e1a10-731b-4c3a-a281-dde201769ab3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 02:59:28.573659 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716e1a10-731b-4c3a-a281-dde201769ab3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:28.575066 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716e1a10-731b-4c3a-a281-dde201769ab3 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:28.583723 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 53/108] 10.222.0.65 () {56 vars in 1101 bytes} [Tue May 10 02:59:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:28.593199 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c431e-e866-40a7-832f-e0e6bdacb0c8 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:28.761574 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c431e-e866-40a7-832f-e0e6bdacb0c8 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:28.790815 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951fb99a-0c8f-4ca6-950f-c72a806fbce2 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:28.791476 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951fb99a-0c8f-4ca6-950f-c72a806fbce2 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:28.791974 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951fb99a-0c8f-4ca6-950f-c72a806fbce2 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:28.793629 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 54/109] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 02:59:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 02:59:28.799068 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dbe0e7-d905-40d7-bce3-43f9892727ad None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:28.799603 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dbe0e7-d905-40d7-bce3-43f9892727ad None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:28.800152 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dbe0e7-d905-40d7-bce3-43f9892727ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:28.804971 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37185900-1f03-4462-a3c1-7ee130b99c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:28.806385 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37185900-1f03-4462-a3c1-7ee130b99c43 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:28.806661 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37185900-1f03-4462-a3c1-7ee130b99c43 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:28.806941 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37185900-1f03-4462-a3c1-7ee130b99c43 None admin] PATH_INFO: `/v3/users/e0bd530123684a0e9ddbebce1608ec92` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:28.818880 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-28dbe0e7-d905-40d7-bce3-43f9892727ad None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 02:59:28.820443 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-28dbe0e7-d905-40d7-bce3-43f9892727ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 02:59:28.833695 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37185900-1f03-4462-a3c1-7ee130b99c43 None admin] RBAC: Authorizing `identity:get_user(user_id=e0bd530123684a0e9ddbebce1608ec92)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:28.835173 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37185900-1f03-4462-a3c1-7ee130b99c43 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:28.837019 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 56/110] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 10 02:59:28 2022] GET /identity/v3/users/e0bd530123684a0e9ddbebce1608ec92 => generated 289 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:28.844231 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37185900-1f03-4462-a3c1-7ee130b99c43 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:28.893286 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 55/111] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 02:59:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 02:59:28.949287 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dbe0e7-d905-40d7-bce3-43f9892727ad None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:29.023359 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37185900-1f03-4462-a3c1-7ee130b99c43 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:29.104504 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e412469-cb6a-419f-9cb1-f0dbc7925b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:29.105094 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e412469-cb6a-419f-9cb1-f0dbc7925b32 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:29.105387 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e412469-cb6a-419f-9cb1-f0dbc7925b32 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:29.105672 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e412469-cb6a-419f-9cb1-f0dbc7925b32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:29.127783 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dbe0e7-d905-40d7-bce3-43f9892727ad None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:29.196910 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f5d161-e80b-4f78-baf8-6e07af51d3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:29.198119 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5d161-e80b-4f78-baf8-6e07af51d3e5 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:29.198621 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5d161-e80b-4f78-baf8-6e07af51d3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:29.199110 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5d161-e80b-4f78-baf8-6e07af51d3e5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:29.202175 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f5d161-e80b-4f78-baf8-6e07af51d3e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:29.204054 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f5d161-e80b-4f78-baf8-6e07af51d3e5 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:29.207080 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 56/112] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 02:59:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 02:59:29.212118 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b19345-c49f-4c00-977a-4ecf01086252 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:29.212755 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b19345-c49f-4c00-977a-4ecf01086252 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:29.213249 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b19345-c49f-4c00-977a-4ecf01086252 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:29.215235 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 57/113] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 02:59:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 02:59:29.216382 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b19345-c49f-4c00-977a-4ecf01086252 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:29.245013 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e412469-cb6a-419f-9cb1-f0dbc7925b32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:29.246759 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e412469-cb6a-419f-9cb1-f0dbc7925b32 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:29.329862 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b19345-c49f-4c00-977a-4ecf01086252 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:29.366692 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8d80aa-96b9-461b-bfdb-2687526543c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:29.367077 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d80aa-96b9-461b-bfdb-2687526543c7 None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:29.367653 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d80aa-96b9-461b-bfdb-2687526543c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:29.368672 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d80aa-96b9-461b-bfdb-2687526543c7 None admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:29.369691 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8d80aa-96b9-461b-bfdb-2687526543c7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:29.371496 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8d80aa-96b9-461b-bfdb-2687526543c7 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:29.376213 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 57/114] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 10 02:59:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 02:59:29.377957 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed1b85-14a2-4f3d-a3f7-7b30b4e7bb8e None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:29.379244 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed1b85-14a2-4f3d-a3f7-7b30b4e7bb8e None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:29.380400 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed1b85-14a2-4f3d-a3f7-7b30b4e7bb8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:29.399393 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-55ed1b85-14a2-4f3d-a3f7-7b30b4e7bb8e None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 02:59:29.400733 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-55ed1b85-14a2-4f3d-a3f7-7b30b4e7bb8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 02:59:29.461781 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 58/115] 10.222.0.65 () {60 vars in 1141 bytes} [Tue May 10 02:59:29 2022] POST /identity/v3/projects => generated 302 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 02:59:29.469564 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af471667-74b2-40b3-9605-05c3992b38b7 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:29.469901 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af471667-74b2-40b3-9605-05c3992b38b7 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:29.470138 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af471667-74b2-40b3-9605-05c3992b38b7 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:29.470456 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 58/116] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 02:59:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 02:59:29.471308 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed1b85-14a2-4f3d-a3f7-7b30b4e7bb8e None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:29.481851 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 59/117] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 02:59:29 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 02:59:29.483215 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e92e9-dc96-4828-90b5-64e9585db487 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:29.483508 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e92e9-dc96-4828-90b5-64e9585db487 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:29.483794 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e92e9-dc96-4828-90b5-64e9585db487 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:29.485275 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 60/118] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 02:59:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 02:59:29.491004 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3524f44-eb72-49c8-928e-3ae70140e03c None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:29.491309 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3524f44-eb72-49c8-928e-3ae70140e03c None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:29.491572 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3524f44-eb72-49c8-928e-3ae70140e03c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:29.521846 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-d3524f44-eb72-49c8-928e-3ae70140e03c None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 02:59:29.523401 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-d3524f44-eb72-49c8-928e-3ae70140e03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 02:59:29.596969 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 61/119] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 02:59:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 02:59:29.598310 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4347e5-aa6c-4c21-b09f-4eb5c1d231fc None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:29.598420 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed1b85-14a2-4f3d-a3f7-7b30b4e7bb8e None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:29.598595 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4347e5-aa6c-4c21-b09f-4eb5c1d231fc None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:29.598883 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4347e5-aa6c-4c21-b09f-4eb5c1d231fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:29.616831 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-db4347e5-aa6c-4c21-b09f-4eb5c1d231fc None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 02:59:29.618008 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-db4347e5-aa6c-4c21-b09f-4eb5c1d231fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 02:59:29.659734 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f36b42-770c-4675-9a58-673e984c0889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:29.659734 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f36b42-770c-4675-9a58-673e984c0889 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:29.660044 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f36b42-770c-4675-9a58-673e984c0889 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:29.660126 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f36b42-770c-4675-9a58-673e984c0889 None admin] PATH_INFO: `/v3/projects/2db4f8a4c66d4ca684aabd3e75eafbc2` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:29.663811 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f36b42-770c-4675-9a58-673e984c0889 None admin] RBAC: Authorizing `identity:get_project(project_id=2db4f8a4c66d4ca684aabd3e75eafbc2)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:29.665890 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f36b42-770c-4675-9a58-673e984c0889 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:29.667651 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 59/120] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 10 02:59:29 2022] GET /identity/v3/projects/2db4f8a4c66d4ca684aabd3e75eafbc2 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:29.672847 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f36b42-770c-4675-9a58-673e984c0889 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:29.692812 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 62/121] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 02:59:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 02:59:29.693690 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4347e5-aa6c-4c21-b09f-4eb5c1d231fc None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:29.810944 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f36b42-770c-4675-9a58-673e984c0889 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:29.815533 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4347e5-aa6c-4c21-b09f-4eb5c1d231fc None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:29.855689 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcafb44-5da9-4095-aa5b-2c580992bf30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:29.856524 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcafb44-5da9-4095-aa5b-2c580992bf30 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:29.856811 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcafb44-5da9-4095-aa5b-2c580992bf30 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:29.857089 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcafb44-5da9-4095-aa5b-2c580992bf30 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:29.861247 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b952ac9-0547-479a-96c7-1624949ca23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:29.862040 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b952ac9-0547-479a-96c7-1624949ca23f None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:29.862323 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b952ac9-0547-479a-96c7-1624949ca23f None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:29.862599 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b952ac9-0547-479a-96c7-1624949ca23f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:29.871351 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcafb44-5da9-4095-aa5b-2c580992bf30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 02:59:29.876437 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b952ac9-0547-479a-96c7-1624949ca23f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 02:59:29.878964 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-fbcafb44-5da9-4095-aa5b-2c580992bf30 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 02:59:29.878964 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 02:59:29.878964 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 02:59:29.878964 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 02:59:29.878964 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 02:59:29.878964 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 02:59:29.878964 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 02:59:29.878964 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 02:59:29.878964 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 02:59:29.878964 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 02:59:29.878964 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 02:59:29.878964 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 02:59:29.878964 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 02:59:29.878964 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 02:59:29.878964 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 02:59:29.878964 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 02:59:29.879864 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 02:59:29.879864 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 02:59:29.879864 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 02:59:29.879864 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 02:59:29.879864 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 02:59:29.879864 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 02:59:29.879864 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 02:59:29.879864 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 02:59:29.879864 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 02:59:29.879864 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 02:59:29.879864 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 02:59:29.879864 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 02:59:29.879864 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 02:59:29.879864 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 02:59:29.879864 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 02:59:29.879864 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 02:59:29.880637 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 02:59:29.880637 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 02:59:29.880637 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 02:59:29.880637 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 02:59:29.880637 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 02:59:29.880637 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 02:59:29.880637 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 02:59:29.880637 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 02:59:29.880637 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 02:59:29.880637 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 02:59:29.880637 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 02:59:29.880637 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 02:59:29.880637 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 63/122] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 10 02:59:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 02:59:29.881306 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcafb44-5da9-4095-aa5b-2c580992bf30 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:29.889598 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-8b952ac9-0547-479a-96c7-1624949ca23f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 02:59:29.889598 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 02:59:29.889598 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 02:59:29.889598 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 02:59:29.889598 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 02:59:29.889598 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 02:59:29.889598 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 02:59:29.889598 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 02:59:29.889598 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 02:59:29.889598 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 02:59:29.889598 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 02:59:29.889598 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 02:59:29.889598 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 02:59:29.889598 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 02:59:29.889598 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 02:59:29.889598 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 02:59:29.890687 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 02:59:29.890687 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 02:59:29.890687 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 02:59:29.890687 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 02:59:29.890687 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 02:59:29.890687 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 02:59:29.890687 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 02:59:29.890687 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 02:59:29.890687 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 02:59:29.890687 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 02:59:29.890687 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 02:59:29.890687 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 02:59:29.890687 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 02:59:29.890687 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 02:59:29.890687 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 02:59:29.890687 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 02:59:29.891661 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 02:59:29.891661 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 02:59:29.891661 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 02:59:29.891661 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 02:59:29.891661 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 02:59:29.891661 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 02:59:29.891661 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 02:59:29.891661 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 02:59:29.891661 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 02:59:29.891661 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 02:59:29.891661 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 02:59:29.891661 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 02:59:29.894085 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 60/123] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 10 02:59:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 02:59:29.894999 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b952ac9-0547-479a-96c7-1624949ca23f None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:29.993499 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcafb44-5da9-4095-aa5b-2c580992bf30 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:30.008813 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b952ac9-0547-479a-96c7-1624949ca23f None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:30.027340 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47776ac5-49ac-4765-afc5-626b2683b37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:30.028212 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47776ac5-49ac-4765-afc5-626b2683b37b None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:30.028649 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47776ac5-49ac-4765-afc5-626b2683b37b None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:30.029031 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47776ac5-49ac-4765-afc5-626b2683b37b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:30.030229 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47776ac5-49ac-4765-afc5-626b2683b37b None admin] RBAC: Adding query filter params (role.id=d1526e6293dc47b1a0e78c462f588dac, scope.project.id=2db4f8a4c66d4ca684aabd3e75eafbc2, user.id=e0bd530123684a0e9ddbebce1608ec92) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 02:59:30.030346 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47776ac5-49ac-4765-afc5-626b2683b37b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:30.031918 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47776ac5-49ac-4765-afc5-626b2683b37b None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:30.044212 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 64/124] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 10 02:59:29 2022] GET /identity/v3/role_assignments?user.id=e0bd530123684a0e9ddbebce1608ec92&scope.project.id=2db4f8a4c66d4ca684aabd3e75eafbc2&role.id=d1526e6293dc47b1a0e78c462f588dac => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:30.045426 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47776ac5-49ac-4765-afc5-626b2683b37b None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:30.046403 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195db46d-e798-4ba0-91a5-7b5c2c0ebe10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:30.047749 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195db46d-e798-4ba0-91a5-7b5c2c0ebe10 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:30.048220 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195db46d-e798-4ba0-91a5-7b5c2c0ebe10 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:30.048646 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195db46d-e798-4ba0-91a5-7b5c2c0ebe10 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:30.061266 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195db46d-e798-4ba0-91a5-7b5c2c0ebe10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 02:59:30.069962 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-195db46d-e798-4ba0-91a5-7b5c2c0ebe10 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 02:59:30.069962 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 02:59:30.069962 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 02:59:30.069962 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 02:59:30.069962 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 02:59:30.069962 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 02:59:30.069962 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 02:59:30.069962 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 02:59:30.069962 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 02:59:30.069962 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 02:59:30.069962 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 02:59:30.069962 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 02:59:30.069962 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 02:59:30.069962 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 02:59:30.069962 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 02:59:30.069962 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 02:59:30.070936 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 02:59:30.070936 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 02:59:30.070936 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 02:59:30.070936 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 02:59:30.070936 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 02:59:30.070936 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 02:59:30.070936 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 02:59:30.070936 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 02:59:30.070936 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 02:59:30.070936 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 02:59:30.070936 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 02:59:30.070936 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 02:59:30.070936 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 02:59:30.070936 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 02:59:30.070936 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 02:59:30.070936 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 02:59:30.071703 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 02:59:30.071703 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 02:59:30.071703 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 02:59:30.071703 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 02:59:30.071703 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 02:59:30.071703 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 02:59:30.071703 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 02:59:30.071703 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 02:59:30.071703 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 02:59:30.071703 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 02:59:30.071703 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 02:59:30.071703 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 02:59:30.074158 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 61/125] 10.222.0.65 () {56 vars in 1114 bytes} [Tue May 10 02:59:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 02:59:30.075131 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195db46d-e798-4ba0-91a5-7b5c2c0ebe10 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:30.181053 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195db46d-e798-4ba0-91a5-7b5c2c0ebe10 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:30.216535 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e583bb88-b206-4c5c-a8fd-c6b2de408cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:30.217598 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583bb88-b206-4c5c-a8fd-c6b2de408cb8 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:30.218088 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583bb88-b206-4c5c-a8fd-c6b2de408cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:30.218199 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47776ac5-49ac-4765-afc5-626b2683b37b None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:30.219003 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583bb88-b206-4c5c-a8fd-c6b2de408cb8 None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:30.219969 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e583bb88-b206-4c5c-a8fd-c6b2de408cb8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 02:59:30.220524 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e583bb88-b206-4c5c-a8fd-c6b2de408cb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:30.222162 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e583bb88-b206-4c5c-a8fd-c6b2de408cb8 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:30.231913 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 62/126] 10.222.0.65 () {56 vars in 1101 bytes} [Tue May 10 02:59:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:30.233107 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e583bb88-b206-4c5c-a8fd-c6b2de408cb8 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:30.264509 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f0df3f-9dc7-4869-b1f2-ec5d195a8fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:30.265196 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0df3f-9dc7-4869-b1f2-ec5d195a8fbb None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:30.265486 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0df3f-9dc7-4869-b1f2-ec5d195a8fbb None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:30.265768 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0df3f-9dc7-4869-b1f2-ec5d195a8fbb None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:30.266530 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f0df3f-9dc7-4869-b1f2-ec5d195a8fbb None admin] RBAC: Adding query filter params (name=member) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 02:59:30.266844 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f0df3f-9dc7-4869-b1f2-ec5d195a8fbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:30.268305 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f0df3f-9dc7-4869-b1f2-ec5d195a8fbb None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:30.282884 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 65/127] 10.222.0.65 () {56 vars in 1101 bytes} [Tue May 10 02:59:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:30.283887 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f0df3f-9dc7-4869-b1f2-ec5d195a8fbb None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:30.344792 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e583bb88-b206-4c5c-a8fd-c6b2de408cb8 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:30.381248 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a77b9-3a7d-4a81-8fbf-efc910d4fe92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:30.382331 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a77b9-3a7d-4a81-8fbf-efc910d4fe92 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:30.382826 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a77b9-3a7d-4a81-8fbf-efc910d4fe92 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:30.383881 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a77b9-3a7d-4a81-8fbf-efc910d4fe92 None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:30.384974 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a77b9-3a7d-4a81-8fbf-efc910d4fe92 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 02:59:30.385523 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a77b9-3a7d-4a81-8fbf-efc910d4fe92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:30.387177 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a77b9-3a7d-4a81-8fbf-efc910d4fe92 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:30.396881 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 63/128] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 10 02:59:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:30.398055 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a77b9-3a7d-4a81-8fbf-efc910d4fe92 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:30.468965 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f0df3f-9dc7-4869-b1f2-ec5d195a8fbb None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:30.501675 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a77b9-3a7d-4a81-8fbf-efc910d4fe92 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:30.523694 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fe2057-1830-4920-88b9-d0e12ee8c88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:30.524643 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe2057-1830-4920-88b9-d0e12ee8c88d None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:30.524925 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe2057-1830-4920-88b9-d0e12ee8c88d None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:30.525200 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe2057-1830-4920-88b9-d0e12ee8c88d None admin] PATH_INFO: `/v3/users/80d1ae1ee3d6406ba9cfc944e06e2daa` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:30.526859 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fe2057-1830-4920-88b9-d0e12ee8c88d None admin] RBAC: Authorizing `identity:get_user(user_id=80d1ae1ee3d6406ba9cfc944e06e2daa)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:30.529589 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fe2057-1830-4920-88b9-d0e12ee8c88d None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:30.531969 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 66/129] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 10 02:59:30 2022] GET /identity/v3/users/80d1ae1ee3d6406ba9cfc944e06e2daa => generated 275 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:30.533031 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fe2057-1830-4920-88b9-d0e12ee8c88d None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:30.577851 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af59d6-6b37-49d9-85aa-fde685c24921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:30.578776 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af59d6-6b37-49d9-85aa-fde685c24921 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:30.579063 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af59d6-6b37-49d9-85aa-fde685c24921 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:30.579344 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af59d6-6b37-49d9-85aa-fde685c24921 None admin] PATH_INFO: `/v3/users/80d1ae1ee3d6406ba9cfc944e06e2daa` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:30.580794 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26af59d6-6b37-49d9-85aa-fde685c24921 None admin] RBAC: Authorizing `identity:get_user(user_id=80d1ae1ee3d6406ba9cfc944e06e2daa)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:30.583468 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26af59d6-6b37-49d9-85aa-fde685c24921 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:30.588167 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 64/130] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 10 02:59:30 2022] GET /identity/v3/users/80d1ae1ee3d6406ba9cfc944e06e2daa => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:30.589900 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af59d6-6b37-49d9-85aa-fde685c24921 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:30.684406 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fe2057-1830-4920-88b9-d0e12ee8c88d None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:30.725091 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ecdb7-2e91-466e-ba7e-c261d720d4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:30.726082 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ecdb7-2e91-466e-ba7e-c261d720d4ab None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:30.726280 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ecdb7-2e91-466e-ba7e-c261d720d4ab None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:30.726528 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ecdb7-2e91-466e-ba7e-c261d720d4ab None admin] PATH_INFO: `/v3/users/80d1ae1ee3d6406ba9cfc944e06e2daa` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:30.732982 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5ecdb7-2e91-466e-ba7e-c261d720d4ab None admin] RBAC: Authorizing `identity:get_user(user_id=80d1ae1ee3d6406ba9cfc944e06e2daa)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:30.734491 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5ecdb7-2e91-466e-ba7e-c261d720d4ab None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:30.736350 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 67/131] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 10 02:59:30 2022] GET /identity/v3/users/80d1ae1ee3d6406ba9cfc944e06e2daa => generated 275 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:30.737133 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ecdb7-2e91-466e-ba7e-c261d720d4ab None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:30.738561 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af59d6-6b37-49d9-85aa-fde685c24921 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:30.773634 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c1c6e-557c-4c6b-8757-ccdb99c524ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:30.774876 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c1c6e-557c-4c6b-8757-ccdb99c524ce None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:30.775404 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c1c6e-557c-4c6b-8757-ccdb99c524ce None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:30.775878 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c1c6e-557c-4c6b-8757-ccdb99c524ce None admin] PATH_INFO: `/v3/projects/bb7a7713f6074e938dcc6d7ded04ccc0` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:30.777294 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36c1c6e-557c-4c6b-8757-ccdb99c524ce None admin] RBAC: Authorizing `identity:get_project(project_id=bb7a7713f6074e938dcc6d7ded04ccc0)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:30.778941 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36c1c6e-557c-4c6b-8757-ccdb99c524ce None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:30.781193 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 65/132] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 10 02:59:30 2022] GET /identity/v3/projects/bb7a7713f6074e938dcc6d7ded04ccc0 => generated 312 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:30.782181 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c1c6e-557c-4c6b-8757-ccdb99c524ce None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:30.882646 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c1c6e-557c-4c6b-8757-ccdb99c524ce None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:30.912026 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ecdb7-2e91-466e-ba7e-c261d720d4ab None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:30.921839 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d88478-7064-4352-b8a0-5a8a432159e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:30.922738 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d88478-7064-4352-b8a0-5a8a432159e1 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:30.923028 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d88478-7064-4352-b8a0-5a8a432159e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:30.923313 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d88478-7064-4352-b8a0-5a8a432159e1 None admin] PATH_INFO: `/v3/projects/2db4f8a4c66d4ca684aabd3e75eafbc2` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:30.924679 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d88478-7064-4352-b8a0-5a8a432159e1 None admin] RBAC: Authorizing `identity:get_project(project_id=2db4f8a4c66d4ca684aabd3e75eafbc2)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:30.926181 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d88478-7064-4352-b8a0-5a8a432159e1 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:30.928030 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 66/133] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 10 02:59:30 2022] GET /identity/v3/projects/2db4f8a4c66d4ca684aabd3e75eafbc2 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:30.928814 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d88478-7064-4352-b8a0-5a8a432159e1 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:30.955829 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d8a246-d919-40e8-ab39-147d1b6c5976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:30.957038 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8a246-d919-40e8-ab39-147d1b6c5976 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:30.957333 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8a246-d919-40e8-ab39-147d1b6c5976 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:30.957617 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8a246-d919-40e8-ab39-147d1b6c5976 None admin] PATH_INFO: `/v3/projects/2db4f8a4c66d4ca684aabd3e75eafbc2` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:30.959314 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d8a246-d919-40e8-ab39-147d1b6c5976 None admin] RBAC: Authorizing `identity:get_project(project_id=2db4f8a4c66d4ca684aabd3e75eafbc2)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:30.961735 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d8a246-d919-40e8-ab39-147d1b6c5976 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:30.964540 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 68/134] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 10 02:59:30 2022] GET /identity/v3/projects/2db4f8a4c66d4ca684aabd3e75eafbc2 => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:30.965900 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37e62b-0635-4c8e-8ab2-cb7f563a2cf9 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:30.966191 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37e62b-0635-4c8e-8ab2-cb7f563a2cf9 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:30.966535 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37e62b-0635-4c8e-8ab2-cb7f563a2cf9 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:30.967878 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 69/135] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 02:59:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 02:59:30.968656 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f37e62b-0635-4c8e-8ab2-cb7f563a2cf9 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:31.043052 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d88478-7064-4352-b8a0-5a8a432159e1 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:31.077446 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec08b895-e0f7-4cb2-8703-a375d531cea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:31.079270 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08b895-e0f7-4cb2-8703-a375d531cea3 None admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:31.079884 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08b895-e0f7-4cb2-8703-a375d531cea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:31.080373 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08b895-e0f7-4cb2-8703-a375d531cea3 None admin] PATH_INFO: `/v3/projects/bb7a7713f6074e938dcc6d7ded04ccc0/users/80d1ae1ee3d6406ba9cfc944e06e2daa/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:31.083705 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec08b895-e0f7-4cb2-8703-a375d531cea3 None admin] RBAC: Authorizing `identity:create_grant(project_id=bb7a7713f6074e938dcc6d7ded04ccc0, user_id=80d1ae1ee3d6406ba9cfc944e06e2daa, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:31.085770 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec08b895-e0f7-4cb2-8703-a375d531cea3 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:31.097237 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f37e62b-0635-4c8e-8ab2-cb7f563a2cf9 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:31.129939 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267bd191-ad02-424b-84af-f17ac1c4462d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:31.130845 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267bd191-ad02-424b-84af-f17ac1c4462d None admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:31.131135 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267bd191-ad02-424b-84af-f17ac1c4462d None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:31.131419 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267bd191-ad02-424b-84af-f17ac1c4462d None admin] PATH_INFO: `/v3/projects/2db4f8a4c66d4ca684aabd3e75eafbc2/users/80d1ae1ee3d6406ba9cfc944e06e2daa/roles/b2cf4d51cc0b4532adcb7021d474177e` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:31.133675 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267bd191-ad02-424b-84af-f17ac1c4462d None admin] RBAC: Authorizing `identity:create_grant(project_id=2db4f8a4c66d4ca684aabd3e75eafbc2, user_id=80d1ae1ee3d6406ba9cfc944e06e2daa, role_id=b2cf4d51cc0b4532adcb7021d474177e)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:31.135130 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267bd191-ad02-424b-84af-f17ac1c4462d None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:31.208032 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 67/136] 10.222.0.65 () {58 vars in 1439 bytes} [Tue May 10 02:59:30 2022] PUT /identity/v3/projects/bb7a7713f6074e938dcc6d7ded04ccc0/users/80d1ae1ee3d6406ba9cfc944e06e2daa/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 02:59:31.208032 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec08b895-e0f7-4cb2-8703-a375d531cea3 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:31.231268 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 70/137] 10.222.0.65 () {58 vars in 1439 bytes} [Tue May 10 02:59:30 2022] PUT /identity/v3/projects/2db4f8a4c66d4ca684aabd3e75eafbc2/users/80d1ae1ee3d6406ba9cfc944e06e2daa/roles/b2cf4d51cc0b4532adcb7021d474177e => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 02:59:31.232913 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9423d15-c21f-491a-8679-879848153fac None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:31.233257 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9423d15-c21f-491a-8679-879848153fac None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:31.233545 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9423d15-c21f-491a-8679-879848153fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:31.266269 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-e9423d15-c21f-491a-8679-879848153fac None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 02:59:31.268851 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-e9423d15-c21f-491a-8679-879848153fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 02:59:31.378411 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 71/138] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 02:59:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 02:59:31.403282 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec08b895-e0f7-4cb2-8703-a375d531cea3 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:31.424564 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9423d15-c21f-491a-8679-879848153fac None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:31.456924 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d5d45-e287-447e-be2c-d373eb967ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:31.458119 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d5d45-e287-447e-be2c-d373eb967ba2 None admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:31.458409 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d5d45-e287-447e-be2c-d373eb967ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:31.458690 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d5d45-e287-447e-be2c-d373eb967ba2 None admin] PATH_INFO: `/v3/projects/2db4f8a4c66d4ca684aabd3e75eafbc2/users/80d1ae1ee3d6406ba9cfc944e06e2daa/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:31.464030 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7d5d45-e287-447e-be2c-d373eb967ba2 None admin] RBAC: Authorizing `identity:create_grant(project_id=2db4f8a4c66d4ca684aabd3e75eafbc2, user_id=80d1ae1ee3d6406ba9cfc944e06e2daa, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:31.464030 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7d5d45-e287-447e-be2c-d373eb967ba2 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:31.533591 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 68/139] 10.222.0.65 () {58 vars in 1439 bytes} [Tue May 10 02:59:31 2022] PUT /identity/v3/projects/2db4f8a4c66d4ca684aabd3e75eafbc2/users/80d1ae1ee3d6406ba9cfc944e06e2daa/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 02:59:31.574991 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9423d15-c21f-491a-8679-879848153fac None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:31.614306 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0aac2-1ab3-407d-8157-989c0bd93ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:31.615161 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0aac2-1ab3-407d-8157-989c0bd93ef7 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:31.615453 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0aac2-1ab3-407d-8157-989c0bd93ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:31.615737 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0aac2-1ab3-407d-8157-989c0bd93ef7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:31.628251 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d0aac2-1ab3-407d-8157-989c0bd93ef7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 02:59:31.636982 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-48d0aac2-1ab3-407d-8157-989c0bd93ef7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 02:59:31.636982 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 02:59:31.636982 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 02:59:31.636982 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 02:59:31.636982 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 02:59:31.636982 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 02:59:31.636982 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 02:59:31.636982 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 02:59:31.636982 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 02:59:31.636982 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 02:59:31.636982 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 02:59:31.636982 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 02:59:31.636982 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 02:59:31.636982 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 02:59:31.636982 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 02:59:31.636982 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 02:59:31.637876 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 02:59:31.637876 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 02:59:31.637876 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 02:59:31.637876 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 02:59:31.637876 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 02:59:31.637876 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 02:59:31.637876 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 02:59:31.637876 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 02:59:31.637876 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 02:59:31.637876 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 02:59:31.637876 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 02:59:31.637876 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 02:59:31.637876 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 02:59:31.637876 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 02:59:31.637876 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 02:59:31.637876 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 02:59:31.638631 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 02:59:31.638631 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 02:59:31.638631 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 02:59:31.638631 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 02:59:31.638631 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 02:59:31.638631 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 02:59:31.638631 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 02:59:31.638631 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 02:59:31.638631 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 02:59:31.638631 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 02:59:31.638631 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 02:59:31.638631 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 02:59:31.638631 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 72/140] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 10 02:59:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 02:59:31.644853 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d5d45-e287-447e-be2c-d373eb967ba2 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:31.772019 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d5d45-e287-447e-be2c-d373eb967ba2 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:31.811645 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19924b7-e36a-4984-841d-80b7b0123b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:31.812782 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19924b7-e36a-4984-841d-80b7b0123b9f None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:31.813303 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19924b7-e36a-4984-841d-80b7b0123b9f None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:31.813790 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19924b7-e36a-4984-841d-80b7b0123b9f None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:31.814757 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19924b7-e36a-4984-841d-80b7b0123b9f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 02:59:31.815263 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19924b7-e36a-4984-841d-80b7b0123b9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:31.816882 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19924b7-e36a-4984-841d-80b7b0123b9f None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:31.826995 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 69/141] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 10 02:59:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:31.832454 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0aac2-1ab3-407d-8157-989c0bd93ef7 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:31.976117 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0aac2-1ab3-407d-8157-989c0bd93ef7 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:32.014475 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd1f3a8-6026-4a14-9041-f3e0087a5d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:32.015358 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1f3a8-6026-4a14-9041-f3e0087a5d2c None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:32.015650 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1f3a8-6026-4a14-9041-f3e0087a5d2c None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:32.015938 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1f3a8-6026-4a14-9041-f3e0087a5d2c None admin] PATH_INFO: `/v3/users/3229265247eb495190623e424798942d` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:32.019990 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd1f3a8-6026-4a14-9041-f3e0087a5d2c None admin] RBAC: Authorizing `identity:get_user(user_id=3229265247eb495190623e424798942d)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:32.021570 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd1f3a8-6026-4a14-9041-f3e0087a5d2c None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:32.032217 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 73/142] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 10 02:59:31 2022] GET /identity/v3/users/3229265247eb495190623e424798942d => generated 247 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:32.032350 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19924b7-e36a-4984-841d-80b7b0123b9f None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:32.148522 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19924b7-e36a-4984-841d-80b7b0123b9f None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:32.187488 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f19d1-2eb9-4de8-b480-ecdde763afc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:32.188184 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f19d1-2eb9-4de8-b480-ecdde763afc2 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:32.188476 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f19d1-2eb9-4de8-b480-ecdde763afc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:32.188760 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f19d1-2eb9-4de8-b480-ecdde763afc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:32.261926 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910f19d1-2eb9-4de8-b480-ecdde763afc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:32.263322 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910f19d1-2eb9-4de8-b480-ecdde763afc2 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:32.376056 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 70/143] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 10 02:59:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 02:59:32.381202 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd1f3a8-6026-4a14-9041-f3e0087a5d2c None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:32.554394 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd1f3a8-6026-4a14-9041-f3e0087a5d2c None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:32.594300 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946eeace-9df6-412e-8f61-773f8bccf369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:32.595178 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946eeace-9df6-412e-8f61-773f8bccf369 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:32.595524 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946eeace-9df6-412e-8f61-773f8bccf369 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:32.595814 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946eeace-9df6-412e-8f61-773f8bccf369 None admin] PATH_INFO: `/v3/projects/2db4f8a4c66d4ca684aabd3e75eafbc2` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:32.597062 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946eeace-9df6-412e-8f61-773f8bccf369 None admin] RBAC: Authorizing `identity:get_project(project_id=2db4f8a4c66d4ca684aabd3e75eafbc2)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:32.598535 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946eeace-9df6-412e-8f61-773f8bccf369 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:32.600511 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 74/144] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 10 02:59:32 2022] GET /identity/v3/projects/2db4f8a4c66d4ca684aabd3e75eafbc2 => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:32.606796 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f19d1-2eb9-4de8-b480-ecdde763afc2 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:32.696428 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1129c8-532b-4a08-a8f6-c67828179b05 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:32.696746 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1129c8-532b-4a08-a8f6-c67828179b05 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:32.697004 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1129c8-532b-4a08-a8f6-c67828179b05 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:32.698650 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 75/145] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 02:59:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 02:59:32.713421 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e73f2f-f44a-4858-902d-263b8302ac66 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:32.713718 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e73f2f-f44a-4858-902d-263b8302ac66 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:32.713999 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e73f2f-f44a-4858-902d-263b8302ac66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:32.726408 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f19d1-2eb9-4de8-b480-ecdde763afc2 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:32.749051 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-65e73f2f-f44a-4858-902d-263b8302ac66 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 02:59:32.750265 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-65e73f2f-f44a-4858-902d-263b8302ac66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 02:59:32.768188 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b1f86c-63ba-47e5-b461-0c93806f0b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:32.769098 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b1f86c-63ba-47e5-b461-0c93806f0b51 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:32.769534 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b1f86c-63ba-47e5-b461-0c93806f0b51 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:32.769960 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b1f86c-63ba-47e5-b461-0c93806f0b51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:32.770954 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b1f86c-63ba-47e5-b461-0c93806f0b51 None admin] RBAC: Adding query filter params (role.id=43105000610f402ca2486e7648018cca, scope.project.id=2db4f8a4c66d4ca684aabd3e75eafbc2, user.id=3229265247eb495190623e424798942d) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 02:59:32.771444 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b1f86c-63ba-47e5-b461-0c93806f0b51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:32.773366 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b1f86c-63ba-47e5-b461-0c93806f0b51 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:32.780737 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 71/146] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 10 02:59:32 2022] GET /identity/v3/role_assignments?user.id=3229265247eb495190623e424798942d&scope.project.id=2db4f8a4c66d4ca684aabd3e75eafbc2&role.id=43105000610f402ca2486e7648018cca => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:32.891251 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 76/147] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 02:59:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 02:59:32.931269 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b1f86c-63ba-47e5-b461-0c93806f0b51 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:33.064606 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b1f86c-63ba-47e5-b461-0c93806f0b51 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:33.100372 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67255cc4-01d6-46da-9fd1-b9cf5e5d72f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:33.101300 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67255cc4-01d6-46da-9fd1-b9cf5e5d72f2 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:33.101591 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67255cc4-01d6-46da-9fd1-b9cf5e5d72f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:33.101983 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67255cc4-01d6-46da-9fd1-b9cf5e5d72f2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:33.103377 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67255cc4-01d6-46da-9fd1-b9cf5e5d72f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:33.104886 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67255cc4-01d6-46da-9fd1-b9cf5e5d72f2 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:33.106573 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 72/148] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 02:59:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:33.112033 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e73f2f-f44a-4858-902d-263b8302ac66 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:33.214458 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e73f2f-f44a-4858-902d-263b8302ac66 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:33.241134 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e4990-e597-46cf-838c-7b70cf15aaea None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:33.241624 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e4990-e597-46cf-838c-7b70cf15aaea None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:33.241694 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e4990-e597-46cf-838c-7b70cf15aaea None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:33.243363 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 73/149] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 02:59:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 02:59:33.248778 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae8c02-b319-49fe-bd38-e35a53a98971 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:33.249041 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae8c02-b319-49fe-bd38-e35a53a98971 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:33.249330 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae8c02-b319-49fe-bd38-e35a53a98971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:33.259375 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad66cb2-e424-4807-92a4-70c1303cfe1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:33.260087 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad66cb2-e424-4807-92a4-70c1303cfe1a None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:33.260379 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad66cb2-e424-4807-92a4-70c1303cfe1a None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:33.260659 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad66cb2-e424-4807-92a4-70c1303cfe1a None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:33.261385 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad66cb2-e424-4807-92a4-70c1303cfe1a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:33.263318 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad66cb2-e424-4807-92a4-70c1303cfe1a None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:33.267944 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-d6ae8c02-b319-49fe-bd38-e35a53a98971 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 02:59:33.271383 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-d6ae8c02-b319-49fe-bd38-e35a53a98971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 02:59:33.348679 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 74/150] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 02:59:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 02:59:33.372756 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae8c02-b319-49fe-bd38-e35a53a98971 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:33.383741 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 77/151] 10.222.0.65 () {60 vars in 1132 bytes} [Tue May 10 02:59:33 2022] POST /identity/v3/users => generated 283 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 02:59:33.492105 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae8c02-b319-49fe-bd38-e35a53a98971 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:33.530099 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfc88b1-0520-4f6e-8cce-dd5f24dab4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:33.530911 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc88b1-0520-4f6e-8cce-dd5f24dab4e7 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:33.531198 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc88b1-0520-4f6e-8cce-dd5f24dab4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:33.531477 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc88b1-0520-4f6e-8cce-dd5f24dab4e7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:33.542659 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfc88b1-0520-4f6e-8cce-dd5f24dab4e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 02:59:33.550667 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-2dfc88b1-0520-4f6e-8cce-dd5f24dab4e7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 02:59:33.550667 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 02:59:33.550667 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 02:59:33.550667 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 02:59:33.550667 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 02:59:33.550667 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 02:59:33.550667 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 02:59:33.550667 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 02:59:33.550667 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 02:59:33.550667 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 02:59:33.550667 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 02:59:33.550667 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 02:59:33.550667 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 02:59:33.550667 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 02:59:33.550667 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 02:59:33.550667 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 02:59:33.551573 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 02:59:33.551573 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 02:59:33.551573 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 02:59:33.551573 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 02:59:33.551573 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 02:59:33.551573 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 02:59:33.551573 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 02:59:33.551573 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 02:59:33.551573 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 02:59:33.551573 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 02:59:33.551573 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 02:59:33.551573 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 02:59:33.551573 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 02:59:33.551573 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 02:59:33.551573 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 02:59:33.551573 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 02:59:33.552482 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 02:59:33.552482 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 02:59:33.552482 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 02:59:33.552482 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 02:59:33.552482 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 02:59:33.552482 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 02:59:33.552482 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 02:59:33.552482 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 02:59:33.552482 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 02:59:33.552482 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 02:59:33.552482 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 02:59:33.552482 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 02:59:33.552482 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 75/152] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 10 02:59:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 02:59:33.558731 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad66cb2-e424-4807-92a4-70c1303cfe1a None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:33.682901 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad66cb2-e424-4807-92a4-70c1303cfe1a None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:33.724613 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a172e3-684c-4def-860b-961c25bc4fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:33.725305 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a172e3-684c-4def-860b-961c25bc4fc4 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:33.725594 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a172e3-684c-4def-860b-961c25bc4fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:33.725878 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a172e3-684c-4def-860b-961c25bc4fc4 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:33.726652 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a172e3-684c-4def-860b-961c25bc4fc4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 02:59:33.727508 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a172e3-684c-4def-860b-961c25bc4fc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:33.728947 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a172e3-684c-4def-860b-961c25bc4fc4 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:33.740911 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 78/153] 10.222.0.65 () {56 vars in 1101 bytes} [Tue May 10 02:59:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:33.747143 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfc88b1-0520-4f6e-8cce-dd5f24dab4e7 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:33.879826 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfc88b1-0520-4f6e-8cce-dd5f24dab4e7 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:33.925762 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1380d2-4b73-40c9-a699-2b76e12ef1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:33.926967 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1380d2-4b73-40c9-a699-2b76e12ef1ab None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:33.927426 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1380d2-4b73-40c9-a699-2b76e12ef1ab None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:33.927871 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1380d2-4b73-40c9-a699-2b76e12ef1ab None admin] PATH_INFO: `/v3/users/e0bd530123684a0e9ddbebce1608ec92` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:33.931903 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1380d2-4b73-40c9-a699-2b76e12ef1ab None admin] RBAC: Authorizing `identity:get_user(user_id=e0bd530123684a0e9ddbebce1608ec92)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:33.933566 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1380d2-4b73-40c9-a699-2b76e12ef1ab None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:33.935766 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 76/154] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 10 02:59:33 2022] GET /identity/v3/users/e0bd530123684a0e9ddbebce1608ec92 => generated 289 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:33.940857 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a172e3-684c-4def-860b-961c25bc4fc4 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:33.962330 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd23a6a-2b13-4f73-8f03-f909eb9bffb0 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:33.962925 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd23a6a-2b13-4f73-8f03-f909eb9bffb0 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:33.963399 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd23a6a-2b13-4f73-8f03-f909eb9bffb0 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:33.964990 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 77/155] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 02:59:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 02:59:33.976432 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0062884-f86c-484d-b00c-997a3d0cb545 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:33.977503 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0062884-f86c-484d-b00c-997a3d0cb545 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:33.977953 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0062884-f86c-484d-b00c-997a3d0cb545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:33.996490 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-d0062884-f86c-484d-b00c-997a3d0cb545 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 02:59:33.998087 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-d0062884-f86c-484d-b00c-997a3d0cb545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 02:59:34.067299 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a172e3-684c-4def-860b-961c25bc4fc4 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:34.079416 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 78/156] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 02:59:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 02:59:34.104933 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94797f91-eca4-4fa3-a360-4e5422c3ebe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:34.106173 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94797f91-eca4-4fa3-a360-4e5422c3ebe9 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:34.106662 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94797f91-eca4-4fa3-a360-4e5422c3ebe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:34.107112 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94797f91-eca4-4fa3-a360-4e5422c3ebe9 None admin] PATH_INFO: `/v3/projects/2db4f8a4c66d4ca684aabd3e75eafbc2` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:34.107281 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0062884-f86c-484d-b00c-997a3d0cb545 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:34.108690 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94797f91-eca4-4fa3-a360-4e5422c3ebe9 None admin] RBAC: Authorizing `identity:get_project(project_id=2db4f8a4c66d4ca684aabd3e75eafbc2)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:34.110359 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94797f91-eca4-4fa3-a360-4e5422c3ebe9 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:34.112308 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 79/157] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 10 02:59:33 2022] GET /identity/v3/projects/2db4f8a4c66d4ca684aabd3e75eafbc2 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:34.119622 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94797f91-eca4-4fa3-a360-4e5422c3ebe9 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:34.212913 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0062884-f86c-484d-b00c-997a3d0cb545 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:34.228934 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94797f91-eca4-4fa3-a360-4e5422c3ebe9 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:34.247534 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f552b-3937-4846-b5cb-3ce7c426e9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:34.248410 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f552b-3937-4846-b5cb-3ce7c426e9a9 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:34.248633 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f552b-3937-4846-b5cb-3ce7c426e9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:34.248906 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f552b-3937-4846-b5cb-3ce7c426e9a9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:34.260137 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44f552b-3937-4846-b5cb-3ce7c426e9a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 02:59:34.264656 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4e28c-8172-45e7-b1bd-5083bbf5062d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:34.265782 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4e28c-8172-45e7-b1bd-5083bbf5062d None admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:34.266252 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4e28c-8172-45e7-b1bd-5083bbf5062d None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:34.266722 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4e28c-8172-45e7-b1bd-5083bbf5062d None admin] PATH_INFO: `/v3/projects/2db4f8a4c66d4ca684aabd3e75eafbc2/users/e0bd530123684a0e9ddbebce1608ec92/roles/d1526e6293dc47b1a0e78c462f588dac` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:34.268869 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-d44f552b-3937-4846-b5cb-3ce7c426e9a9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 02:59:34.268869 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 02:59:34.268869 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 02:59:34.268869 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 02:59:34.268869 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 02:59:34.268869 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 02:59:34.268869 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 02:59:34.268869 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 02:59:34.268869 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 02:59:34.268869 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 02:59:34.268869 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 02:59:34.268869 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 02:59:34.268869 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 02:59:34.268869 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 02:59:34.268869 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 02:59:34.268869 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 02:59:34.269710 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 02:59:34.269710 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 02:59:34.269710 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 02:59:34.269710 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 02:59:34.269710 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 02:59:34.269710 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 02:59:34.269710 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 02:59:34.269710 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 02:59:34.269710 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 02:59:34.269710 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 02:59:34.269710 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 02:59:34.269710 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 02:59:34.269710 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 02:59:34.269710 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 02:59:34.269710 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 02:59:34.269710 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 02:59:34.270746 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 02:59:34.270746 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 02:59:34.270746 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 02:59:34.270746 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 02:59:34.270746 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 02:59:34.270746 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 02:59:34.270746 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 02:59:34.270746 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 02:59:34.270746 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 02:59:34.270746 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 02:59:34.270746 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 02:59:34.270746 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 02:59:34.270746 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 79/158] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 10 02:59:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 02:59:34.271920 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4e28c-8172-45e7-b1bd-5083bbf5062d None admin] RBAC: Authorizing `identity:create_grant(project_id=2db4f8a4c66d4ca684aabd3e75eafbc2, user_id=e0bd530123684a0e9ddbebce1608ec92, role_id=d1526e6293dc47b1a0e78c462f588dac)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:34.274232 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4e28c-8172-45e7-b1bd-5083bbf5062d None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:34.276393 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f552b-3937-4846-b5cb-3ce7c426e9a9 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:34.358788 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 80/159] 10.222.0.65 () {58 vars in 1439 bytes} [Tue May 10 02:59:34 2022] PUT /identity/v3/projects/2db4f8a4c66d4ca684aabd3e75eafbc2/users/e0bd530123684a0e9ddbebce1608ec92/roles/d1526e6293dc47b1a0e78c462f588dac => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 02:59:34.390371 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f552b-3937-4846-b5cb-3ce7c426e9a9 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:34.427110 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bba9738-d868-4850-b683-ea64e56b385f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:34.427799 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba9738-d868-4850-b683-ea64e56b385f None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:34.428101 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba9738-d868-4850-b683-ea64e56b385f None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:34.428376 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba9738-d868-4850-b683-ea64e56b385f None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:34.429145 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bba9738-d868-4850-b683-ea64e56b385f None admin] RBAC: Adding query filter params (name=member) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 02:59:34.429446 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bba9738-d868-4850-b683-ea64e56b385f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:34.430900 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bba9738-d868-4850-b683-ea64e56b385f None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:34.440360 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 80/160] 10.222.0.65 () {56 vars in 1101 bytes} [Tue May 10 02:59:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 02:59:34.446095 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4e28c-8172-45e7-b1bd-5083bbf5062d None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:34.557593 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4e28c-8172-45e7-b1bd-5083bbf5062d None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:34.594102 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b434bfe-b1fa-4290-a8e2-b0b52b146d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:34.594996 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b434bfe-b1fa-4290-a8e2-b0b52b146d3a None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:34.595274 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b434bfe-b1fa-4290-a8e2-b0b52b146d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:34.595546 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b434bfe-b1fa-4290-a8e2-b0b52b146d3a None admin] PATH_INFO: `/v3/users/80d1ae1ee3d6406ba9cfc944e06e2daa` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:34.596887 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b434bfe-b1fa-4290-a8e2-b0b52b146d3a None admin] RBAC: Authorizing `identity:get_user(user_id=80d1ae1ee3d6406ba9cfc944e06e2daa)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:34.598498 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b434bfe-b1fa-4290-a8e2-b0b52b146d3a None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:34.600331 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 81/161] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 10 02:59:34 2022] GET /identity/v3/users/80d1ae1ee3d6406ba9cfc944e06e2daa => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:34.606003 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bba9738-d868-4850-b683-ea64e56b385f None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:34.713092 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bba9738-d868-4850-b683-ea64e56b385f None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:34.747328 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a2d380-39a6-46c5-bc16-2a94559c88a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:34.748043 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2d380-39a6-46c5-bc16-2a94559c88a7 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:34.748308 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2d380-39a6-46c5-bc16-2a94559c88a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:34.748585 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2d380-39a6-46c5-bc16-2a94559c88a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:34.822810 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a2d380-39a6-46c5-bc16-2a94559c88a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:34.824237 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a2d380-39a6-46c5-bc16-2a94559c88a7 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:34.929584 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 81/162] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 10 02:59:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 02:59:34.935635 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b434bfe-b1fa-4290-a8e2-b0b52b146d3a None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:34.989682 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9885f26-3293-4444-8c90-157dfcf15c37 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:34.990019 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9885f26-3293-4444-8c90-157dfcf15c37 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:34.990227 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9885f26-3293-4444-8c90-157dfcf15c37 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:34.991598 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 82/163] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 02:59:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 02:59:35.001829 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebaf223-b30e-4f22-8a87-08dc78a01380 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:35.002127 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebaf223-b30e-4f22-8a87-08dc78a01380 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:35.002381 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebaf223-b30e-4f22-8a87-08dc78a01380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:35.029268 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-eebaf223-b30e-4f22-8a87-08dc78a01380 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 02:59:35.030447 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-eebaf223-b30e-4f22-8a87-08dc78a01380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 02:59:35.073407 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b434bfe-b1fa-4290-a8e2-b0b52b146d3a None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:35.108196 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0208a912-e1be-4dd4-b082-3e27b46e0cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:35.109341 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208a912-e1be-4dd4-b082-3e27b46e0cff None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:35.109627 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208a912-e1be-4dd4-b082-3e27b46e0cff None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:35.109905 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208a912-e1be-4dd4-b082-3e27b46e0cff None admin] PATH_INFO: `/v3/projects/bb7a7713f6074e938dcc6d7ded04ccc0` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:35.111092 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0208a912-e1be-4dd4-b082-3e27b46e0cff None admin] RBAC: Authorizing `identity:get_project(project_id=bb7a7713f6074e938dcc6d7ded04ccc0)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:35.112585 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0208a912-e1be-4dd4-b082-3e27b46e0cff None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:35.114412 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 82/164] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 10 02:59:34 2022] GET /identity/v3/projects/bb7a7713f6074e938dcc6d7ded04ccc0 => generated 312 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:35.115669 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878208a-7a48-4b8e-b187-0fe989ec7357 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:35.115943 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878208a-7a48-4b8e-b187-0fe989ec7357 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:35.116244 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878208a-7a48-4b8e-b187-0fe989ec7357 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:35.123245 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 83/165] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 02:59:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 02:59:35.127294 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b878208a-7a48-4b8e-b187-0fe989ec7357 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:35.135738 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 83/166] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 02:59:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 02:59:35.137430 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0946c-8605-4fbc-ab58-22974066b19c None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:35.137744 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0946c-8605-4fbc-ab58-22974066b19c None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:35.138019 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0946c-8605-4fbc-ab58-22974066b19c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:35.169000 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-d8e0946c-8605-4fbc-ab58-22974066b19c None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 02:59:35.171156 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-d8e0946c-8605-4fbc-ab58-22974066b19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 02:59:35.280119 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 84/167] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 02:59:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 02:59:35.281786 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e0946c-8605-4fbc-ab58-22974066b19c None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:35.337847 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b878208a-7a48-4b8e-b187-0fe989ec7357 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:35.394207 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e0946c-8605-4fbc-ab58-22974066b19c None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:35.422097 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8784ef8-24b2-4fa0-8990-d00b72f7bb08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:35.423087 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8784ef8-24b2-4fa0-8990-d00b72f7bb08 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:35.423550 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8784ef8-24b2-4fa0-8990-d00b72f7bb08 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:35.424023 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8784ef8-24b2-4fa0-8990-d00b72f7bb08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:35.425032 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8784ef8-24b2-4fa0-8990-d00b72f7bb08 None admin] RBAC: Adding query filter params (role.id=bab81fd8d58945b8a1ea63c93b3b4857, scope.project.id=bb7a7713f6074e938dcc6d7ded04ccc0, user.id=80d1ae1ee3d6406ba9cfc944e06e2daa) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 02:59:35.425519 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8784ef8-24b2-4fa0-8990-d00b72f7bb08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:35.427185 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8784ef8-24b2-4fa0-8990-d00b72f7bb08 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:35.431505 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20326d80-09f6-481a-8658-3e920845ee01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:35.432593 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20326d80-09f6-481a-8658-3e920845ee01 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:35.433005 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20326d80-09f6-481a-8658-3e920845ee01 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:35.433417 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20326d80-09f6-481a-8658-3e920845ee01 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:35.444728 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20326d80-09f6-481a-8658-3e920845ee01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 02:59:35.447805 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 84/168] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 10 02:59:35 2022] GET /identity/v3/role_assignments?user.id=80d1ae1ee3d6406ba9cfc944e06e2daa&scope.project.id=bb7a7713f6074e938dcc6d7ded04ccc0&role.id=bab81fd8d58945b8a1ea63c93b3b4857 => generated 608 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:35.449567 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8784ef8-24b2-4fa0-8990-d00b72f7bb08 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:35.468795 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-20326d80-09f6-481a-8658-3e920845ee01 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 02:59:35.468795 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 02:59:35.468795 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 02:59:35.468795 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 02:59:35.468795 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 02:59:35.468795 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 02:59:35.468795 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 02:59:35.468795 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 02:59:35.468795 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 02:59:35.468795 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 02:59:35.468795 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 02:59:35.468795 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 02:59:35.468795 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 02:59:35.468795 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 02:59:35.468795 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 02:59:35.468795 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 02:59:35.469713 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 02:59:35.469713 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 02:59:35.469713 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 02:59:35.469713 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 02:59:35.469713 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 02:59:35.469713 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 02:59:35.469713 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 02:59:35.469713 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 02:59:35.469713 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 02:59:35.469713 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 02:59:35.469713 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 02:59:35.469713 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 02:59:35.469713 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 02:59:35.469713 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 02:59:35.469713 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 02:59:35.469713 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 02:59:35.470514 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 02:59:35.470514 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 02:59:35.470514 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 02:59:35.470514 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 02:59:35.470514 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 02:59:35.470514 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 02:59:35.470514 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 02:59:35.470514 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 02:59:35.470514 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 02:59:35.470514 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 02:59:35.470514 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 02:59:35.470514 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 02:59:35.473300 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 85/169] 10.222.0.65 () {56 vars in 1114 bytes} [Tue May 10 02:59:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 02:59:35.482374 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20326d80-09f6-481a-8658-3e920845ee01 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:35.589752 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20326d80-09f6-481a-8658-3e920845ee01 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:35.652177 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b2ae9-cf24-4a02-933e-fc63917b0c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:35.652872 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b2ae9-cf24-4a02-933e-fc63917b0c32 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:35.653177 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b2ae9-cf24-4a02-933e-fc63917b0c32 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:35.653433 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b2ae9-cf24-4a02-933e-fc63917b0c32 None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:35.654206 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487b2ae9-cf24-4a02-933e-fc63917b0c32 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 02:59:35.654518 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487b2ae9-cf24-4a02-933e-fc63917b0c32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:35.655940 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487b2ae9-cf24-4a02-933e-fc63917b0c32 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:35.669428 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 86/170] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 10 02:59:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 02:59:35.678019 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b2ae9-cf24-4a02-933e-fc63917b0c32 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:35.711384 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8784ef8-24b2-4fa0-8990-d00b72f7bb08 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:35.789350 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debe5ea3-bc69-4c3d-930f-2ce6a582dd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:35.790166 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe5ea3-bc69-4c3d-930f-2ce6a582dd93 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:35.790448 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe5ea3-bc69-4c3d-930f-2ce6a582dd93 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:35.790725 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe5ea3-bc69-4c3d-930f-2ce6a582dd93 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:35.825068 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debe5ea3-bc69-4c3d-930f-2ce6a582dd93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 02:59:35.832908 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-debe5ea3-bc69-4c3d-930f-2ce6a582dd93 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 02:59:35.832908 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 02:59:35.832908 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 02:59:35.832908 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 02:59:35.832908 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 02:59:35.832908 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 02:59:35.832908 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 02:59:35.832908 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 02:59:35.832908 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 02:59:35.832908 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 02:59:35.832908 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 02:59:35.832908 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 02:59:35.832908 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 02:59:35.832908 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 02:59:35.832908 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 02:59:35.832908 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 02:59:35.833825 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 02:59:35.833825 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 02:59:35.833825 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 02:59:35.833825 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 02:59:35.833825 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 02:59:35.833825 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 02:59:35.833825 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 02:59:35.833825 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 02:59:35.833825 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 02:59:35.833825 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 02:59:35.833825 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 02:59:35.833825 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 02:59:35.833825 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 02:59:35.833825 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 02:59:35.833825 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 02:59:35.833825 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 02:59:35.834586 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 02:59:35.834586 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 02:59:35.834586 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 02:59:35.834586 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 02:59:35.834586 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 02:59:35.834586 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 02:59:35.834586 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 02:59:35.834586 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 02:59:35.834586 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 02:59:35.834586 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 02:59:35.834586 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 02:59:35.834586 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 02:59:35.834586 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 85/171] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 10 02:59:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 02:59:35.843988 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debe5ea3-bc69-4c3d-930f-2ce6a582dd93 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:35.907926 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b2ae9-cf24-4a02-933e-fc63917b0c32 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:35.992181 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d519d-6c30-477c-90b7-2a19c5b10677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:35.993669 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d519d-6c30-477c-90b7-2a19c5b10677 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:35.993954 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d519d-6c30-477c-90b7-2a19c5b10677 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:35.994230 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d519d-6c30-477c-90b7-2a19c5b10677 None admin] PATH_INFO: `/v3/users/80d1ae1ee3d6406ba9cfc944e06e2daa` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:35.995503 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038d519d-6c30-477c-90b7-2a19c5b10677 None admin] RBAC: Authorizing `identity:get_user(user_id=80d1ae1ee3d6406ba9cfc944e06e2daa)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:35.996983 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038d519d-6c30-477c-90b7-2a19c5b10677 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:35.998852 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 87/172] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 10 02:59:35 2022] GET /identity/v3/users/80d1ae1ee3d6406ba9cfc944e06e2daa => generated 275 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:36.009062 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d519d-6c30-477c-90b7-2a19c5b10677 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:36.056368 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debe5ea3-bc69-4c3d-930f-2ce6a582dd93 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:36.123581 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e61b222-54da-434d-a6fa-96d387e95f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:36.124294 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e61b222-54da-434d-a6fa-96d387e95f80 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:36.124583 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e61b222-54da-434d-a6fa-96d387e95f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:36.124861 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e61b222-54da-434d-a6fa-96d387e95f80 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:36.125626 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e61b222-54da-434d-a6fa-96d387e95f80 None admin] RBAC: Adding query filter params (name=member) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 02:59:36.125935 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e61b222-54da-434d-a6fa-96d387e95f80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:36.127323 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e61b222-54da-434d-a6fa-96d387e95f80 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:36.143549 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 86/173] 10.222.0.65 () {56 vars in 1101 bytes} [Tue May 10 02:59:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 02:59:36.149061 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e61b222-54da-434d-a6fa-96d387e95f80 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:36.177317 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d519d-6c30-477c-90b7-2a19c5b10677 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:36.240480 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e30ce79-1232-4c26-941a-651153c2a7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:36.241139 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30ce79-1232-4c26-941a-651153c2a7cc None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:36.241421 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30ce79-1232-4c26-941a-651153c2a7cc None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:36.241849 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30ce79-1232-4c26-941a-651153c2a7cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:36.357102 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e30ce79-1232-4c26-941a-651153c2a7cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:36.358580 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e30ce79-1232-4c26-941a-651153c2a7cc None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:36.375730 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e61b222-54da-434d-a6fa-96d387e95f80 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:36.446205 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5715ef-a4c1-47b6-a31d-7439265c1ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:36.447101 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5715ef-a4c1-47b6-a31d-7439265c1ee1 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:36.447388 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5715ef-a4c1-47b6-a31d-7439265c1ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:36.447663 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5715ef-a4c1-47b6-a31d-7439265c1ee1 None admin] PATH_INFO: `/v3/users/80d1ae1ee3d6406ba9cfc944e06e2daa` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:36.452756 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5715ef-a4c1-47b6-a31d-7439265c1ee1 None admin] RBAC: Authorizing `identity:get_user(user_id=80d1ae1ee3d6406ba9cfc944e06e2daa)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:36.456140 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5715ef-a4c1-47b6-a31d-7439265c1ee1 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:36.456140 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 87/174] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 10 02:59:36 2022] GET /identity/v3/users/80d1ae1ee3d6406ba9cfc944e06e2daa => generated 275 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 02:59:36.464043 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5715ef-a4c1-47b6-a31d-7439265c1ee1 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:36.603254 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5715ef-a4c1-47b6-a31d-7439265c1ee1 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:36.606945 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 88/175] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 10 02:59:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 02:59:36.621017 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e30ce79-1232-4c26-941a-651153c2a7cc None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:36.686182 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e49913-3067-4382-b1fb-7ee0fdb50f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:36.687226 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e49913-3067-4382-b1fb-7ee0fdb50f14 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:36.687733 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e49913-3067-4382-b1fb-7ee0fdb50f14 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:36.688232 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e49913-3067-4382-b1fb-7ee0fdb50f14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:36.734760 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e30ce79-1232-4c26-941a-651153c2a7cc None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:36.776214 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107cce70-c5e8-434c-9179-d6e249934b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:36.777085 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107cce70-c5e8-434c-9179-d6e249934b10 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:36.777367 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107cce70-c5e8-434c-9179-d6e249934b10 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:36.777645 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107cce70-c5e8-434c-9179-d6e249934b10 None admin] PATH_INFO: `/v3/projects/2db4f8a4c66d4ca684aabd3e75eafbc2` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:36.784273 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107cce70-c5e8-434c-9179-d6e249934b10 None admin] RBAC: Authorizing `identity:get_project(project_id=2db4f8a4c66d4ca684aabd3e75eafbc2)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:36.785752 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107cce70-c5e8-434c-9179-d6e249934b10 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:36.787585 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 89/176] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 10 02:59:36 2022] GET /identity/v3/projects/2db4f8a4c66d4ca684aabd3e75eafbc2 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:36.793855 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107cce70-c5e8-434c-9179-d6e249934b10 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:36.807748 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e49913-3067-4382-b1fb-7ee0fdb50f14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:36.809268 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e49913-3067-4382-b1fb-7ee0fdb50f14 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:36.952399 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 88/177] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 10 02:59:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 02:59:36.953606 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e49913-3067-4382-b1fb-7ee0fdb50f14 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:36.972498 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107cce70-c5e8-434c-9179-d6e249934b10 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:37.045583 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddfee29-6805-40fb-a70f-ead7c443494f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:37.046248 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddfee29-6805-40fb-a70f-ead7c443494f None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:37.046529 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddfee29-6805-40fb-a70f-ead7c443494f None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:37.046803 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddfee29-6805-40fb-a70f-ead7c443494f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:37.047643 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddfee29-6805-40fb-a70f-ead7c443494f None admin] RBAC: Adding query filter params (role.id=b2cf4d51cc0b4532adcb7021d474177e, scope.project.id=2db4f8a4c66d4ca684aabd3e75eafbc2, user.id=80d1ae1ee3d6406ba9cfc944e06e2daa) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 02:59:37.047950 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddfee29-6805-40fb-a70f-ead7c443494f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:37.053302 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddfee29-6805-40fb-a70f-ead7c443494f None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:37.063481 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 90/178] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 10 02:59:36 2022] GET /identity/v3/role_assignments?user.id=80d1ae1ee3d6406ba9cfc944e06e2daa&scope.project.id=2db4f8a4c66d4ca684aabd3e75eafbc2&role.id=b2cf4d51cc0b4532adcb7021d474177e => generated 608 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 02:59:37.075079 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e49913-3067-4382-b1fb-7ee0fdb50f14 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:37.120908 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab3c4d9-9e4c-4ffd-9158-addc68c691bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:37.121812 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3c4d9-9e4c-4ffd-9158-addc68c691bc None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:37.122099 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3c4d9-9e4c-4ffd-9158-addc68c691bc None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:37.122376 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3c4d9-9e4c-4ffd-9158-addc68c691bc None admin] PATH_INFO: `/v3/projects/2db4f8a4c66d4ca684aabd3e75eafbc2` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:37.124357 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab3c4d9-9e4c-4ffd-9158-addc68c691bc None admin] RBAC: Authorizing `identity:get_project(project_id=2db4f8a4c66d4ca684aabd3e75eafbc2)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:37.125902 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab3c4d9-9e4c-4ffd-9158-addc68c691bc None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:37.127747 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 89/179] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 10 02:59:36 2022] GET /identity/v3/projects/2db4f8a4c66d4ca684aabd3e75eafbc2 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 02:59:37.133796 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddfee29-6805-40fb-a70f-ead7c443494f None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:37.295885 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c11866-a7af-4265-b804-e3d906a54a2f None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:37.296219 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c11866-a7af-4265-b804-e3d906a54a2f None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:37.296393 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c11866-a7af-4265-b804-e3d906a54a2f None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:37.298066 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 90/180] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 02:59:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 02:59:37.303408 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7af6d-bc3c-4179-a4cc-3452123a9ecf None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:37.303696 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7af6d-bc3c-4179-a4cc-3452123a9ecf None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:37.303976 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7af6d-bc3c-4179-a4cc-3452123a9ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:37.334938 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-3ac7af6d-bc3c-4179-a4cc-3452123a9ecf None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 02:59:37.336720 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-3ac7af6d-bc3c-4179-a4cc-3452123a9ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 02:59:37.336924 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddfee29-6805-40fb-a70f-ead7c443494f None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:37.402476 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85fc357-f1c9-4e46-8ef7-10a477be2304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:37.403232 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85fc357-f1c9-4e46-8ef7-10a477be2304 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:37.403390 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85fc357-f1c9-4e46-8ef7-10a477be2304 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:37.403672 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85fc357-f1c9-4e46-8ef7-10a477be2304 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:37.404550 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85fc357-f1c9-4e46-8ef7-10a477be2304 None admin] RBAC: Adding query filter params (role.id=bab81fd8d58945b8a1ea63c93b3b4857, scope.project.id=2db4f8a4c66d4ca684aabd3e75eafbc2, user.id=80d1ae1ee3d6406ba9cfc944e06e2daa) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 02:59:37.404926 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85fc357-f1c9-4e46-8ef7-10a477be2304 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:37.406301 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85fc357-f1c9-4e46-8ef7-10a477be2304 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:37.425130 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 91/181] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 10 02:59:37 2022] GET /identity/v3/role_assignments?user.id=80d1ae1ee3d6406ba9cfc944e06e2daa&scope.project.id=2db4f8a4c66d4ca684aabd3e75eafbc2&role.id=bab81fd8d58945b8a1ea63c93b3b4857 => generated 608 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:37.429681 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 91/182] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 02:59:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 02:59:37.472785 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85fc357-f1c9-4e46-8ef7-10a477be2304 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:37.598751 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85fc357-f1c9-4e46-8ef7-10a477be2304 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:37.646175 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b998c2cd-b910-4231-ae03-78acbc724e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:37.646988 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998c2cd-b910-4231-ae03-78acbc724e44 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:37.647273 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998c2cd-b910-4231-ae03-78acbc724e44 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:37.647549 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998c2cd-b910-4231-ae03-78acbc724e44 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:37.662730 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b998c2cd-b910-4231-ae03-78acbc724e44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 02:59:37.671080 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-b998c2cd-b910-4231-ae03-78acbc724e44 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 02:59:37.671080 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 02:59:37.671080 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 02:59:37.671080 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 02:59:37.671080 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 02:59:37.671080 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 02:59:37.671080 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 02:59:37.671080 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 02:59:37.671080 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 02:59:37.671080 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 02:59:37.671080 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 02:59:37.671080 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 02:59:37.671080 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 02:59:37.671080 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 02:59:37.671080 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 02:59:37.671080 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 02:59:37.671964 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 02:59:37.671964 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 02:59:37.671964 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 02:59:37.671964 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 02:59:37.671964 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 02:59:37.671964 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 02:59:37.671964 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 02:59:37.671964 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 02:59:37.671964 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 02:59:37.671964 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 02:59:37.671964 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 02:59:37.671964 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 02:59:37.671964 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 02:59:37.671964 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 02:59:37.671964 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 02:59:37.671964 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 02:59:37.673215 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 02:59:37.673215 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 02:59:37.673215 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 02:59:37.673215 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 02:59:37.673215 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 02:59:37.673215 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 02:59:37.673215 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 02:59:37.673215 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 02:59:37.673215 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 02:59:37.673215 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 02:59:37.673215 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 02:59:37.673215 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 02:59:37.673215 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 92/183] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 10 02:59:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 02:59:37.678056 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac7af6d-bc3c-4179-a4cc-3452123a9ecf None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:37.713505 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a30a4ab-d891-4d8a-ac1b-853b1ab709c9 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:37.713823 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a30a4ab-d891-4d8a-ac1b-853b1ab709c9 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:37.714070 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a30a4ab-d891-4d8a-ac1b-853b1ab709c9 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:37.715688 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 93/184] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 02:59:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 02:59:37.720963 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78775b36-ec15-4905-bbd7-10497d10ddb3 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:37.721253 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78775b36-ec15-4905-bbd7-10497d10ddb3 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:37.721512 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78775b36-ec15-4905-bbd7-10497d10ddb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:37.765296 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-78775b36-ec15-4905-bbd7-10497d10ddb3 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 02:59:37.766546 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-78775b36-ec15-4905-bbd7-10497d10ddb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 02:59:37.843394 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac7af6d-bc3c-4179-a4cc-3452123a9ecf None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:37.861900 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 94/185] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 02:59:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 02:59:37.892979 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78775b36-ec15-4905-bbd7-10497d10ddb3 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:37.895900 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caed9cf-94fa-4497-9fc0-fec6263f3a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:37.897945 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caed9cf-94fa-4497-9fc0-fec6263f3a14 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:37.898465 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caed9cf-94fa-4497-9fc0-fec6263f3a14 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:37.900568 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caed9cf-94fa-4497-9fc0-fec6263f3a14 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:37.901591 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caed9cf-94fa-4497-9fc0-fec6263f3a14 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 02:59:37.902104 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caed9cf-94fa-4497-9fc0-fec6263f3a14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:37.903794 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caed9cf-94fa-4497-9fc0-fec6263f3a14 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:37.920054 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 92/186] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 10 02:59:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:37.924785 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caed9cf-94fa-4497-9fc0-fec6263f3a14 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:38.081153 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78775b36-ec15-4905-bbd7-10497d10ddb3 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:38.086704 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caed9cf-94fa-4497-9fc0-fec6263f3a14 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:38.119948 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f3205-5840-4edd-ae2e-9fd32cd2ef32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:38.121005 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f3205-5840-4edd-ae2e-9fd32cd2ef32 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:38.121393 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f3205-5840-4edd-ae2e-9fd32cd2ef32 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:38.121674 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f3205-5840-4edd-ae2e-9fd32cd2ef32 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:38.121867 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c374279b-ab96-4acb-bf82-162c58ad1e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:38.122746 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374279b-ab96-4acb-bf82-162c58ad1e18 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:38.123032 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374279b-ab96-4acb-bf82-162c58ad1e18 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:38.123308 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374279b-ab96-4acb-bf82-162c58ad1e18 None admin] PATH_INFO: `/v3/users/3a28204d82d74009b0035fe0b2c3601c` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:38.133578 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912f3205-5840-4edd-ae2e-9fd32cd2ef32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 02:59:38.139110 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c374279b-ab96-4acb-bf82-162c58ad1e18 None admin] RBAC: Authorizing `identity:get_user(user_id=3a28204d82d74009b0035fe0b2c3601c)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:38.141792 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c374279b-ab96-4acb-bf82-162c58ad1e18 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:38.142019 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-912f3205-5840-4edd-ae2e-9fd32cd2ef32 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 02:59:38.142019 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 02:59:38.142019 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 02:59:38.142019 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 02:59:38.142019 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 02:59:38.142019 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 02:59:38.142019 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 02:59:38.142019 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 02:59:38.142019 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 02:59:38.142019 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 02:59:38.142019 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 02:59:38.142019 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 02:59:38.142019 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 02:59:38.142019 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 02:59:38.142019 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 02:59:38.142019 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 02:59:38.142942 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 02:59:38.142942 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 02:59:38.142942 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 02:59:38.142942 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 02:59:38.142942 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 02:59:38.142942 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 02:59:38.142942 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 02:59:38.142942 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 02:59:38.142942 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 02:59:38.142942 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 02:59:38.142942 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 02:59:38.142942 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 02:59:38.142942 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 02:59:38.142942 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 02:59:38.142942 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 02:59:38.142942 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 02:59:38.143722 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 02:59:38.143722 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 02:59:38.143722 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 02:59:38.143722 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 02:59:38.143722 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 02:59:38.143722 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 02:59:38.143722 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 02:59:38.143722 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 02:59:38.143722 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 02:59:38.143722 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 02:59:38.143722 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 02:59:38.143722 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 02:59:38.143722 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 95/187] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 10 02:59:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 02:59:38.145488 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269ec84-7c4c-4560-aa0c-1c3a5523a8ea None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:38.146110 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269ec84-7c4c-4560-aa0c-1c3a5523a8ea None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:38.146583 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269ec84-7c4c-4560-aa0c-1c3a5523a8ea None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:38.147770 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 93/188] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 10 02:59:37 2022] GET /identity/v3/users/3a28204d82d74009b0035fe0b2c3601c => generated 283 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:38.150958 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 96/189] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 02:59:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 02:59:38.152688 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c374279b-ab96-4acb-bf82-162c58ad1e18 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:38.155111 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0269ec84-7c4c-4560-aa0c-1c3a5523a8ea None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:38.253880 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c374279b-ab96-4acb-bf82-162c58ad1e18 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:38.266682 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0269ec84-7c4c-4560-aa0c-1c3a5523a8ea None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:38.291595 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad62891a-db7b-45c6-b876-73665bed6afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:38.292300 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62891a-db7b-45c6-b876-73665bed6afd None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:38.292582 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62891a-db7b-45c6-b876-73665bed6afd None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:38.292857 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62891a-db7b-45c6-b876-73665bed6afd None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:38.293615 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad62891a-db7b-45c6-b876-73665bed6afd None admin] RBAC: Adding query filter params (name=reader) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 02:59:38.293926 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad62891a-db7b-45c6-b876-73665bed6afd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:38.295349 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad62891a-db7b-45c6-b876-73665bed6afd None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:38.303594 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 94/190] 10.222.0.65 () {56 vars in 1101 bytes} [Tue May 10 02:59:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 02:59:38.304848 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c9ead-682f-485e-8e16-837fe087da0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:38.304991 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378250ef-b503-4087-a431-7c18d7372433 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:38.305146 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378250ef-b503-4087-a431-7c18d7372433 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:38.305425 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378250ef-b503-4087-a431-7c18d7372433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:38.306014 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c9ead-682f-485e-8e16-837fe087da0e None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:38.306426 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c9ead-682f-485e-8e16-837fe087da0e None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:38.306982 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c9ead-682f-485e-8e16-837fe087da0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:38.322967 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-378250ef-b503-4087-a431-7c18d7372433 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 02:59:38.324200 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-378250ef-b503-4087-a431-7c18d7372433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 02:59:38.373081 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8c9ead-682f-485e-8e16-837fe087da0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:38.374556 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8c9ead-682f-485e-8e16-837fe087da0e None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:38.386622 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 95/191] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 02:59:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 02:59:38.387450 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378250ef-b503-4087-a431-7c18d7372433 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:38.479775 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 97/192] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 10 02:59:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 02:59:38.481825 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e83533-520d-46e3-8661-aa9fd45f4ff5 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:38.482122 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e83533-520d-46e3-8661-aa9fd45f4ff5 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:38.482398 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e83533-520d-46e3-8661-aa9fd45f4ff5 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:38.483702 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 98/193] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 02:59:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 02:59:38.485011 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e83533-520d-46e3-8661-aa9fd45f4ff5 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:38.502007 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378250ef-b503-4087-a431-7c18d7372433 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:38.534509 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e559db2-ee84-4661-97d2-ca6aa20b7dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:38.535372 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e559db2-ee84-4661-97d2-ca6aa20b7dc0 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:38.535652 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e559db2-ee84-4661-97d2-ca6aa20b7dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:38.535926 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e559db2-ee84-4661-97d2-ca6aa20b7dc0 None admin] PATH_INFO: `/v3/users/e0bd530123684a0e9ddbebce1608ec92` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:38.537141 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e559db2-ee84-4661-97d2-ca6aa20b7dc0 None admin] RBAC: Authorizing `identity:get_user(user_id=e0bd530123684a0e9ddbebce1608ec92)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:38.538580 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e559db2-ee84-4661-97d2-ca6aa20b7dc0 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:38.540277 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 96/194] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 10 02:59:38 2022] GET /identity/v3/users/e0bd530123684a0e9ddbebce1608ec92 => generated 289 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:38.540277 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e559db2-ee84-4661-97d2-ca6aa20b7dc0 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:38.580363 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e83533-520d-46e3-8661-aa9fd45f4ff5 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:38.611255 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6130684-4b54-470a-aa5a-6136ff961ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:38.612075 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6130684-4b54-470a-aa5a-6136ff961ec7 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:38.612356 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6130684-4b54-470a-aa5a-6136ff961ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:38.612635 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6130684-4b54-470a-aa5a-6136ff961ec7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:38.622793 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6130684-4b54-470a-aa5a-6136ff961ec7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 02:59:38.630871 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-c6130684-4b54-470a-aa5a-6136ff961ec7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 02:59:38.630871 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 02:59:38.630871 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 02:59:38.630871 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 02:59:38.630871 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 02:59:38.630871 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 02:59:38.630871 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 02:59:38.630871 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 02:59:38.630871 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 02:59:38.630871 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 02:59:38.630871 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 02:59:38.630871 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 02:59:38.630871 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 02:59:38.630871 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 02:59:38.630871 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 02:59:38.630871 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 02:59:38.631743 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 02:59:38.631743 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 02:59:38.631743 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 02:59:38.631743 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 02:59:38.631743 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 02:59:38.631743 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 02:59:38.631743 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 02:59:38.631743 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 02:59:38.631743 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 02:59:38.631743 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 02:59:38.631743 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 02:59:38.631743 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 02:59:38.631743 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 02:59:38.631743 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 02:59:38.631743 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 02:59:38.631743 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 02:59:38.632579 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 02:59:38.632579 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 02:59:38.632579 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 02:59:38.632579 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 02:59:38.632579 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 02:59:38.632579 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 02:59:38.632579 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 02:59:38.632579 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 02:59:38.632579 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 02:59:38.632579 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 02:59:38.632579 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 02:59:38.632579 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 02:59:38.632579 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 99/195] 10.222.0.65 () {56 vars in 1114 bytes} [Tue May 10 02:59:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 02:59:38.633858 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ab643-caad-49de-ad7b-c78d84d4c19f None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:38.634378 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ab643-caad-49de-ad7b-c78d84d4c19f None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:38.634470 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ab643-caad-49de-ad7b-c78d84d4c19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:38.634536 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e559db2-ee84-4661-97d2-ca6aa20b7dc0 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:38.650124 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-9e0ab643-caad-49de-ad7b-c78d84d4c19f None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 02:59:38.651327 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-9e0ab643-caad-49de-ad7b-c78d84d4c19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 02:59:38.667044 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809487f0-5678-4e7e-8040-b6bc7c7912b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:38.667901 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809487f0-5678-4e7e-8040-b6bc7c7912b8 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:38.668207 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809487f0-5678-4e7e-8040-b6bc7c7912b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:38.668481 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809487f0-5678-4e7e-8040-b6bc7c7912b8 None admin] PATH_INFO: `/v3/projects/d89ba6f6a62842108d74ca873033ee82` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:38.669658 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809487f0-5678-4e7e-8040-b6bc7c7912b8 None admin] RBAC: Authorizing `identity:get_project(project_id=d89ba6f6a62842108d74ca873033ee82)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:38.671097 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809487f0-5678-4e7e-8040-b6bc7c7912b8 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:38.672815 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 97/196] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 10 02:59:38 2022] GET /identity/v3/projects/d89ba6f6a62842108d74ca873033ee82 => generated 302 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:38.673566 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809487f0-5678-4e7e-8040-b6bc7c7912b8 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:38.714918 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 100/197] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 02:59:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 02:59:38.716926 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ab643-caad-49de-ad7b-c78d84d4c19f None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:38.767982 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809487f0-5678-4e7e-8040-b6bc7c7912b8 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:38.799372 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb89d7-e6cf-4b2a-957b-78b33d8986f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:38.800055 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb89d7-e6cf-4b2a-957b-78b33d8986f3 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:38.800341 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb89d7-e6cf-4b2a-957b-78b33d8986f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:38.800616 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb89d7-e6cf-4b2a-957b-78b33d8986f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:38.807843 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ab643-caad-49de-ad7b-c78d84d4c19f None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:38.839410 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a55fb7-0b83-4535-800c-a9ac36030678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:38.840094 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a55fb7-0b83-4535-800c-a9ac36030678 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:38.840381 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a55fb7-0b83-4535-800c-a9ac36030678 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:38.840653 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a55fb7-0b83-4535-800c-a9ac36030678 None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:38.841397 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a55fb7-0b83-4535-800c-a9ac36030678 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 02:59:38.841694 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a55fb7-0b83-4535-800c-a9ac36030678 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:38.843063 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a55fb7-0b83-4535-800c-a9ac36030678 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:38.850561 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 101/198] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 10 02:59:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:38.851315 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a55fb7-0b83-4535-800c-a9ac36030678 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:38.864778 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb89d7-e6cf-4b2a-957b-78b33d8986f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:38.866276 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb89d7-e6cf-4b2a-957b-78b33d8986f3 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:38.947491 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a55fb7-0b83-4535-800c-a9ac36030678 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:38.957401 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 98/199] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 10 02:59:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 02:59:38.958029 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb89d7-e6cf-4b2a-957b-78b33d8986f3 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:38.979243 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17d367-0866-4bdc-9104-70b90aae06be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:38.979890 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17d367-0866-4bdc-9104-70b90aae06be None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:38.980205 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17d367-0866-4bdc-9104-70b90aae06be None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:38.980483 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17d367-0866-4bdc-9104-70b90aae06be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:38.981344 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17d367-0866-4bdc-9104-70b90aae06be None admin] RBAC: Adding query filter params (role.id=43105000610f402ca2486e7648018cca, scope.project.id=d89ba6f6a62842108d74ca873033ee82, user.id=3a28204d82d74009b0035fe0b2c3601c) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 02:59:38.981655 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17d367-0866-4bdc-9104-70b90aae06be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:38.983073 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17d367-0866-4bdc-9104-70b90aae06be None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:38.988303 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 102/200] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 10 02:59:38 2022] GET /identity/v3/role_assignments?user.id=3a28204d82d74009b0035fe0b2c3601c&scope.project.id=d89ba6f6a62842108d74ca873033ee82&role.id=43105000610f402ca2486e7648018cca => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:38.989127 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17d367-0866-4bdc-9104-70b90aae06be None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:39.060799 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb89d7-e6cf-4b2a-957b-78b33d8986f3 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:39.095048 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f97f750-d759-4b60-a023-16998d7fcbca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:39.095858 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97f750-d759-4b60-a023-16998d7fcbca None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:39.096212 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97f750-d759-4b60-a023-16998d7fcbca None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:39.096487 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97f750-d759-4b60-a023-16998d7fcbca None admin] PATH_INFO: `/v3/domains/default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:39.097714 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f97f750-d759-4b60-a023-16998d7fcbca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:39.099187 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f97f750-d759-4b60-a023-16998d7fcbca None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:39.099554 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17d367-0866-4bdc-9104-70b90aae06be None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:39.101060 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 99/201] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 02:59:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:39.102207 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f97f750-d759-4b60-a023-16998d7fcbca None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:39.144429 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be7c1e-9326-4752-bd0e-c69541a50014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:39.145441 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be7c1e-9326-4752-bd0e-c69541a50014 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:39.145718 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be7c1e-9326-4752-bd0e-c69541a50014 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:39.145988 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be7c1e-9326-4752-bd0e-c69541a50014 None admin] PATH_INFO: `/v3/users/3a28204d82d74009b0035fe0b2c3601c` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:39.147245 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1be7c1e-9326-4752-bd0e-c69541a50014 None admin] RBAC: Authorizing `identity:get_user(user_id=3a28204d82d74009b0035fe0b2c3601c)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:39.148753 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1be7c1e-9326-4752-bd0e-c69541a50014 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:39.154914 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 103/202] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 10 02:59:38 2022] GET /identity/v3/users/3a28204d82d74009b0035fe0b2c3601c => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:39.154914 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be7c1e-9326-4752-bd0e-c69541a50014 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:39.209221 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f97f750-d759-4b60-a023-16998d7fcbca None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:39.241857 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4fee22-f4b4-4571-a01b-1409b4c3a741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:39.243403 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4fee22-f4b4-4571-a01b-1409b4c3a741 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:39.243683 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4fee22-f4b4-4571-a01b-1409b4c3a741 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:39.243954 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4fee22-f4b4-4571-a01b-1409b4c3a741 None admin] PATH_INFO: `/v3/projects/2db4f8a4c66d4ca684aabd3e75eafbc2` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:39.245178 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4fee22-f4b4-4571-a01b-1409b4c3a741 None admin] RBAC: Authorizing `identity:get_project(project_id=2db4f8a4c66d4ca684aabd3e75eafbc2)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:39.246609 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4fee22-f4b4-4571-a01b-1409b4c3a741 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:39.247651 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be7c1e-9326-4752-bd0e-c69541a50014 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:39.248537 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 100/203] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 10 02:59:39 2022] GET /identity/v3/projects/2db4f8a4c66d4ca684aabd3e75eafbc2 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:39.252973 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4fee22-f4b4-4571-a01b-1409b4c3a741 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:39.280295 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49cb80f-38eb-4dbe-8695-ffe1a87ad9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:39.281106 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49cb80f-38eb-4dbe-8695-ffe1a87ad9c2 None admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:39.281385 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49cb80f-38eb-4dbe-8695-ffe1a87ad9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:39.281662 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49cb80f-38eb-4dbe-8695-ffe1a87ad9c2 None admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:39.282359 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49cb80f-38eb-4dbe-8695-ffe1a87ad9c2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:39.284091 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49cb80f-38eb-4dbe-8695-ffe1a87ad9c2 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:39.350764 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4fee22-f4b4-4571-a01b-1409b4c3a741 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:39.360532 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 104/204] 10.222.0.65 () {60 vars in 1132 bytes} [Tue May 10 02:59:39 2022] POST /identity/v3/users => generated 297 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 02:59:39.361323 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49cb80f-38eb-4dbe-8695-ffe1a87ad9c2 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:39.397860 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81eb50b-6fdc-49e0-8c57-e7faa7c2acaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:39.399082 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81eb50b-6fdc-49e0-8c57-e7faa7c2acaa None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:39.399366 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81eb50b-6fdc-49e0-8c57-e7faa7c2acaa None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:39.399642 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81eb50b-6fdc-49e0-8c57-e7faa7c2acaa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:39.478672 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81eb50b-6fdc-49e0-8c57-e7faa7c2acaa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:39.480253 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81eb50b-6fdc-49e0-8c57-e7faa7c2acaa None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:39.485119 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49cb80f-38eb-4dbe-8695-ffe1a87ad9c2 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:39.520833 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f7bd6-fd47-40e1-af88-2985ce115d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:39.521737 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f7bd6-fd47-40e1-af88-2985ce115d3f None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:39.522141 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f7bd6-fd47-40e1-af88-2985ce115d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:39.522515 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f7bd6-fd47-40e1-af88-2985ce115d3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:39.524113 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53f7bd6-fd47-40e1-af88-2985ce115d3f None admin] RBAC: Adding query filter params (role.id=d1526e6293dc47b1a0e78c462f588dac, scope.project.id=2db4f8a4c66d4ca684aabd3e75eafbc2, user.id=e0bd530123684a0e9ddbebce1608ec92) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 02:59:39.524536 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53f7bd6-fd47-40e1-af88-2985ce115d3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:39.526106 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53f7bd6-fd47-40e1-af88-2985ce115d3f None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:39.533088 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 105/205] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 10 02:59:39 2022] GET /identity/v3/role_assignments?user.id=e0bd530123684a0e9ddbebce1608ec92&scope.project.id=2db4f8a4c66d4ca684aabd3e75eafbc2&role.id=d1526e6293dc47b1a0e78c462f588dac => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:39.596963 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 101/206] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 10 02:59:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 02:59:39.603609 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f7bd6-fd47-40e1-af88-2985ce115d3f None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:39.713790 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f7bd6-fd47-40e1-af88-2985ce115d3f None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:39.750164 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a8c554-2bf0-46de-a325-98251d88cbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:39.751039 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8c554-2bf0-46de-a325-98251d88cbcf None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:39.751323 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8c554-2bf0-46de-a325-98251d88cbcf None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:39.751602 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8c554-2bf0-46de-a325-98251d88cbcf None admin] PATH_INFO: `/v3/projects/d89ba6f6a62842108d74ca873033ee82` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:39.752962 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a8c554-2bf0-46de-a325-98251d88cbcf None admin] RBAC: Authorizing `identity:get_project(project_id=d89ba6f6a62842108d74ca873033ee82)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:39.754418 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a8c554-2bf0-46de-a325-98251d88cbcf None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:39.756155 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 106/207] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 10 02:59:39 2022] GET /identity/v3/projects/d89ba6f6a62842108d74ca873033ee82 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:39.762556 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81eb50b-6fdc-49e0-8c57-e7faa7c2acaa None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:39.869186 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81eb50b-6fdc-49e0-8c57-e7faa7c2acaa None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:39.911436 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee6113e-17eb-4ee6-a1ec-62f8560324eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:39.916027 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6113e-17eb-4ee6-a1ec-62f8560324eb None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:39.916027 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6113e-17eb-4ee6-a1ec-62f8560324eb None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:39.916027 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6113e-17eb-4ee6-a1ec-62f8560324eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:39.916027 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee6113e-17eb-4ee6-a1ec-62f8560324eb None admin] RBAC: Adding query filter params (role.id=b2cf4d51cc0b4532adcb7021d474177e, scope.project.id=d89ba6f6a62842108d74ca873033ee82, user.id=3a28204d82d74009b0035fe0b2c3601c) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 02:59:39.916027 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee6113e-17eb-4ee6-a1ec-62f8560324eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:39.916027 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee6113e-17eb-4ee6-a1ec-62f8560324eb None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:39.920968 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 102/208] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 10 02:59:39 2022] GET /identity/v3/role_assignments?user.id=3a28204d82d74009b0035fe0b2c3601c&scope.project.id=d89ba6f6a62842108d74ca873033ee82&role.id=b2cf4d51cc0b4532adcb7021d474177e => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:41.212968 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08dcc59-696c-4b9c-a589-9049d38bb8b5 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:41.213513 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08dcc59-696c-4b9c-a589-9049d38bb8b5 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:41.213513 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08dcc59-696c-4b9c-a589-9049d38bb8b5 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:41.215093 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 107/209] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 02:59:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 02:59:41.220622 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd4d70-c612-4016-b971-6e4688aa8492 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:41.221033 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd4d70-c612-4016-b971-6e4688aa8492 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:41.221206 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd4d70-c612-4016-b971-6e4688aa8492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:41.237673 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-9efd4d70-c612-4016-b971-6e4688aa8492 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 02:59:41.238856 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-9efd4d70-c612-4016-b971-6e4688aa8492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 02:59:41.304680 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 103/210] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 02:59:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 02:59:41.326345 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08dcc59-696c-4b9c-a589-9049d38bb8b5 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:41.426894 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08dcc59-696c-4b9c-a589-9049d38bb8b5 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:41.460725 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d340e75-9ba0-4df0-9254-155100543801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:41.462080 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d340e75-9ba0-4df0-9254-155100543801 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:41.462360 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d340e75-9ba0-4df0-9254-155100543801 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:41.462631 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d340e75-9ba0-4df0-9254-155100543801 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:41.472922 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d340e75-9ba0-4df0-9254-155100543801 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 02:59:41.481494 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-3d340e75-9ba0-4df0-9254-155100543801 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 02:59:41.481494 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 02:59:41.481494 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 02:59:41.481494 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 02:59:41.481494 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 02:59:41.481494 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 02:59:41.481494 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 02:59:41.481494 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 02:59:41.481494 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 02:59:41.481494 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 02:59:41.481494 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 02:59:41.481494 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 02:59:41.481494 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 02:59:41.481494 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 02:59:41.481494 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 02:59:41.481494 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 02:59:41.483136 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 02:59:41.483136 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 02:59:41.483136 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 02:59:41.483136 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 02:59:41.483136 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 02:59:41.483136 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 02:59:41.483136 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 02:59:41.483136 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 02:59:41.483136 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 02:59:41.483136 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 02:59:41.483136 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 02:59:41.483136 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 02:59:41.483136 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 02:59:41.483136 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 02:59:41.483136 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 02:59:41.483136 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 02:59:41.484038 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 02:59:41.484038 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 02:59:41.484038 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 02:59:41.484038 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 02:59:41.484038 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 02:59:41.484038 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 02:59:41.484038 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 02:59:41.484038 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 02:59:41.484038 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 02:59:41.484038 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 02:59:41.484038 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 02:59:41.484038 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 02:59:41.484038 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 108/211] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 10 02:59:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 02:59:41.488510 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd4d70-c612-4016-b971-6e4688aa8492 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:41.587122 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd4d70-c612-4016-b971-6e4688aa8492 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:41.620843 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e7a43a-1b2e-4e5f-a820-e560ce8e1cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:41.621521 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7a43a-1b2e-4e5f-a820-e560ce8e1cb9 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:41.621794 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7a43a-1b2e-4e5f-a820-e560ce8e1cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:41.622068 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7a43a-1b2e-4e5f-a820-e560ce8e1cb9 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:41.622814 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e7a43a-1b2e-4e5f-a820-e560ce8e1cb9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 02:59:41.623118 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e7a43a-1b2e-4e5f-a820-e560ce8e1cb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:41.624525 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e7a43a-1b2e-4e5f-a820-e560ce8e1cb9 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:41.633745 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 104/212] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 10 02:59:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:41.639296 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d340e75-9ba0-4df0-9254-155100543801 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:41.745969 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d340e75-9ba0-4df0-9254-155100543801 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:41.785869 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7091c47d-d3e0-478d-b407-0635d8181b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:41.786756 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7091c47d-d3e0-478d-b407-0635d8181b92 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:41.787040 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7091c47d-d3e0-478d-b407-0635d8181b92 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:41.787316 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7091c47d-d3e0-478d-b407-0635d8181b92 None admin] PATH_INFO: `/v3/users/3a28204d82d74009b0035fe0b2c3601c` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:41.788708 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7091c47d-d3e0-478d-b407-0635d8181b92 None admin] RBAC: Authorizing `identity:get_user(user_id=3a28204d82d74009b0035fe0b2c3601c)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:41.790208 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7091c47d-d3e0-478d-b407-0635d8181b92 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:41.791895 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 109/213] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 10 02:59:41 2022] GET /identity/v3/users/3a28204d82d74009b0035fe0b2c3601c => generated 283 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:41.797281 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e7a43a-1b2e-4e5f-a820-e560ce8e1cb9 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:41.895923 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e04a5-357c-447b-8b6a-b39ca8369215 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:41.896600 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e04a5-357c-447b-8b6a-b39ca8369215 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:41.897105 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e04a5-357c-447b-8b6a-b39ca8369215 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:41.897538 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e7a43a-1b2e-4e5f-a820-e560ce8e1cb9 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:41.899015 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 110/214] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 02:59:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 02:59:41.904365 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b94a6-b90e-4ad3-bfa7-6bd0c2460538 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:41.904657 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b94a6-b90e-4ad3-bfa7-6bd0c2460538 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:41.904939 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b94a6-b90e-4ad3-bfa7-6bd0c2460538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:41.922218 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-315b94a6-b90e-4ad3-bfa7-6bd0c2460538 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 02:59:41.923400 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-315b94a6-b90e-4ad3-bfa7-6bd0c2460538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 02:59:41.938726 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af82c3-fe3a-48fb-952f-f32bfa70bef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:41.939598 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af82c3-fe3a-48fb-952f-f32bfa70bef4 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:41.939887 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af82c3-fe3a-48fb-952f-f32bfa70bef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:41.940198 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af82c3-fe3a-48fb-952f-f32bfa70bef4 None admin] PATH_INFO: `/v3/projects/d89ba6f6a62842108d74ca873033ee82` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:41.941394 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1af82c3-fe3a-48fb-952f-f32bfa70bef4 None admin] RBAC: Authorizing `identity:get_project(project_id=d89ba6f6a62842108d74ca873033ee82)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:41.942845 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1af82c3-fe3a-48fb-952f-f32bfa70bef4 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:41.944601 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 105/215] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 10 02:59:41 2022] GET /identity/v3/projects/d89ba6f6a62842108d74ca873033ee82 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:41.945863 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b70dc0-980f-42cb-a969-ec9cd61b74ea None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:41.946153 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b70dc0-980f-42cb-a969-ec9cd61b74ea None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:41.946433 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b70dc0-980f-42cb-a969-ec9cd61b74ea None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:41.947782 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 106/216] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 02:59:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 02:59:41.950462 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b70dc0-980f-42cb-a969-ec9cd61b74ea None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:41.998650 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 111/217] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 02:59:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 02:59:41.999917 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a9fb86-0d20-49b1-9fc8-32110c287f09 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:42.000238 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a9fb86-0d20-49b1-9fc8-32110c287f09 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:42.000526 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a9fb86-0d20-49b1-9fc8-32110c287f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:42.022488 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-12a9fb86-0d20-49b1-9fc8-32110c287f09 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 02:59:42.023676 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-12a9fb86-0d20-49b1-9fc8-32110c287f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 02:59:42.069432 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b70dc0-980f-42cb-a969-ec9cd61b74ea None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:42.092075 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 112/218] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 02:59:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 02:59:42.092075 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a9fb86-0d20-49b1-9fc8-32110c287f09 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:42.110553 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ba8c0-c12c-40eb-873f-a64114e5a8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:42.111771 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ba8c0-c12c-40eb-873f-a64114e5a8f3 None admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:42.112300 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ba8c0-c12c-40eb-873f-a64114e5a8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:42.113212 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ba8c0-c12c-40eb-873f-a64114e5a8f3 None admin] PATH_INFO: `/v3/projects/d89ba6f6a62842108d74ca873033ee82/users/3a28204d82d74009b0035fe0b2c3601c/roles/43105000610f402ca2486e7648018cca` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:42.115979 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684ba8c0-c12c-40eb-873f-a64114e5a8f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=d89ba6f6a62842108d74ca873033ee82, user_id=3a28204d82d74009b0035fe0b2c3601c, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:42.118006 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684ba8c0-c12c-40eb-873f-a64114e5a8f3 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:42.188762 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a9fb86-0d20-49b1-9fc8-32110c287f09 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:42.199293 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 107/219] 10.222.0.65 () {58 vars in 1439 bytes} [Tue May 10 02:59:41 2022] PUT /identity/v3/projects/d89ba6f6a62842108d74ca873033ee82/users/3a28204d82d74009b0035fe0b2c3601c/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 02:59:42.200218 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ba8c0-c12c-40eb-873f-a64114e5a8f3 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:42.222817 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e392ea-cb32-4a76-b3d5-5afe40982191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:42.223639 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e392ea-cb32-4a76-b3d5-5afe40982191 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:42.223924 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e392ea-cb32-4a76-b3d5-5afe40982191 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:42.224239 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e392ea-cb32-4a76-b3d5-5afe40982191 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:42.236115 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e392ea-cb32-4a76-b3d5-5afe40982191 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 02:59:42.244722 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-81e392ea-cb32-4a76-b3d5-5afe40982191 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 02:59:42.244722 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 02:59:42.244722 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 02:59:42.244722 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 02:59:42.244722 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 02:59:42.244722 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 02:59:42.244722 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 02:59:42.244722 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 02:59:42.244722 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 02:59:42.244722 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 02:59:42.244722 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 02:59:42.244722 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 02:59:42.244722 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 02:59:42.244722 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 02:59:42.244722 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 02:59:42.244722 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 02:59:42.245915 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 02:59:42.245915 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 02:59:42.245915 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 02:59:42.245915 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 02:59:42.245915 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 02:59:42.245915 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 02:59:42.245915 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 02:59:42.245915 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 02:59:42.245915 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 02:59:42.245915 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 02:59:42.245915 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 02:59:42.245915 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 02:59:42.245915 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 02:59:42.245915 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 02:59:42.245915 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 02:59:42.245915 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 02:59:42.252334 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 02:59:42.252334 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 02:59:42.252334 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 02:59:42.252334 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 02:59:42.252334 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 02:59:42.252334 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 02:59:42.252334 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 02:59:42.252334 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 02:59:42.252334 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 02:59:42.252334 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 02:59:42.252334 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 02:59:42.252334 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 02:59:42.252334 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 113/220] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 10 02:59:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 02:59:42.252334 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc6e43b-9df9-439a-ba1c-4bdb1e98726f None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:42.253046 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc6e43b-9df9-439a-ba1c-4bdb1e98726f None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:42.253046 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc6e43b-9df9-439a-ba1c-4bdb1e98726f None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:42.253046 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 114/221] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 02:59:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 02:59:42.253046 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc6e43b-9df9-439a-ba1c-4bdb1e98726f None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:42.324733 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ba8c0-c12c-40eb-873f-a64114e5a8f3 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:42.359868 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611dd938-70d9-4cdd-8bc4-e076a650e638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:42.360710 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611dd938-70d9-4cdd-8bc4-e076a650e638 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:42.360998 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611dd938-70d9-4cdd-8bc4-e076a650e638 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:42.361273 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611dd938-70d9-4cdd-8bc4-e076a650e638 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:42.362113 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc6e43b-9df9-439a-ba1c-4bdb1e98726f None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:42.362461 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611dd938-70d9-4cdd-8bc4-e076a650e638 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:42.363952 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611dd938-70d9-4cdd-8bc4-e076a650e638 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:42.365691 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 108/222] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 02:59:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:42.370456 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f782e0-2bae-41df-ba4e-660e5c835407 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:42.370456 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f782e0-2bae-41df-ba4e-660e5c835407 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:42.370456 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f782e0-2bae-41df-ba4e-660e5c835407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:42.385842 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-d4f782e0-2bae-41df-ba4e-660e5c835407 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 02:59:42.387412 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-d4f782e0-2bae-41df-ba4e-660e5c835407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 02:59:42.403569 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9c725a-4062-44f9-8e5b-982184907c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:42.404306 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c725a-4062-44f9-8e5b-982184907c6e None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:42.404596 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c725a-4062-44f9-8e5b-982184907c6e None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:42.404871 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c725a-4062-44f9-8e5b-982184907c6e None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:42.405631 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9c725a-4062-44f9-8e5b-982184907c6e None admin] RBAC: Adding query filter params (name=member) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 02:59:42.405935 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9c725a-4062-44f9-8e5b-982184907c6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:42.407308 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9c725a-4062-44f9-8e5b-982184907c6e None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:42.416528 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 115/223] 10.222.0.65 () {56 vars in 1101 bytes} [Tue May 10 02:59:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 02:59:42.417401 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9c725a-4062-44f9-8e5b-982184907c6e None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:42.456727 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 109/224] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 02:59:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 02:59:42.465184 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f782e0-2bae-41df-ba4e-660e5c835407 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:42.528232 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9c725a-4062-44f9-8e5b-982184907c6e None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:42.566678 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e8258f-3dbd-4264-9155-1d2e6c59fdcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:42.567615 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8258f-3dbd-4264-9155-1d2e6c59fdcf None admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:42.567901 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8258f-3dbd-4264-9155-1d2e6c59fdcf None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:42.568209 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8258f-3dbd-4264-9155-1d2e6c59fdcf None admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:42.568846 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f782e0-2bae-41df-ba4e-660e5c835407 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:42.568944 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e8258f-3dbd-4264-9155-1d2e6c59fdcf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:42.570550 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e8258f-3dbd-4264-9155-1d2e6c59fdcf None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:42.602841 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf5a288-9701-4f83-8a70-44208c81142e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:42.603716 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf5a288-9701-4f83-8a70-44208c81142e None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:42.603995 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf5a288-9701-4f83-8a70-44208c81142e None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:42.604358 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf5a288-9701-4f83-8a70-44208c81142e None admin] PATH_INFO: `/v3/users/9917a15f2091446ba31c7f27fc84d2fe` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:42.617519 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf5a288-9701-4f83-8a70-44208c81142e None admin] RBAC: Authorizing `identity:get_user(user_id=9917a15f2091446ba31c7f27fc84d2fe)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:42.618974 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf5a288-9701-4f83-8a70-44208c81142e None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:42.620678 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 110/225] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 10 02:59:42 2022] GET /identity/v3/users/9917a15f2091446ba31c7f27fc84d2fe => generated 297 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:42.621441 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf5a288-9701-4f83-8a70-44208c81142e None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:42.674916 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 116/226] 10.222.0.65 () {60 vars in 1132 bytes} [Tue May 10 02:59:42 2022] POST /identity/v3/users => generated 297 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 02:59:42.687034 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e8258f-3dbd-4264-9155-1d2e6c59fdcf None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:42.729261 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf5a288-9701-4f83-8a70-44208c81142e None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:42.775975 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417646fc-d6a2-4067-8143-7a705921c1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:42.776838 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417646fc-d6a2-4067-8143-7a705921c1b0 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:42.777121 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417646fc-d6a2-4067-8143-7a705921c1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:42.777398 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417646fc-d6a2-4067-8143-7a705921c1b0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:42.792535 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417646fc-d6a2-4067-8143-7a705921c1b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 02:59:42.802493 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e8258f-3dbd-4264-9155-1d2e6c59fdcf None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:42.803043 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-417646fc-d6a2-4067-8143-7a705921c1b0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 02:59:42.803043 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 02:59:42.803043 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 02:59:42.803043 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 02:59:42.803043 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 02:59:42.803043 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 02:59:42.803043 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 02:59:42.803043 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 02:59:42.803043 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 02:59:42.803043 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 02:59:42.803043 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 02:59:42.803043 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 02:59:42.803043 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 02:59:42.803043 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 02:59:42.803043 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 02:59:42.803043 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 02:59:42.804031 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 02:59:42.804031 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 02:59:42.804031 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 02:59:42.804031 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 02:59:42.804031 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 02:59:42.804031 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 02:59:42.804031 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 02:59:42.804031 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 02:59:42.804031 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 02:59:42.804031 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 02:59:42.804031 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 02:59:42.804031 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 02:59:42.804031 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 02:59:42.804031 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 02:59:42.804031 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 02:59:42.804031 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 02:59:42.804859 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 02:59:42.804859 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 02:59:42.804859 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 02:59:42.804859 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 02:59:42.804859 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 02:59:42.804859 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 02:59:42.804859 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 02:59:42.804859 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 02:59:42.804859 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 02:59:42.804859 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 02:59:42.804859 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 02:59:42.804859 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 02:59:42.804859 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 111/227] 10.222.0.65 () {56 vars in 1114 bytes} [Tue May 10 02:59:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 02:59:42.812409 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417646fc-d6a2-4067-8143-7a705921c1b0 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:42.846676 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d05a75c-7818-44f4-af56-cc14fa2f3eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:42.847767 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05a75c-7818-44f4-af56-cc14fa2f3eb7 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:42.848333 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05a75c-7818-44f4-af56-cc14fa2f3eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:42.848813 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05a75c-7818-44f4-af56-cc14fa2f3eb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:42.933059 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d05a75c-7818-44f4-af56-cc14fa2f3eb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:42.934675 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d05a75c-7818-44f4-af56-cc14fa2f3eb7 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:42.941956 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417646fc-d6a2-4067-8143-7a705921c1b0 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:42.984358 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33cd3cb-5274-4ad1-a561-890dea326c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:42.985039 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33cd3cb-5274-4ad1-a561-890dea326c15 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:42.985318 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33cd3cb-5274-4ad1-a561-890dea326c15 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:42.985592 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33cd3cb-5274-4ad1-a561-890dea326c15 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:42.986342 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33cd3cb-5274-4ad1-a561-890dea326c15 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 02:59:42.986645 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33cd3cb-5274-4ad1-a561-890dea326c15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:42.988280 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33cd3cb-5274-4ad1-a561-890dea326c15 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:42.997829 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 112/228] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 10 02:59:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:43.004104 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33cd3cb-5274-4ad1-a561-890dea326c15 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:43.065777 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 117/229] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 10 02:59:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 02:59:43.072424 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d05a75c-7818-44f4-af56-cc14fa2f3eb7 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:43.122815 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33cd3cb-5274-4ad1-a561-890dea326c15 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:43.159945 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e48c1-810d-478c-ae37-6c8a66465247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:43.161169 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e48c1-810d-478c-ae37-6c8a66465247 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:43.161676 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e48c1-810d-478c-ae37-6c8a66465247 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:43.162129 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e48c1-810d-478c-ae37-6c8a66465247 None admin] PATH_INFO: `/v3/users/3a28204d82d74009b0035fe0b2c3601c` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:43.163516 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336e48c1-810d-478c-ae37-6c8a66465247 None admin] RBAC: Authorizing `identity:get_user(user_id=3a28204d82d74009b0035fe0b2c3601c)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:43.165232 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336e48c1-810d-478c-ae37-6c8a66465247 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:43.167360 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 113/230] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 10 02:59:43 2022] GET /identity/v3/users/3a28204d82d74009b0035fe0b2c3601c => generated 283 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 02:59:43.172833 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e48c1-810d-478c-ae37-6c8a66465247 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:43.192602 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d05a75c-7818-44f4-af56-cc14fa2f3eb7 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:43.228171 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f017eda-34d5-4fef-8f1b-d2eacf371235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:43.229855 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f017eda-34d5-4fef-8f1b-d2eacf371235 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:43.230351 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f017eda-34d5-4fef-8f1b-d2eacf371235 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:43.230803 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f017eda-34d5-4fef-8f1b-d2eacf371235 None admin] PATH_INFO: `/v3/projects/d89ba6f6a62842108d74ca873033ee82` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:43.232209 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f017eda-34d5-4fef-8f1b-d2eacf371235 None admin] RBAC: Authorizing `identity:get_project(project_id=d89ba6f6a62842108d74ca873033ee82)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:43.233845 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f017eda-34d5-4fef-8f1b-d2eacf371235 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:43.235747 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 118/231] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 10 02:59:43 2022] GET /identity/v3/projects/d89ba6f6a62842108d74ca873033ee82 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 02:59:43.242581 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f017eda-34d5-4fef-8f1b-d2eacf371235 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:43.278057 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e48c1-810d-478c-ae37-6c8a66465247 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:43.319834 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f68ccf-2f7e-44a3-8e30-2c4d6ea2d9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:43.321215 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f68ccf-2f7e-44a3-8e30-2c4d6ea2d9e9 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:43.321493 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f68ccf-2f7e-44a3-8e30-2c4d6ea2d9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:43.321762 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f68ccf-2f7e-44a3-8e30-2c4d6ea2d9e9 None admin] PATH_INFO: `/v3/projects/d89ba6f6a62842108d74ca873033ee82` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:43.323113 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f68ccf-2f7e-44a3-8e30-2c4d6ea2d9e9 None admin] RBAC: Authorizing `identity:get_project(project_id=d89ba6f6a62842108d74ca873033ee82)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:43.324558 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f68ccf-2f7e-44a3-8e30-2c4d6ea2d9e9 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:43.326262 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 114/232] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 10 02:59:43 2022] GET /identity/v3/projects/d89ba6f6a62842108d74ca873033ee82 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:43.336993 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f68ccf-2f7e-44a3-8e30-2c4d6ea2d9e9 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:43.450231 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f68ccf-2f7e-44a3-8e30-2c4d6ea2d9e9 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:43.462249 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f017eda-34d5-4fef-8f1b-d2eacf371235 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:43.488128 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d91a57b-8c72-4512-b56c-d6c53ee17755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:43.489106 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91a57b-8c72-4512-b56c-d6c53ee17755 None admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:43.489762 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91a57b-8c72-4512-b56c-d6c53ee17755 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:43.490047 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91a57b-8c72-4512-b56c-d6c53ee17755 None admin] PATH_INFO: `/v3/projects/d89ba6f6a62842108d74ca873033ee82/users/3a28204d82d74009b0035fe0b2c3601c/roles/b2cf4d51cc0b4532adcb7021d474177e` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:43.493080 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d91a57b-8c72-4512-b56c-d6c53ee17755 None admin] RBAC: Authorizing `identity:create_grant(project_id=d89ba6f6a62842108d74ca873033ee82, user_id=3a28204d82d74009b0035fe0b2c3601c, role_id=b2cf4d51cc0b4532adcb7021d474177e)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:43.494537 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d91a57b-8c72-4512-b56c-d6c53ee17755 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:43.520287 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5ae53a-fa16-4764-909d-58e174ba7577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:43.524702 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ae53a-fa16-4764-909d-58e174ba7577 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:43.524702 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ae53a-fa16-4764-909d-58e174ba7577 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:43.524702 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ae53a-fa16-4764-909d-58e174ba7577 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:43.524702 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5ae53a-fa16-4764-909d-58e174ba7577 None admin] RBAC: Adding query filter params (role.id=bab81fd8d58945b8a1ea63c93b3b4857, scope.project.id=d89ba6f6a62842108d74ca873033ee82, user.id=9917a15f2091446ba31c7f27fc84d2fe) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 02:59:43.524702 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5ae53a-fa16-4764-909d-58e174ba7577 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:43.524702 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5ae53a-fa16-4764-909d-58e174ba7577 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:43.529958 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 119/233] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 10 02:59:43 2022] GET /identity/v3/role_assignments?user.id=9917a15f2091446ba31c7f27fc84d2fe&scope.project.id=d89ba6f6a62842108d74ca873033ee82&role.id=bab81fd8d58945b8a1ea63c93b3b4857 => generated 259 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:43.619196 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 115/234] 10.222.0.65 () {58 vars in 1439 bytes} [Tue May 10 02:59:43 2022] PUT /identity/v3/projects/d89ba6f6a62842108d74ca873033ee82/users/3a28204d82d74009b0035fe0b2c3601c/roles/b2cf4d51cc0b4532adcb7021d474177e => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 02:59:44.593401 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d638b-5e42-4555-9cdc-6c4f587163ab None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:44.594265 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d638b-5e42-4555-9cdc-6c4f587163ab None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:44.594689 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d638b-5e42-4555-9cdc-6c4f587163ab None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:44.596241 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 120/235] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 02:59:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 02:59:44.601715 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1318f9b-bb2f-4054-bc66-15640194b10b None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:44.602524 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1318f9b-bb2f-4054-bc66-15640194b10b None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:44.602950 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1318f9b-bb2f-4054-bc66-15640194b10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:44.622990 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-c1318f9b-bb2f-4054-bc66-15640194b10b None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 02:59:44.624462 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-c1318f9b-bb2f-4054-bc66-15640194b10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 02:59:44.694811 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 116/236] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 02:59:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 02:59:44.741922 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690d638b-5e42-4555-9cdc-6c4f587163ab None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:44.868738 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690d638b-5e42-4555-9cdc-6c4f587163ab None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:44.903763 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd04ccc-327c-407a-8cac-70f1cb2c5af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:44.904813 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd04ccc-327c-407a-8cac-70f1cb2c5af6 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:44.905272 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd04ccc-327c-407a-8cac-70f1cb2c5af6 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:44.905701 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd04ccc-327c-407a-8cac-70f1cb2c5af6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:44.916872 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd04ccc-327c-407a-8cac-70f1cb2c5af6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 02:59:44.924719 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-4bd04ccc-327c-407a-8cac-70f1cb2c5af6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 02:59:44.924719 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 02:59:44.924719 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 02:59:44.924719 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 02:59:44.924719 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 02:59:44.924719 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 02:59:44.924719 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 02:59:44.924719 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 02:59:44.924719 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 02:59:44.924719 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 02:59:44.924719 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 02:59:44.924719 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 02:59:44.924719 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 02:59:44.924719 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 02:59:44.924719 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 02:59:44.924719 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 02:59:44.925796 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 02:59:44.925796 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 02:59:44.925796 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 02:59:44.925796 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 02:59:44.925796 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 02:59:44.925796 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 02:59:44.925796 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 02:59:44.925796 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 02:59:44.925796 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 02:59:44.925796 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 02:59:44.925796 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 02:59:44.925796 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 02:59:44.925796 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 02:59:44.925796 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 02:59:44.925796 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 02:59:44.925796 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 02:59:44.926769 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 02:59:44.926769 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 02:59:44.926769 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 02:59:44.926769 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 02:59:44.926769 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 02:59:44.926769 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 02:59:44.926769 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 02:59:44.926769 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 02:59:44.926769 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 02:59:44.926769 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 02:59:44.926769 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 02:59:44.926769 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 02:59:44.929140 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 121/237] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 10 02:59:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 02:59:44.935359 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1318f9b-bb2f-4054-bc66-15640194b10b None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:45.129414 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1318f9b-bb2f-4054-bc66-15640194b10b None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:45.180975 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad80e9fd-b237-45d4-b847-c6c3f880c8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:45.181668 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80e9fd-b237-45d4-b847-c6c3f880c8b2 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:45.181962 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80e9fd-b237-45d4-b847-c6c3f880c8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:45.182239 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80e9fd-b237-45d4-b847-c6c3f880c8b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:45.183001 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad80e9fd-b237-45d4-b847-c6c3f880c8b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 02:59:45.183308 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad80e9fd-b237-45d4-b847-c6c3f880c8b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:45.184856 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad80e9fd-b237-45d4-b847-c6c3f880c8b2 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:45.193461 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 117/238] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 10 02:59:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:45.199250 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd04ccc-327c-407a-8cac-70f1cb2c5af6 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:45.308363 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd04ccc-327c-407a-8cac-70f1cb2c5af6 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:45.347732 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388ed88-5295-4d2f-8f40-31cdfc88a95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:45.348939 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388ed88-5295-4d2f-8f40-31cdfc88a95d None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:45.349411 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388ed88-5295-4d2f-8f40-31cdfc88a95d None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:45.349839 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388ed88-5295-4d2f-8f40-31cdfc88a95d None admin] PATH_INFO: `/v3/users/3a28204d82d74009b0035fe0b2c3601c` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:45.351494 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9388ed88-5295-4d2f-8f40-31cdfc88a95d None admin] RBAC: Authorizing `identity:get_user(user_id=3a28204d82d74009b0035fe0b2c3601c)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:45.353809 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9388ed88-5295-4d2f-8f40-31cdfc88a95d None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:45.355782 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 122/239] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 10 02:59:45 2022] GET /identity/v3/users/3a28204d82d74009b0035fe0b2c3601c => generated 283 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:45.361743 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad80e9fd-b237-45d4-b847-c6c3f880c8b2 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:45.540302 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad80e9fd-b237-45d4-b847-c6c3f880c8b2 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:45.543825 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0d77f-519e-4230-82e5-b0b50c4ca37e None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:45.544153 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0d77f-519e-4230-82e5-b0b50c4ca37e None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:45.544437 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0d77f-519e-4230-82e5-b0b50c4ca37e None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:45.545955 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 123/240] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 02:59:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 02:59:45.551668 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e0dde-d4da-4e25-be16-a5cf0f6ea436 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:45.552674 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e0dde-d4da-4e25-be16-a5cf0f6ea436 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:45.553244 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e0dde-d4da-4e25-be16-a5cf0f6ea436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:45.573328 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-563e0dde-d4da-4e25-be16-a5cf0f6ea436 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 02:59:45.575335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-563e0dde-d4da-4e25-be16-a5cf0f6ea436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 02:59:45.590562 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748516e6-dca9-4b55-a90c-37a36e2d6e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:45.591223 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748516e6-dca9-4b55-a90c-37a36e2d6e22 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:45.591504 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748516e6-dca9-4b55-a90c-37a36e2d6e22 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:45.591775 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748516e6-dca9-4b55-a90c-37a36e2d6e22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:45.654384 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 124/241] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 02:59:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 02:59:45.658345 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5701667-f3c0-40c9-8f33-c4eb8659fc50 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:45.658345 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5701667-f3c0-40c9-8f33-c4eb8659fc50 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:45.658345 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5701667-f3c0-40c9-8f33-c4eb8659fc50 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:45.658345 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 125/242] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 02:59:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 02:59:45.666859 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa08da7-f4db-4204-b690-dc21099b42db None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:45.667144 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa08da7-f4db-4204-b690-dc21099b42db None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:45.667421 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa08da7-f4db-4204-b690-dc21099b42db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:45.695895 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-aaa08da7-f4db-4204-b690-dc21099b42db None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 02:59:45.697305 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-aaa08da7-f4db-4204-b690-dc21099b42db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 02:59:45.697657 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748516e6-dca9-4b55-a90c-37a36e2d6e22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:45.699759 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748516e6-dca9-4b55-a90c-37a36e2d6e22 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:45.774353 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 126/243] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 02:59:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 02:59:45.774927 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa08da7-f4db-4204-b690-dc21099b42db None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:45.823712 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 118/244] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 10 02:59:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 02:59:45.823712 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748516e6-dca9-4b55-a90c-37a36e2d6e22 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:45.897052 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa08da7-f4db-4204-b690-dc21099b42db None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:45.922721 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748516e6-dca9-4b55-a90c-37a36e2d6e22 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:45.943712 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bfb5bd-c641-4aeb-83d2-5fe0b7a4e6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:45.944554 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfb5bd-c641-4aeb-83d2-5fe0b7a4e6a8 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:45.944836 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfb5bd-c641-4aeb-83d2-5fe0b7a4e6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:45.945645 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfb5bd-c641-4aeb-83d2-5fe0b7a4e6a8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:45.947729 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bfb5bd-c641-4aeb-83d2-5fe0b7a4e6a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:45.949210 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bfb5bd-c641-4aeb-83d2-5fe0b7a4e6a8 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:45.955175 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 127/245] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 02:59:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:45.955175 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bfb5bd-c641-4aeb-83d2-5fe0b7a4e6a8 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:45.969666 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb60c58-bdc9-43e6-a252-ae7c2545d4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:45.971079 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb60c58-bdc9-43e6-a252-ae7c2545d4f6 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:45.971502 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb60c58-bdc9-43e6-a252-ae7c2545d4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:45.972113 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb60c58-bdc9-43e6-a252-ae7c2545d4f6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:45.986147 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb60c58-bdc9-43e6-a252-ae7c2545d4f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 02:59:45.995971 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-9cb60c58-bdc9-43e6-a252-ae7c2545d4f6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 02:59:45.995971 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 02:59:45.995971 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 02:59:45.995971 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 02:59:45.995971 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 02:59:45.995971 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 02:59:45.995971 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 02:59:45.995971 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 02:59:45.995971 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 02:59:45.995971 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 02:59:45.995971 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 02:59:45.995971 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 02:59:45.995971 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 02:59:45.995971 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 02:59:45.995971 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 02:59:45.995971 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 02:59:45.997108 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 02:59:45.997108 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 02:59:45.997108 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 02:59:45.997108 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 02:59:45.997108 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 02:59:45.997108 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 02:59:45.997108 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 02:59:45.997108 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 02:59:45.997108 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 02:59:45.997108 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 02:59:45.997108 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 02:59:45.997108 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 02:59:45.997108 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 02:59:45.997108 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 02:59:45.997108 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 02:59:45.997108 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 02:59:45.998120 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 02:59:45.998120 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 02:59:45.998120 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 02:59:45.998120 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 02:59:45.998120 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 02:59:45.998120 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 02:59:45.998120 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 02:59:45.998120 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 02:59:45.998120 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 02:59:45.998120 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 02:59:45.998120 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 02:59:45.998120 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 02:59:46.001266 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 119/246] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 10 02:59:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 02:59:46.002262 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb60c58-bdc9-43e6-a252-ae7c2545d4f6 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:46.065987 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bfb5bd-c641-4aeb-83d2-5fe0b7a4e6a8 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:46.109266 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57da8a44-0a03-4058-bd3f-ee0cdb72d720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:46.110957 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da8a44-0a03-4058-bd3f-ee0cdb72d720 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:46.111713 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da8a44-0a03-4058-bd3f-ee0cdb72d720 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:46.112257 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da8a44-0a03-4058-bd3f-ee0cdb72d720 None admin] PATH_INFO: `/v3/projects/d89ba6f6a62842108d74ca873033ee82` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:46.114393 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57da8a44-0a03-4058-bd3f-ee0cdb72d720 None admin] RBAC: Authorizing `identity:get_project(project_id=d89ba6f6a62842108d74ca873033ee82)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:46.116522 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57da8a44-0a03-4058-bd3f-ee0cdb72d720 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:46.120306 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb60c58-bdc9-43e6-a252-ae7c2545d4f6 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:46.124416 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 128/247] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 10 02:59:45 2022] GET /identity/v3/projects/d89ba6f6a62842108d74ca873033ee82 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:46.125024 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57da8a44-0a03-4058-bd3f-ee0cdb72d720 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:46.160260 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cd20f7-acb9-4ae7-b883-99dc1a532bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:46.160822 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd20f7-acb9-4ae7-b883-99dc1a532bc0 None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:46.161111 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd20f7-acb9-4ae7-b883-99dc1a532bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:46.161447 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd20f7-acb9-4ae7-b883-99dc1a532bc0 None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:46.162157 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cd20f7-acb9-4ae7-b883-99dc1a532bc0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:46.163663 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cd20f7-acb9-4ae7-b883-99dc1a532bc0 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:46.237415 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57da8a44-0a03-4058-bd3f-ee0cdb72d720 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:46.256038 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 120/248] 10.222.0.65 () {60 vars in 1132 bytes} [Tue May 10 02:59:46 2022] POST /identity/v3/users => generated 293 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 02:59:46.256038 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cd20f7-acb9-4ae7-b883-99dc1a532bc0 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:46.292045 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eafa9c-64fd-40d8-a76a-0d9e0c0b49de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:46.292733 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eafa9c-64fd-40d8-a76a-0d9e0c0b49de None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:46.293620 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eafa9c-64fd-40d8-a76a-0d9e0c0b49de None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:46.293620 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eafa9c-64fd-40d8-a76a-0d9e0c0b49de None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:46.294167 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eafa9c-64fd-40d8-a76a-0d9e0c0b49de None admin] RBAC: Adding query filter params (name=reader) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 02:59:46.296391 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eafa9c-64fd-40d8-a76a-0d9e0c0b49de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:46.299580 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eafa9c-64fd-40d8-a76a-0d9e0c0b49de None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:46.321823 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 129/249] 10.222.0.65 () {56 vars in 1101 bytes} [Tue May 10 02:59:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:46.329978 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eafa9c-64fd-40d8-a76a-0d9e0c0b49de None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:46.466737 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cd20f7-acb9-4ae7-b883-99dc1a532bc0 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:46.475121 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eafa9c-64fd-40d8-a76a-0d9e0c0b49de None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:46.521789 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d31067c-6167-4494-86de-1a1ded5fac40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:46.524224 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31067c-6167-4494-86de-1a1ded5fac40 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:46.524729 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31067c-6167-4494-86de-1a1ded5fac40 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:46.525215 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31067c-6167-4494-86de-1a1ded5fac40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:46.526801 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d31067c-6167-4494-86de-1a1ded5fac40 None admin] RBAC: Adding query filter params (role.id=43105000610f402ca2486e7648018cca, scope.project.id=d89ba6f6a62842108d74ca873033ee82, user.id=3a28204d82d74009b0035fe0b2c3601c) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 02:59:46.527380 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d31067c-6167-4494-86de-1a1ded5fac40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:46.529610 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d31067c-6167-4494-86de-1a1ded5fac40 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:46.530469 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e5c3a7-1f90-4285-84f0-6f721e9fad82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:46.531865 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5c3a7-1f90-4285-84f0-6f721e9fad82 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:46.532388 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5c3a7-1f90-4285-84f0-6f721e9fad82 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:46.533659 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5c3a7-1f90-4285-84f0-6f721e9fad82 None admin] PATH_INFO: `/v3/users/e3e1307cfd044ace940f37192011c130` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:46.542229 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 121/250] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 10 02:59:46 2022] GET /identity/v3/role_assignments?user.id=3a28204d82d74009b0035fe0b2c3601c&scope.project.id=d89ba6f6a62842108d74ca873033ee82&role.id=43105000610f402ca2486e7648018cca => generated 608 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:46.542229 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee7906-1efb-437d-bfe1-c7c7ba51913a None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:46.542229 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee7906-1efb-437d-bfe1-c7c7ba51913a None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:46.542229 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee7906-1efb-437d-bfe1-c7c7ba51913a None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:46.542229 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 122/251] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 02:59:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 02:59:46.548618 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcdd6bc-a37d-40fa-8608-0e62f95b6deb None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:46.549185 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcdd6bc-a37d-40fa-8608-0e62f95b6deb None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:46.549657 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcdd6bc-a37d-40fa-8608-0e62f95b6deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:46.553264 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e5c3a7-1f90-4285-84f0-6f721e9fad82 None admin] RBAC: Authorizing `identity:get_user(user_id=e3e1307cfd044ace940f37192011c130)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:46.554794 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e5c3a7-1f90-4285-84f0-6f721e9fad82 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:46.556727 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 130/252] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 10 02:59:46 2022] GET /identity/v3/users/e3e1307cfd044ace940f37192011c130 => generated 297 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:46.563588 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e5c3a7-1f90-4285-84f0-6f721e9fad82 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:46.569239 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-0fcdd6bc-a37d-40fa-8608-0e62f95b6deb None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 02:59:46.571130 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-0fcdd6bc-a37d-40fa-8608-0e62f95b6deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 02:59:46.647597 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 123/253] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 02:59:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 02:59:46.670852 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9822b-d2c3-4165-9b20-94ad86ff2349 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:46.671388 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9822b-d2c3-4165-9b20-94ad86ff2349 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:46.671838 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9822b-d2c3-4165-9b20-94ad86ff2349 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:46.673414 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 124/254] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 02:59:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 02:59:46.674291 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e9822b-d2c3-4165-9b20-94ad86ff2349 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:46.698594 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e5c3a7-1f90-4285-84f0-6f721e9fad82 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:46.736101 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7edab2d-8d0c-4eb8-abd2-276a3a960a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:46.737054 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7edab2d-8d0c-4eb8-abd2-276a3a960a19 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:46.737483 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7edab2d-8d0c-4eb8-abd2-276a3a960a19 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:46.737911 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7edab2d-8d0c-4eb8-abd2-276a3a960a19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:46.797421 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e9822b-d2c3-4165-9b20-94ad86ff2349 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:46.809047 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7edab2d-8d0c-4eb8-abd2-276a3a960a19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:46.810599 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7edab2d-8d0c-4eb8-abd2-276a3a960a19 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:46.846748 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a92b964-9aeb-4db3-b7c5-b3d2a2d3fdb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:46.846748 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92b964-9aeb-4db3-b7c5-b3d2a2d3fdb2 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:46.846748 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92b964-9aeb-4db3-b7c5-b3d2a2d3fdb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:46.846748 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92b964-9aeb-4db3-b7c5-b3d2a2d3fdb2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:46.866784 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a92b964-9aeb-4db3-b7c5-b3d2a2d3fdb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 02:59:46.878095 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-4a92b964-9aeb-4db3-b7c5-b3d2a2d3fdb2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 02:59:46.878095 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 02:59:46.878095 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 02:59:46.878095 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 02:59:46.878095 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 02:59:46.878095 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 02:59:46.878095 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 02:59:46.878095 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 02:59:46.878095 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 02:59:46.878095 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 02:59:46.878095 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 02:59:46.878095 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 02:59:46.878095 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 02:59:46.878095 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 02:59:46.878095 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 02:59:46.878095 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 02:59:46.879016 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 02:59:46.879016 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 02:59:46.879016 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 02:59:46.879016 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 02:59:46.879016 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 02:59:46.879016 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 02:59:46.879016 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 02:59:46.879016 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 02:59:46.879016 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 02:59:46.879016 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 02:59:46.879016 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 02:59:46.879016 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 02:59:46.879016 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 02:59:46.879016 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 02:59:46.879016 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 02:59:46.879016 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 02:59:46.879790 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 02:59:46.879790 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 02:59:46.879790 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 02:59:46.879790 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 02:59:46.879790 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 02:59:46.879790 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 02:59:46.879790 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 02:59:46.879790 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 02:59:46.879790 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 02:59:46.879790 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 02:59:46.879790 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 02:59:46.879790 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 02:59:46.882434 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 125/255] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 10 02:59:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 02:59:46.885365 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d497cc-599a-477c-9eaa-ef1a36f6425c None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:46.885921 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d497cc-599a-477c-9eaa-ef1a36f6425c None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:46.886440 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d497cc-599a-477c-9eaa-ef1a36f6425c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:46.908490 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-99d497cc-599a-477c-9eaa-ef1a36f6425c None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 02:59:46.910387 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-99d497cc-599a-477c-9eaa-ef1a36f6425c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 02:59:46.942995 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 131/256] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 10 02:59:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 02:59:46.943956 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7edab2d-8d0c-4eb8-abd2-276a3a960a19 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:47.002519 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 126/257] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 02:59:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 02:59:47.004301 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d497cc-599a-477c-9eaa-ef1a36f6425c None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:47.051991 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7edab2d-8d0c-4eb8-abd2-276a3a960a19 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:47.086635 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6272a9a4-205a-4030-aece-fe64640a7b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:47.087015 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272a9a4-205a-4030-aece-fe64640a7b0f None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:47.087271 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272a9a4-205a-4030-aece-fe64640a7b0f None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:47.087548 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272a9a4-205a-4030-aece-fe64640a7b0f None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:47.088335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6272a9a4-205a-4030-aece-fe64640a7b0f None admin] RBAC: Adding query filter params (name=member) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 02:59:47.088647 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6272a9a4-205a-4030-aece-fe64640a7b0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:47.090033 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6272a9a4-205a-4030-aece-fe64640a7b0f None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:47.103987 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 132/258] 10.222.0.65 () {56 vars in 1101 bytes} [Tue May 10 02:59:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:47.105268 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6272a9a4-205a-4030-aece-fe64640a7b0f None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:47.131819 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d497cc-599a-477c-9eaa-ef1a36f6425c None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:47.166134 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd6587-226a-4949-a62f-e3a9b455b962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:47.166921 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd6587-226a-4949-a62f-e3a9b455b962 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:47.167204 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd6587-226a-4949-a62f-e3a9b455b962 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:47.167480 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd6587-226a-4949-a62f-e3a9b455b962 None admin] PATH_INFO: `/v3/projects/d89ba6f6a62842108d74ca873033ee82` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:47.168690 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dd6587-226a-4949-a62f-e3a9b455b962 None admin] RBAC: Authorizing `identity:get_project(project_id=d89ba6f6a62842108d74ca873033ee82)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:47.170138 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dd6587-226a-4949-a62f-e3a9b455b962 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:47.172065 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 127/259] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 10 02:59:47 2022] GET /identity/v3/projects/d89ba6f6a62842108d74ca873033ee82 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:47.172617 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd6587-226a-4949-a62f-e3a9b455b962 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:47.247632 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6272a9a4-205a-4030-aece-fe64640a7b0f None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:47.281706 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1cf385-894e-4101-93ea-1721ca1b3d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:47.282782 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1cf385-894e-4101-93ea-1721ca1b3d91 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:47.283066 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1cf385-894e-4101-93ea-1721ca1b3d91 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:47.283234 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd6587-226a-4949-a62f-e3a9b455b962 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:47.283330 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1cf385-894e-4101-93ea-1721ca1b3d91 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:47.296576 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1cf385-894e-4101-93ea-1721ca1b3d91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 02:59:47.307745 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-5b1cf385-894e-4101-93ea-1721ca1b3d91 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 02:59:47.307745 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 02:59:47.307745 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 02:59:47.307745 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 02:59:47.307745 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 02:59:47.307745 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 02:59:47.307745 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 02:59:47.307745 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 02:59:47.307745 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 02:59:47.307745 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 02:59:47.307745 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 02:59:47.307745 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 02:59:47.307745 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 02:59:47.307745 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 02:59:47.307745 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 02:59:47.307745 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 02:59:47.308667 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 02:59:47.308667 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 02:59:47.308667 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 02:59:47.308667 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 02:59:47.308667 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 02:59:47.308667 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 02:59:47.308667 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 02:59:47.308667 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 02:59:47.308667 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 02:59:47.308667 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 02:59:47.308667 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 02:59:47.308667 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 02:59:47.308667 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 02:59:47.308667 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 02:59:47.308667 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 02:59:47.308667 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 02:59:47.309462 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 02:59:47.309462 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 02:59:47.309462 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 02:59:47.309462 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 02:59:47.309462 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 02:59:47.309462 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 02:59:47.309462 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 02:59:47.309462 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 02:59:47.309462 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 02:59:47.309462 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 02:59:47.309462 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 02:59:47.309462 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 02:59:47.312161 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 133/260] 10.222.0.65 () {56 vars in 1114 bytes} [Tue May 10 02:59:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 02:59:47.312996 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1cf385-894e-4101-93ea-1721ca1b3d91 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:47.324680 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b452eccf-a4d2-4ac5-b817-fd0c4635ad71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:47.325938 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452eccf-a4d2-4ac5-b817-fd0c4635ad71 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:47.326216 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452eccf-a4d2-4ac5-b817-fd0c4635ad71 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:47.326808 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452eccf-a4d2-4ac5-b817-fd0c4635ad71 None admin] PATH_INFO: `/v3/users/9917a15f2091446ba31c7f27fc84d2fe` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:47.328278 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b452eccf-a4d2-4ac5-b817-fd0c4635ad71 None admin] RBAC: Authorizing `identity:get_user(user_id=9917a15f2091446ba31c7f27fc84d2fe)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:47.330392 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b452eccf-a4d2-4ac5-b817-fd0c4635ad71 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:47.332531 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 128/261] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 10 02:59:47 2022] GET /identity/v3/users/9917a15f2091446ba31c7f27fc84d2fe => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:47.333298 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b452eccf-a4d2-4ac5-b817-fd0c4635ad71 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:47.419243 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1cf385-894e-4101-93ea-1721ca1b3d91 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:47.440792 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b452eccf-a4d2-4ac5-b817-fd0c4635ad71 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:47.459952 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4729ed-e830-49d3-ba05-61a27e9a8b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:47.460920 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4729ed-e830-49d3-ba05-61a27e9a8b15 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:47.461338 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4729ed-e830-49d3-ba05-61a27e9a8b15 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:47.461748 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4729ed-e830-49d3-ba05-61a27e9a8b15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:47.462721 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4729ed-e830-49d3-ba05-61a27e9a8b15 None admin] RBAC: Adding query filter params (role.id=d1526e6293dc47b1a0e78c462f588dac, scope.project.id=d89ba6f6a62842108d74ca873033ee82, user.id=e3e1307cfd044ace940f37192011c130) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 02:59:47.463170 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4729ed-e830-49d3-ba05-61a27e9a8b15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:47.464776 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4729ed-e830-49d3-ba05-61a27e9a8b15 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:47.470880 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 134/262] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 10 02:59:47 2022] GET /identity/v3/role_assignments?user.id=e3e1307cfd044ace940f37192011c130&scope.project.id=d89ba6f6a62842108d74ca873033ee82&role.id=d1526e6293dc47b1a0e78c462f588dac => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:47.471841 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4729ed-e830-49d3-ba05-61a27e9a8b15 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:47.486587 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f9beb6-5fbf-42ad-9e94-3d756b1f1405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:47.487064 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9beb6-5fbf-42ad-9e94-3d756b1f1405 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:47.487354 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9beb6-5fbf-42ad-9e94-3d756b1f1405 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:47.487624 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9beb6-5fbf-42ad-9e94-3d756b1f1405 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:47.488433 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f9beb6-5fbf-42ad-9e94-3d756b1f1405 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 02:59:47.488750 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f9beb6-5fbf-42ad-9e94-3d756b1f1405 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:47.490219 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f9beb6-5fbf-42ad-9e94-3d756b1f1405 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:47.514525 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 129/263] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 10 02:59:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:47.519780 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f9beb6-5fbf-42ad-9e94-3d756b1f1405 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:47.584667 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4729ed-e830-49d3-ba05-61a27e9a8b15 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:47.629605 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ffc700-e0a9-47f8-900b-5778c1634b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:47.630759 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffc700-e0a9-47f8-900b-5778c1634b5c None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:47.631191 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffc700-e0a9-47f8-900b-5778c1634b5c None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:47.631610 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffc700-e0a9-47f8-900b-5778c1634b5c None admin] PATH_INFO: `/v3/projects/d89ba6f6a62842108d74ca873033ee82` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:47.633169 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ffc700-e0a9-47f8-900b-5778c1634b5c None admin] RBAC: Authorizing `identity:get_project(project_id=d89ba6f6a62842108d74ca873033ee82)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:47.634871 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ffc700-e0a9-47f8-900b-5778c1634b5c None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:47.636910 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 135/264] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 10 02:59:47 2022] GET /identity/v3/projects/d89ba6f6a62842108d74ca873033ee82 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:47.644100 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ffc700-e0a9-47f8-900b-5778c1634b5c None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:47.689708 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f9beb6-5fbf-42ad-9e94-3d756b1f1405 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:47.728761 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f2a59-9f1d-468c-8198-e00c7a425e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:47.729651 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f2a59-9f1d-468c-8198-e00c7a425e39 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:47.729934 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f2a59-9f1d-468c-8198-e00c7a425e39 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:47.730207 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f2a59-9f1d-468c-8198-e00c7a425e39 None admin] PATH_INFO: `/v3/users/3a28204d82d74009b0035fe0b2c3601c` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:47.731500 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5f2a59-9f1d-468c-8198-e00c7a425e39 None admin] RBAC: Authorizing `identity:get_user(user_id=3a28204d82d74009b0035fe0b2c3601c)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:47.732995 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5f2a59-9f1d-468c-8198-e00c7a425e39 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:47.734939 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 130/265] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 10 02:59:47 2022] GET /identity/v3/users/3a28204d82d74009b0035fe0b2c3601c => generated 283 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 02:59:47.740552 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f2a59-9f1d-468c-8198-e00c7a425e39 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:47.852996 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f2a59-9f1d-468c-8198-e00c7a425e39 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:47.885893 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ffc700-e0a9-47f8-900b-5778c1634b5c None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:47.890853 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d92b633-ccf5-41f6-81f4-e4e4febf041f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:47.891524 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92b633-ccf5-41f6-81f4-e4e4febf041f None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:47.891807 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92b633-ccf5-41f6-81f4-e4e4febf041f None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:47.892112 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92b633-ccf5-41f6-81f4-e4e4febf041f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:47.923027 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c119b2c1-c108-476c-aaa6-7cce2cf03bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:47.924313 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c119b2c1-c108-476c-aaa6-7cce2cf03bcc None admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:47.924854 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c119b2c1-c108-476c-aaa6-7cce2cf03bcc None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:47.925325 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c119b2c1-c108-476c-aaa6-7cce2cf03bcc None admin] PATH_INFO: `/v3/projects/d89ba6f6a62842108d74ca873033ee82/users/9917a15f2091446ba31c7f27fc84d2fe/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:47.927583 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c119b2c1-c108-476c-aaa6-7cce2cf03bcc None admin] RBAC: Authorizing `identity:create_grant(project_id=d89ba6f6a62842108d74ca873033ee82, user_id=9917a15f2091446ba31c7f27fc84d2fe, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:47.929257 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c119b2c1-c108-476c-aaa6-7cce2cf03bcc None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:47.962855 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d92b633-ccf5-41f6-81f4-e4e4febf041f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:47.964360 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d92b633-ccf5-41f6-81f4-e4e4febf041f None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:48.034030 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 136/266] 10.222.0.65 () {58 vars in 1439 bytes} [Tue May 10 02:59:47 2022] PUT /identity/v3/projects/d89ba6f6a62842108d74ca873033ee82/users/9917a15f2091446ba31c7f27fc84d2fe/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 02:59:48.065761 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 131/267] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 10 02:59:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 02:59:48.071917 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c119b2c1-c108-476c-aaa6-7cce2cf03bcc None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:48.190998 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c119b2c1-c108-476c-aaa6-7cce2cf03bcc None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:48.235636 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d8aa7-2075-4db9-b4c9-33ed77134f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:48.236453 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d8aa7-2075-4db9-b4c9-33ed77134f00 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:48.236735 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d8aa7-2075-4db9-b4c9-33ed77134f00 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:48.237010 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d8aa7-2075-4db9-b4c9-33ed77134f00 None admin] PATH_INFO: `/v3/projects/d89ba6f6a62842108d74ca873033ee82` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:48.238208 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d8aa7-2075-4db9-b4c9-33ed77134f00 None admin] RBAC: Authorizing `identity:get_project(project_id=d89ba6f6a62842108d74ca873033ee82)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:48.239657 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d8aa7-2075-4db9-b4c9-33ed77134f00 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:48.241389 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 137/268] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 10 02:59:48 2022] GET /identity/v3/projects/d89ba6f6a62842108d74ca873033ee82 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:48.247403 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d92b633-ccf5-41f6-81f4-e4e4febf041f None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:48.354632 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d92b633-ccf5-41f6-81f4-e4e4febf041f None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:48.393454 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f6cb16-a257-4145-bc47-ccfdb4f661c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:48.394111 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6cb16-a257-4145-bc47-ccfdb4f661c4 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:48.394394 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6cb16-a257-4145-bc47-ccfdb4f661c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:48.394667 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6cb16-a257-4145-bc47-ccfdb4f661c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:48.395503 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f6cb16-a257-4145-bc47-ccfdb4f661c4 None admin] RBAC: Adding query filter params (role.id=b2cf4d51cc0b4532adcb7021d474177e, scope.project.id=d89ba6f6a62842108d74ca873033ee82, user.id=3a28204d82d74009b0035fe0b2c3601c) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 02:59:48.395811 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f6cb16-a257-4145-bc47-ccfdb4f661c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:48.397301 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f6cb16-a257-4145-bc47-ccfdb4f661c4 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:48.403864 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 132/269] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 10 02:59:48 2022] GET /identity/v3/role_assignments?user.id=3a28204d82d74009b0035fe0b2c3601c&scope.project.id=d89ba6f6a62842108d74ca873033ee82&role.id=b2cf4d51cc0b4532adcb7021d474177e => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:49.088172 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d65b2-867c-41f2-aa54-e25a988dbec3 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:49.088763 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d65b2-867c-41f2-aa54-e25a988dbec3 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:49.088763 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d65b2-867c-41f2-aa54-e25a988dbec3 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:49.090290 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 138/270] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 02:59:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 02:59:49.096250 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e528e3-18a1-4801-a1f0-00f3cbe075da None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:49.097145 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e528e3-18a1-4801-a1f0-00f3cbe075da None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:49.097650 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e528e3-18a1-4801-a1f0-00f3cbe075da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:49.115247 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-c0e528e3-18a1-4801-a1f0-00f3cbe075da None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 02:59:49.116778 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-c0e528e3-18a1-4801-a1f0-00f3cbe075da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 02:59:49.192105 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 133/271] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 02:59:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 02:59:49.209738 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8d65b2-867c-41f2-aa54-e25a988dbec3 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:49.263542 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d7719-9ff1-49e6-8df5-f2349748b84d None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:49.264192 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d7719-9ff1-49e6-8df5-f2349748b84d None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:49.264675 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d7719-9ff1-49e6-8df5-f2349748b84d None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:49.266249 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 134/272] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 02:59:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 02:59:49.273738 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85107a2-c171-4832-bc2f-99a37d055a35 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:49.274252 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85107a2-c171-4832-bc2f-99a37d055a35 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:49.274920 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85107a2-c171-4832-bc2f-99a37d055a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:49.296917 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-b85107a2-c171-4832-bc2f-99a37d055a35 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 02:59:49.298844 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-b85107a2-c171-4832-bc2f-99a37d055a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 02:59:49.317079 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8d65b2-867c-41f2-aa54-e25a988dbec3 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:49.351275 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b53365-9d98-44af-9a31-87fbd40b1846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:49.352173 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b53365-9d98-44af-9a31-87fbd40b1846 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:49.352560 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b53365-9d98-44af-9a31-87fbd40b1846 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:49.352938 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b53365-9d98-44af-9a31-87fbd40b1846 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:49.363637 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b53365-9d98-44af-9a31-87fbd40b1846 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 02:59:49.371776 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-59b53365-9d98-44af-9a31-87fbd40b1846 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 02:59:49.371776 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 02:59:49.371776 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 02:59:49.371776 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 02:59:49.371776 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 02:59:49.371776 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 02:59:49.371776 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 02:59:49.371776 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 02:59:49.371776 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 02:59:49.371776 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 02:59:49.371776 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 02:59:49.371776 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 02:59:49.371776 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 02:59:49.371776 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 02:59:49.371776 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 02:59:49.371776 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 02:59:49.372907 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 02:59:49.372907 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 02:59:49.372907 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 02:59:49.372907 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 02:59:49.372907 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 02:59:49.372907 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 02:59:49.372907 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 02:59:49.372907 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 02:59:49.372907 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 02:59:49.372907 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 02:59:49.372907 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 02:59:49.372907 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 02:59:49.372907 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 02:59:49.372907 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 02:59:49.372907 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 02:59:49.372907 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 02:59:49.373927 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 02:59:49.373927 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 02:59:49.373927 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 02:59:49.373927 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 02:59:49.373927 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 02:59:49.373927 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 02:59:49.373927 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 02:59:49.373927 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 02:59:49.373927 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 02:59:49.373927 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 02:59:49.373927 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 02:59:49.373927 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 02:59:49.380765 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 139/273] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 10 02:59:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 02:59:49.382232 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b53365-9d98-44af-9a31-87fbd40b1846 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:49.396154 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 135/274] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 02:59:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 02:59:49.415781 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85107a2-c171-4832-bc2f-99a37d055a35 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:49.517427 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b53365-9d98-44af-9a31-87fbd40b1846 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:49.531424 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85107a2-c171-4832-bc2f-99a37d055a35 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:49.562282 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63eace6-a9f9-4c4f-a67c-eed39c72b50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:49.563524 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63eace6-a9f9-4c4f-a67c-eed39c72b50f None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:49.564090 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63eace6-a9f9-4c4f-a67c-eed39c72b50f None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:49.564634 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63eace6-a9f9-4c4f-a67c-eed39c72b50f None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:49.565635 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63eace6-a9f9-4c4f-a67c-eed39c72b50f None admin] RBAC: Adding query filter params (name=member) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 02:59:49.566120 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63eace6-a9f9-4c4f-a67c-eed39c72b50f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:49.566935 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf16d4d-e062-453e-8177-57d167368e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:49.567829 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf16d4d-e062-453e-8177-57d167368e9f None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:49.568090 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63eace6-a9f9-4c4f-a67c-eed39c72b50f None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:49.568328 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf16d4d-e062-453e-8177-57d167368e9f None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:49.568712 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf16d4d-e062-453e-8177-57d167368e9f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:49.570008 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf16d4d-e062-453e-8177-57d167368e9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:49.571600 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf16d4d-e062-453e-8177-57d167368e9f None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:49.573695 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 136/275] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 02:59:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 02:59:49.582147 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf16d4d-e062-453e-8177-57d167368e9f None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:49.582627 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 140/276] 10.222.0.65 () {56 vars in 1101 bytes} [Tue May 10 02:59:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:49.584836 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63eace6-a9f9-4c4f-a67c-eed39c72b50f None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:49.679329 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf16d4d-e062-453e-8177-57d167368e9f None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:49.712646 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63eace6-a9f9-4c4f-a67c-eed39c72b50f None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:49.716985 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19217e53-6433-4717-82ad-3ad69ac9f3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:49.717775 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19217e53-6433-4717-82ad-3ad69ac9f3b0 None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:49.718131 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19217e53-6433-4717-82ad-3ad69ac9f3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:49.718486 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19217e53-6433-4717-82ad-3ad69ac9f3b0 None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:49.719298 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19217e53-6433-4717-82ad-3ad69ac9f3b0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:49.720943 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19217e53-6433-4717-82ad-3ad69ac9f3b0 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:49.750112 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d947006c-5c3a-4165-81b4-e026ff5b1774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:49.751916 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d947006c-5c3a-4165-81b4-e026ff5b1774 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:49.751916 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d947006c-5c3a-4165-81b4-e026ff5b1774 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:49.751916 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d947006c-5c3a-4165-81b4-e026ff5b1774 None admin] PATH_INFO: `/v3/users/10553f47f2a84eb9abf0dbd36ee7d012` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:49.764825 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d947006c-5c3a-4165-81b4-e026ff5b1774 None admin] RBAC: Authorizing `identity:get_user(user_id=10553f47f2a84eb9abf0dbd36ee7d012)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:49.766292 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d947006c-5c3a-4165-81b4-e026ff5b1774 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:49.768168 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 141/277] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 10 02:59:49 2022] GET /identity/v3/users/10553f47f2a84eb9abf0dbd36ee7d012 => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 02:59:49.774148 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d947006c-5c3a-4165-81b4-e026ff5b1774 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:49.848381 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 137/278] 10.222.0.65 () {60 vars in 1132 bytes} [Tue May 10 02:59:49 2022] POST /identity/v3/users => generated 293 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 02:59:49.882496 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d947006c-5c3a-4165-81b4-e026ff5b1774 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:49.891019 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a3e15-498d-4663-9564-13fa3cf89d18 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:49.891312 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a3e15-498d-4663-9564-13fa3cf89d18 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:49.891725 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a3e15-498d-4663-9564-13fa3cf89d18 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:49.893120 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 138/279] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 02:59:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 02:59:49.899160 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ecd4d1-cf26-4c9b-a790-4d1cf82506b9 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:49.899580 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ecd4d1-cf26-4c9b-a790-4d1cf82506b9 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:49.899977 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ecd4d1-cf26-4c9b-a790-4d1cf82506b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:49.919987 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-46ecd4d1-cf26-4c9b-a790-4d1cf82506b9 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 02:59:49.921686 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-46ecd4d1-cf26-4c9b-a790-4d1cf82506b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 02:59:49.924828 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533b4aa3-825a-4cb5-b9e2-b69275093e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:49.925723 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b4aa3-825a-4cb5-b9e2-b69275093e1c None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:49.926174 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b4aa3-825a-4cb5-b9e2-b69275093e1c None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:49.926591 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b4aa3-825a-4cb5-b9e2-b69275093e1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:49.927582 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533b4aa3-825a-4cb5-b9e2-b69275093e1c None admin] RBAC: Adding query filter params (role.id=bab81fd8d58945b8a1ea63c93b3b4857, user.id=10553f47f2a84eb9abf0dbd36ee7d012, scope.system=all) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 02:59:49.928086 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533b4aa3-825a-4cb5-b9e2-b69275093e1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:49.929826 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533b4aa3-825a-4cb5-b9e2-b69275093e1c None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:49.935888 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 142/280] 10.222.0.65 () {56 vars in 1308 bytes} [Tue May 10 02:59:49 2022] GET /identity/v3/role_assignments?user.id=10553f47f2a84eb9abf0dbd36ee7d012&scope.system=all&role.id=bab81fd8d58945b8a1ea63c93b3b4857 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 02:59:50.006507 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 139/281] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 02:59:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 02:59:50.029481 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533b4aa3-825a-4cb5-b9e2-b69275093e1c None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:50.138958 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533b4aa3-825a-4cb5-b9e2-b69275093e1c None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:50.174020 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1fbf0e-032c-4160-91ae-b6c62d6efbd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:50.174821 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fbf0e-032c-4160-91ae-b6c62d6efbd9 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:50.175096 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fbf0e-032c-4160-91ae-b6c62d6efbd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:50.175365 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fbf0e-032c-4160-91ae-b6c62d6efbd9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:50.185950 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1fbf0e-032c-4160-91ae-b6c62d6efbd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 02:59:50.193636 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-1b1fbf0e-032c-4160-91ae-b6c62d6efbd9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 02:59:50.193636 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 02:59:50.193636 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 02:59:50.193636 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 02:59:50.193636 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 02:59:50.193636 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 02:59:50.193636 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 02:59:50.193636 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 02:59:50.193636 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 02:59:50.193636 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 02:59:50.193636 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 02:59:50.193636 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 02:59:50.193636 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 02:59:50.193636 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 02:59:50.193636 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 02:59:50.193636 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 02:59:50.194521 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 02:59:50.194521 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 02:59:50.194521 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 02:59:50.194521 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 02:59:50.194521 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 02:59:50.194521 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 02:59:50.194521 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 02:59:50.194521 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 02:59:50.194521 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 02:59:50.194521 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 02:59:50.194521 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 02:59:50.194521 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 02:59:50.194521 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 02:59:50.194521 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 02:59:50.194521 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 02:59:50.194521 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 02:59:50.195852 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 02:59:50.195852 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 02:59:50.195852 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 02:59:50.195852 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 02:59:50.195852 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 02:59:50.195852 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 02:59:50.195852 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 02:59:50.195852 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 02:59:50.195852 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 02:59:50.195852 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 02:59:50.195852 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 02:59:50.195852 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 02:59:50.195852 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 143/282] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 10 02:59:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 02:59:50.202577 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ecd4d1-cf26-4c9b-a790-4d1cf82506b9 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:50.312254 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ecd4d1-cf26-4c9b-a790-4d1cf82506b9 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:50.351502 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007cba8f-0ac0-4213-964d-eeae97324f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:50.352571 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007cba8f-0ac0-4213-964d-eeae97324f4e None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:50.353054 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007cba8f-0ac0-4213-964d-eeae97324f4e None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:50.353539 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007cba8f-0ac0-4213-964d-eeae97324f4e None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:50.354485 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007cba8f-0ac0-4213-964d-eeae97324f4e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 02:59:50.354997 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007cba8f-0ac0-4213-964d-eeae97324f4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:50.357014 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007cba8f-0ac0-4213-964d-eeae97324f4e None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:50.367400 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 140/283] 10.222.0.65 () {56 vars in 1101 bytes} [Tue May 10 02:59:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:50.373082 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1fbf0e-032c-4160-91ae-b6c62d6efbd9 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:50.486232 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1fbf0e-032c-4160-91ae-b6c62d6efbd9 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:50.524041 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1535aac-6f0b-494e-8c7c-f08aa7ed7847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:50.524925 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1535aac-6f0b-494e-8c7c-f08aa7ed7847 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:50.525201 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1535aac-6f0b-494e-8c7c-f08aa7ed7847 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:50.525471 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1535aac-6f0b-494e-8c7c-f08aa7ed7847 None admin] PATH_INFO: `/v3/users/e3e1307cfd044ace940f37192011c130` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:50.526679 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1535aac-6f0b-494e-8c7c-f08aa7ed7847 None admin] RBAC: Authorizing `identity:get_user(user_id=e3e1307cfd044ace940f37192011c130)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:50.528170 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1535aac-6f0b-494e-8c7c-f08aa7ed7847 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:50.530107 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 144/284] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 10 02:59:50 2022] GET /identity/v3/users/e3e1307cfd044ace940f37192011c130 => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:50.535785 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007cba8f-0ac0-4213-964d-eeae97324f4e None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:50.649642 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4ad03-79ab-45a9-9e0c-d81d438207c8 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:50.649933 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4ad03-79ab-45a9-9e0c-d81d438207c8 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:50.650189 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4ad03-79ab-45a9-9e0c-d81d438207c8 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:50.651723 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 145/285] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 02:59:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 02:59:50.656815 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815de6f3-632c-42b5-b957-6256e67a97fa None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:50.657329 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815de6f3-632c-42b5-b957-6256e67a97fa None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:50.658047 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815de6f3-632c-42b5-b957-6256e67a97fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:50.676698 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-815de6f3-632c-42b5-b957-6256e67a97fa None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 02:59:50.678667 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-815de6f3-632c-42b5-b957-6256e67a97fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 02:59:50.684288 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007cba8f-0ac0-4213-964d-eeae97324f4e None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:50.752661 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d7c0c-b565-43dd-8ab9-18d398c74243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:50.753870 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d7c0c-b565-43dd-8ab9-18d398c74243 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:50.754469 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d7c0c-b565-43dd-8ab9-18d398c74243 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:50.754947 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d7c0c-b565-43dd-8ab9-18d398c74243 None admin] PATH_INFO: `/v3/projects/d89ba6f6a62842108d74ca873033ee82` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:50.756796 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4d7c0c-b565-43dd-8ab9-18d398c74243 None admin] RBAC: Authorizing `identity:get_project(project_id=d89ba6f6a62842108d74ca873033ee82)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:50.758920 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4d7c0c-b565-43dd-8ab9-18d398c74243 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:50.765416 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 141/286] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 10 02:59:50 2022] GET /identity/v3/projects/d89ba6f6a62842108d74ca873033ee82 => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:50.766253 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d7c0c-b565-43dd-8ab9-18d398c74243 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:50.785071 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 146/287] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 02:59:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 02:59:50.810087 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815de6f3-632c-42b5-b957-6256e67a97fa None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:50.921281 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815de6f3-632c-42b5-b957-6256e67a97fa None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:50.963060 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6950ad48-a639-4676-9b14-31f72aa86fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:50.964274 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950ad48-a639-4676-9b14-31f72aa86fe4 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:50.964739 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950ad48-a639-4676-9b14-31f72aa86fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:50.965195 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950ad48-a639-4676-9b14-31f72aa86fe4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:50.986279 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d7c0c-b565-43dd-8ab9-18d398c74243 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:50.989025 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6950ad48-a639-4676-9b14-31f72aa86fe4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 02:59:50.997327 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-6950ad48-a639-4676-9b14-31f72aa86fe4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 02:59:50.997327 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 02:59:50.997327 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 02:59:50.997327 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 02:59:50.997327 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 02:59:50.997327 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 02:59:50.997327 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 02:59:50.997327 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 02:59:50.997327 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 02:59:50.997327 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 02:59:50.997327 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 02:59:50.997327 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 02:59:50.997327 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 02:59:50.997327 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 02:59:50.997327 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 02:59:50.997327 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 02:59:50.998182 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 02:59:50.998182 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 02:59:50.998182 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 02:59:50.998182 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 02:59:50.998182 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 02:59:50.998182 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 02:59:50.998182 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 02:59:50.998182 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 02:59:50.998182 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 02:59:50.998182 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 02:59:50.998182 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 02:59:50.998182 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 02:59:50.998182 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 02:59:50.998182 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 02:59:50.998182 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 02:59:50.998182 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 02:59:50.998986 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 02:59:50.998986 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 02:59:50.998986 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 02:59:50.998986 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 02:59:50.998986 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 02:59:50.998986 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 02:59:50.998986 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 02:59:50.998986 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 02:59:50.998986 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 02:59:50.998986 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 02:59:50.998986 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 02:59:50.998986 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 02:59:51.011049 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 147/288] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 10 02:59:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 02:59:51.011874 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6950ad48-a639-4676-9b14-31f72aa86fe4 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:51.038519 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe799b6a-ee55-4be6-a05c-efed0ef3c5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:51.047484 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe799b6a-ee55-4be6-a05c-efed0ef3c5c3 None admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:51.047484 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe799b6a-ee55-4be6-a05c-efed0ef3c5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:51.047484 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe799b6a-ee55-4be6-a05c-efed0ef3c5c3 None admin] PATH_INFO: `/v3/projects/d89ba6f6a62842108d74ca873033ee82/users/e3e1307cfd044ace940f37192011c130/roles/d1526e6293dc47b1a0e78c462f588dac` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:51.047484 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe799b6a-ee55-4be6-a05c-efed0ef3c5c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=d89ba6f6a62842108d74ca873033ee82, user_id=e3e1307cfd044ace940f37192011c130, role_id=d1526e6293dc47b1a0e78c462f588dac)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:51.047484 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe799b6a-ee55-4be6-a05c-efed0ef3c5c3 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:51.145191 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6950ad48-a639-4676-9b14-31f72aa86fe4 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:51.179214 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c51e15-ac4c-4ccc-84a0-4628fdf725fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:51.180468 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c51e15-ac4c-4ccc-84a0-4628fdf725fb None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:51.180754 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c51e15-ac4c-4ccc-84a0-4628fdf725fb None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:51.181028 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c51e15-ac4c-4ccc-84a0-4628fdf725fb None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:51.181786 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c51e15-ac4c-4ccc-84a0-4628fdf725fb None admin] RBAC: Adding query filter params (name=member) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 02:59:51.182149 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c51e15-ac4c-4ccc-84a0-4628fdf725fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:51.183531 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c51e15-ac4c-4ccc-84a0-4628fdf725fb None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:51.191998 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 148/289] 10.222.0.65 () {56 vars in 1101 bytes} [Tue May 10 02:59:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:51.203998 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 142/290] 10.222.0.65 () {58 vars in 1439 bytes} [Tue May 10 02:59:50 2022] PUT /identity/v3/projects/d89ba6f6a62842108d74ca873033ee82/users/e3e1307cfd044ace940f37192011c130/roles/d1526e6293dc47b1a0e78c462f588dac => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 02:59:51.205029 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c51e15-ac4c-4ccc-84a0-4628fdf725fb None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:51.315728 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c51e15-ac4c-4ccc-84a0-4628fdf725fb None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:51.351898 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c5d32c-a66f-4ad6-a4bb-ff630640aa53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:51.352807 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5d32c-a66f-4ad6-a4bb-ff630640aa53 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:51.353088 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5d32c-a66f-4ad6-a4bb-ff630640aa53 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:51.353364 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5d32c-a66f-4ad6-a4bb-ff630640aa53 None admin] PATH_INFO: `/v3/users/9917a15f2091446ba31c7f27fc84d2fe` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:51.354587 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c5d32c-a66f-4ad6-a4bb-ff630640aa53 None admin] RBAC: Authorizing `identity:get_user(user_id=9917a15f2091446ba31c7f27fc84d2fe)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:51.356058 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c5d32c-a66f-4ad6-a4bb-ff630640aa53 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:51.357804 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 149/291] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 10 02:59:51 2022] GET /identity/v3/users/9917a15f2091446ba31c7f27fc84d2fe => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:51.363449 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe799b6a-ee55-4be6-a05c-efed0ef3c5c3 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:51.502164 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe799b6a-ee55-4be6-a05c-efed0ef3c5c3 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:51.538334 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0378eb-c9d2-441a-81ca-5c67f6d8ae77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:51.539555 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0378eb-c9d2-441a-81ca-5c67f6d8ae77 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:51.539843 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0378eb-c9d2-441a-81ca-5c67f6d8ae77 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:51.540168 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0378eb-c9d2-441a-81ca-5c67f6d8ae77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:51.617420 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0378eb-c9d2-441a-81ca-5c67f6d8ae77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:51.618871 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0378eb-c9d2-441a-81ca-5c67f6d8ae77 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:51.743539 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 143/292] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 10 02:59:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 02:59:51.748899 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c5d32c-a66f-4ad6-a4bb-ff630640aa53 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:51.897338 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c5d32c-a66f-4ad6-a4bb-ff630640aa53 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:51.940509 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d594b26b-367e-42b8-918b-ccf4cd37df07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:51.941374 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594b26b-367e-42b8-918b-ccf4cd37df07 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:51.941652 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594b26b-367e-42b8-918b-ccf4cd37df07 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:51.941924 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594b26b-367e-42b8-918b-ccf4cd37df07 None admin] PATH_INFO: `/v3/projects/d89ba6f6a62842108d74ca873033ee82` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:51.943095 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d594b26b-367e-42b8-918b-ccf4cd37df07 None admin] RBAC: Authorizing `identity:get_project(project_id=d89ba6f6a62842108d74ca873033ee82)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:51.944557 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d594b26b-367e-42b8-918b-ccf4cd37df07 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:51.946783 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 150/293] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 10 02:59:51 2022] GET /identity/v3/projects/d89ba6f6a62842108d74ca873033ee82 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:51.952675 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0378eb-c9d2-441a-81ca-5c67f6d8ae77 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:52.086673 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0378eb-c9d2-441a-81ca-5c67f6d8ae77 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:52.142181 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377d2d50-36f7-4760-97f9-e15ac1117bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:52.143279 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d2d50-36f7-4760-97f9-e15ac1117bb7 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:52.143570 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d2d50-36f7-4760-97f9-e15ac1117bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:52.143992 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d2d50-36f7-4760-97f9-e15ac1117bb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:52.145347 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377d2d50-36f7-4760-97f9-e15ac1117bb7 None admin] RBAC: Adding query filter params (role.id=bab81fd8d58945b8a1ea63c93b3b4857, scope.project.id=d89ba6f6a62842108d74ca873033ee82, user.id=9917a15f2091446ba31c7f27fc84d2fe) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 02:59:52.145823 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377d2d50-36f7-4760-97f9-e15ac1117bb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:52.148198 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377d2d50-36f7-4760-97f9-e15ac1117bb7 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:52.160920 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 144/294] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 10 02:59:51 2022] GET /identity/v3/role_assignments?user.id=9917a15f2091446ba31c7f27fc84d2fe&scope.project.id=d89ba6f6a62842108d74ca873033ee82&role.id=bab81fd8d58945b8a1ea63c93b3b4857 => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:52.628461 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28b1f2-af83-49c2-9a53-e6eeef096af5 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:52.628969 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28b1f2-af83-49c2-9a53-e6eeef096af5 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:52.629043 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28b1f2-af83-49c2-9a53-e6eeef096af5 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:52.630619 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 151/295] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 02:59:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 02:59:52.637132 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15bf05a-f51a-4120-90cc-416ccca0bc90 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:52.637574 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15bf05a-f51a-4120-90cc-416ccca0bc90 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:52.637671 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15bf05a-f51a-4120-90cc-416ccca0bc90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:52.654821 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-c15bf05a-f51a-4120-90cc-416ccca0bc90 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 02:59:52.656028 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-c15bf05a-f51a-4120-90cc-416ccca0bc90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 02:59:52.689205 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861443c-c74d-4955-929a-532c152df2d8 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:52.689596 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861443c-c74d-4955-929a-532c152df2d8 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:52.689879 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861443c-c74d-4955-929a-532c152df2d8 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:52.691422 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 152/296] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 02:59:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 02:59:52.696851 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d80249-dfb2-4c8d-a7d5-2539a4e447f7 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:52.697378 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d80249-dfb2-4c8d-a7d5-2539a4e447f7 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:52.697860 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d80249-dfb2-4c8d-a7d5-2539a4e447f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:52.714763 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-81d80249-dfb2-4c8d-a7d5-2539a4e447f7 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 02:59:52.716287 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-81d80249-dfb2-4c8d-a7d5-2539a4e447f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 02:59:52.724421 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 145/297] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 02:59:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 02:59:52.747992 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15bf05a-f51a-4120-90cc-416ccca0bc90 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:52.787101 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 153/298] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 02:59:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 02:59:52.799823 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e59a31-cb4e-4270-a050-4715ffe8aa03 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:52.800189 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e59a31-cb4e-4270-a050-4715ffe8aa03 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:52.800479 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e59a31-cb4e-4270-a050-4715ffe8aa03 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:52.802087 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 154/299] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 02:59:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 02:59:52.808138 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7be5e-dfb5-4651-ac0b-cd1f426cb41f None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:52.808417 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7be5e-dfb5-4651-ac0b-cd1f426cb41f None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:52.808698 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7be5e-dfb5-4651-ac0b-cd1f426cb41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:52.825033 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-01b7be5e-dfb5-4651-ac0b-cd1f426cb41f None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 02:59:52.826192 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-01b7be5e-dfb5-4651-ac0b-cd1f426cb41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 02:59:52.863120 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15bf05a-f51a-4120-90cc-416ccca0bc90 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:52.897558 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 155/300] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 02:59:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 02:59:52.898718 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558c8694-7bb0-45b6-8901-9f4526f593c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:52.898916 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b7be5e-dfb5-4651-ac0b-cd1f426cb41f None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:52.899966 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c8694-7bb0-45b6-8901-9f4526f593c1 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:52.900481 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c8694-7bb0-45b6-8901-9f4526f593c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:52.900996 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c8694-7bb0-45b6-8901-9f4526f593c1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:52.911594 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558c8694-7bb0-45b6-8901-9f4526f593c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 02:59:52.920562 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-558c8694-7bb0-45b6-8901-9f4526f593c1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 02:59:52.920562 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 02:59:52.920562 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 02:59:52.920562 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 02:59:52.920562 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 02:59:52.920562 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 02:59:52.920562 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 02:59:52.920562 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 02:59:52.920562 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 02:59:52.920562 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 02:59:52.920562 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 02:59:52.920562 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 02:59:52.920562 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 02:59:52.920562 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 02:59:52.920562 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 02:59:52.920562 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 02:59:52.921468 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 02:59:52.921468 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 02:59:52.921468 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 02:59:52.921468 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 02:59:52.921468 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 02:59:52.921468 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 02:59:52.921468 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 02:59:52.921468 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 02:59:52.921468 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 02:59:52.921468 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 02:59:52.921468 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 02:59:52.921468 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 02:59:52.921468 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 02:59:52.921468 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 02:59:52.921468 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 02:59:52.921468 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 02:59:52.922289 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 02:59:52.922289 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 02:59:52.922289 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 02:59:52.922289 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 02:59:52.922289 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 02:59:52.922289 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 02:59:52.922289 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 02:59:52.922289 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 02:59:52.922289 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 02:59:52.922289 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 02:59:52.922289 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 02:59:52.922289 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 02:59:52.922289 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 146/301] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 10 02:59:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 02:59:52.922940 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558c8694-7bb0-45b6-8901-9f4526f593c1 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:53.007816 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b7be5e-dfb5-4651-ac0b-cd1f426cb41f None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:53.020655 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558c8694-7bb0-45b6-8901-9f4526f593c1 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:53.041761 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c3d12-d86a-4fb0-ac98-2dd3f4efeaa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:53.042557 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c3d12-d86a-4fb0-ac98-2dd3f4efeaa0 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:53.042833 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c3d12-d86a-4fb0-ac98-2dd3f4efeaa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:53.043098 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c3d12-d86a-4fb0-ac98-2dd3f4efeaa0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:53.053753 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97c3d12-d86a-4fb0-ac98-2dd3f4efeaa0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 02:59:53.054705 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5af1fd-959f-4e56-b7d8-4dddf5ab2375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:53.055509 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5af1fd-959f-4e56-b7d8-4dddf5ab2375 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:53.055792 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5af1fd-959f-4e56-b7d8-4dddf5ab2375 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:53.056105 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5af1fd-959f-4e56-b7d8-4dddf5ab2375 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:53.057305 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5af1fd-959f-4e56-b7d8-4dddf5ab2375 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:53.058761 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5af1fd-959f-4e56-b7d8-4dddf5ab2375 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:53.060578 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 147/302] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 02:59:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:53.061291 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5af1fd-959f-4e56-b7d8-4dddf5ab2375 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:53.061561 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-b97c3d12-d86a-4fb0-ac98-2dd3f4efeaa0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 02:59:53.061561 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 02:59:53.061561 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 02:59:53.061561 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 02:59:53.061561 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 02:59:53.061561 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 02:59:53.061561 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 02:59:53.061561 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 02:59:53.061561 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 02:59:53.061561 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 02:59:53.061561 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 02:59:53.061561 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 02:59:53.061561 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 02:59:53.061561 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 02:59:53.061561 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 02:59:53.061561 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 02:59:53.062379 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 02:59:53.062379 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 02:59:53.062379 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 02:59:53.062379 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 02:59:53.062379 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 02:59:53.062379 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 02:59:53.062379 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 02:59:53.062379 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 02:59:53.062379 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 02:59:53.062379 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 02:59:53.062379 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 02:59:53.062379 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 02:59:53.062379 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 02:59:53.062379 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 02:59:53.062379 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 02:59:53.062379 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 02:59:53.063171 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 02:59:53.063171 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 02:59:53.063171 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 02:59:53.063171 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 02:59:53.063171 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 02:59:53.063171 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 02:59:53.063171 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 02:59:53.063171 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 02:59:53.063171 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 02:59:53.063171 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 02:59:53.063171 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 02:59:53.063171 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 02:59:53.063171 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 156/303] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 10 02:59:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 02:59:53.068924 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c3d12-d86a-4fb0-ac98-2dd3f4efeaa0 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:53.165075 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c3d12-d86a-4fb0-ac98-2dd3f4efeaa0 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:53.170055 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5af1fd-959f-4e56-b7d8-4dddf5ab2375 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:53.198597 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b51cb71-119e-4329-9ffa-ccc5e29c8242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:53.199263 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51cb71-119e-4329-9ffa-ccc5e29c8242 None admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:53.199549 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51cb71-119e-4329-9ffa-ccc5e29c8242 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:53.199831 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51cb71-119e-4329-9ffa-ccc5e29c8242 None admin] PATH_INFO: `/v3/groups` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:53.200550 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b51cb71-119e-4329-9ffa-ccc5e29c8242 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:53.201970 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b51cb71-119e-4329-9ffa-ccc5e29c8242 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:53.204487 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b79e3e8-dcfb-4089-9ab0-4d8a71808bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:53.205160 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79e3e8-dcfb-4089-9ab0-4d8a71808bc1 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:53.205446 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79e3e8-dcfb-4089-9ab0-4d8a71808bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:53.205727 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79e3e8-dcfb-4089-9ab0-4d8a71808bc1 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:53.206477 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b79e3e8-dcfb-4089-9ab0-4d8a71808bc1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 02:59:53.206785 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b79e3e8-dcfb-4089-9ab0-4d8a71808bc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:53.208172 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b79e3e8-dcfb-4089-9ab0-4d8a71808bc1 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:53.216645 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 148/304] 10.222.0.65 () {56 vars in 1101 bytes} [Tue May 10 02:59:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:53.217454 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b79e3e8-dcfb-4089-9ab0-4d8a71808bc1 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:53.267531 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 157/305] 10.222.0.65 () {60 vars in 1134 bytes} [Tue May 10 02:59:53 2022] POST /identity/v3/groups => generated 229 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 02:59:53.268669 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b51cb71-119e-4329-9ffa-ccc5e29c8242 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:53.329563 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b79e3e8-dcfb-4089-9ab0-4d8a71808bc1 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:53.371200 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a727a-c3b0-4469-a4b3-6b2b5385a072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:53.372249 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a727a-c3b0-4469-a4b3-6b2b5385a072 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:53.372708 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a727a-c3b0-4469-a4b3-6b2b5385a072 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:53.373148 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a727a-c3b0-4469-a4b3-6b2b5385a072 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:53.374104 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368a727a-c3b0-4469-a4b3-6b2b5385a072 None admin] RBAC: Adding query filter params (name=member) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 02:59:53.374628 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368a727a-c3b0-4469-a4b3-6b2b5385a072 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:53.376248 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368a727a-c3b0-4469-a4b3-6b2b5385a072 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:53.392066 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 149/306] 10.222.0.65 () {56 vars in 1101 bytes} [Tue May 10 02:59:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:53.393308 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a727a-c3b0-4469-a4b3-6b2b5385a072 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:53.401685 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b51cb71-119e-4329-9ffa-ccc5e29c8242 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:53.460547 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ccad2b-7ec2-4f51-88ab-465ad9d2ceb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:53.462164 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ccad2b-7ec2-4f51-88ab-465ad9d2ceb8 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:53.462674 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ccad2b-7ec2-4f51-88ab-465ad9d2ceb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:53.463092 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ccad2b-7ec2-4f51-88ab-465ad9d2ceb8 None admin] PATH_INFO: `/v3/users/afb127fa5a5749b786d881428cbb048b` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:53.478731 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ccad2b-7ec2-4f51-88ab-465ad9d2ceb8 None admin] RBAC: Authorizing `identity:get_user(user_id=afb127fa5a5749b786d881428cbb048b)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:53.480271 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ccad2b-7ec2-4f51-88ab-465ad9d2ceb8 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:53.482188 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 158/307] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 10 02:59:53 2022] GET /identity/v3/users/afb127fa5a5749b786d881428cbb048b => generated 293 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:53.492022 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ccad2b-7ec2-4f51-88ab-465ad9d2ceb8 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:53.533056 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a727a-c3b0-4469-a4b3-6b2b5385a072 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:53.580140 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964560a8-252a-40f2-b99f-2c476b47d00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:53.581707 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964560a8-252a-40f2-b99f-2c476b47d00d None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:53.582199 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964560a8-252a-40f2-b99f-2c476b47d00d None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:53.582678 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964560a8-252a-40f2-b99f-2c476b47d00d None admin] PATH_INFO: `/v3/users/10553f47f2a84eb9abf0dbd36ee7d012` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:53.584425 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964560a8-252a-40f2-b99f-2c476b47d00d None admin] RBAC: Authorizing `identity:get_user(user_id=10553f47f2a84eb9abf0dbd36ee7d012)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:53.587097 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964560a8-252a-40f2-b99f-2c476b47d00d None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:53.590092 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 150/308] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 10 02:59:53 2022] GET /identity/v3/users/10553f47f2a84eb9abf0dbd36ee7d012 => generated 293 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:53.595445 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964560a8-252a-40f2-b99f-2c476b47d00d None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:53.634607 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ccad2b-7ec2-4f51-88ab-465ad9d2ceb8 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:53.670560 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b8f0f-32ee-4440-9371-e139495be123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:53.671529 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b8f0f-32ee-4440-9371-e139495be123 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:53.671960 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b8f0f-32ee-4440-9371-e139495be123 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:53.672408 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b8f0f-32ee-4440-9371-e139495be123 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:53.673403 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477b8f0f-32ee-4440-9371-e139495be123 None admin] RBAC: Adding query filter params (role.id=d1526e6293dc47b1a0e78c462f588dac, user.id=afb127fa5a5749b786d881428cbb048b, scope.system=all) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 02:59:53.673882 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477b8f0f-32ee-4440-9371-e139495be123 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:53.675458 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477b8f0f-32ee-4440-9371-e139495be123 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:53.688136 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 159/309] 10.222.0.65 () {56 vars in 1308 bytes} [Tue May 10 02:59:53 2022] GET /identity/v3/role_assignments?user.id=afb127fa5a5749b786d881428cbb048b&scope.system=all&role.id=d1526e6293dc47b1a0e78c462f588dac => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 02:59:53.747935 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964560a8-252a-40f2-b99f-2c476b47d00d None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:53.800515 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd85c47f-d134-4610-8768-4c29b8e0501b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:53.801335 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85c47f-d134-4610-8768-4c29b8e0501b None admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:53.801619 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85c47f-d134-4610-8768-4c29b8e0501b None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:53.801898 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85c47f-d134-4610-8768-4c29b8e0501b None admin] PATH_INFO: `/v3/system/users/10553f47f2a84eb9abf0dbd36ee7d012/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:53.803563 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd85c47f-d134-4610-8768-4c29b8e0501b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=10553f47f2a84eb9abf0dbd36ee7d012, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:53.805557 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd85c47f-d134-4610-8768-4c29b8e0501b None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:53.904178 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 151/310] 10.222.0.65 () {58 vars in 1334 bytes} [Tue May 10 02:59:53 2022] PUT /identity/v3/system/users/10553f47f2a84eb9abf0dbd36ee7d012/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 02:59:54.051730 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd88d65-97a9-4d5e-a133-56e0fa3a3fa9 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:54.052084 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd88d65-97a9-4d5e-a133-56e0fa3a3fa9 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:54.052255 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd88d65-97a9-4d5e-a133-56e0fa3a3fa9 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:54.053905 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 160/311] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 02:59:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 02:59:54.059932 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024cc6d2-134b-476e-bdfd-606fc4da23a1 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:54.060278 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024cc6d2-134b-476e-bdfd-606fc4da23a1 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:54.060537 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024cc6d2-134b-476e-bdfd-606fc4da23a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:54.084549 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-024cc6d2-134b-476e-bdfd-606fc4da23a1 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 02:59:54.086734 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-024cc6d2-134b-476e-bdfd-606fc4da23a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 02:59:54.176422 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 152/312] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 02:59:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 02:59:54.203937 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd88d65-97a9-4d5e-a133-56e0fa3a3fa9 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:54.313058 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd88d65-97a9-4d5e-a133-56e0fa3a3fa9 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:54.347512 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f7b3d-2cc9-4e99-8e63-42aa69bfd809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:54.348677 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f7b3d-2cc9-4e99-8e63-42aa69bfd809 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:54.349183 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f7b3d-2cc9-4e99-8e63-42aa69bfd809 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:54.349653 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f7b3d-2cc9-4e99-8e63-42aa69bfd809 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:54.360280 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8f7b3d-2cc9-4e99-8e63-42aa69bfd809 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 02:59:54.368782 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-9b8f7b3d-2cc9-4e99-8e63-42aa69bfd809 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 02:59:54.368782 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 02:59:54.368782 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 02:59:54.368782 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 02:59:54.368782 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 02:59:54.368782 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 02:59:54.368782 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 02:59:54.368782 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 02:59:54.368782 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 02:59:54.368782 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 02:59:54.368782 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 02:59:54.368782 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 02:59:54.368782 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 02:59:54.368782 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 02:59:54.368782 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 02:59:54.368782 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 02:59:54.369670 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 02:59:54.369670 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 02:59:54.369670 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 02:59:54.369670 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 02:59:54.369670 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 02:59:54.369670 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 02:59:54.369670 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 02:59:54.369670 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 02:59:54.369670 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 02:59:54.369670 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 02:59:54.369670 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 02:59:54.369670 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 02:59:54.369670 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 02:59:54.369670 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 02:59:54.369670 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 02:59:54.369670 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 02:59:54.370443 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 02:59:54.370443 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 02:59:54.370443 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 02:59:54.370443 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 02:59:54.370443 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 02:59:54.370443 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 02:59:54.370443 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 02:59:54.370443 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 02:59:54.370443 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 02:59:54.370443 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 02:59:54.370443 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 02:59:54.370443 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 02:59:54.372824 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 161/313] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 10 02:59:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 02:59:54.378652 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024cc6d2-134b-476e-bdfd-606fc4da23a1 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:54.485290 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024cc6d2-134b-476e-bdfd-606fc4da23a1 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:54.520179 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee868e8-0d47-4682-922c-1cf9c82dc293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:54.520867 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee868e8-0d47-4682-922c-1cf9c82dc293 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:54.521154 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee868e8-0d47-4682-922c-1cf9c82dc293 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:54.521429 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee868e8-0d47-4682-922c-1cf9c82dc293 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:54.522206 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee868e8-0d47-4682-922c-1cf9c82dc293 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 02:59:54.522513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee868e8-0d47-4682-922c-1cf9c82dc293 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:54.524049 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee868e8-0d47-4682-922c-1cf9c82dc293 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:54.534372 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 153/314] 10.222.0.65 () {56 vars in 1101 bytes} [Tue May 10 02:59:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:54.539835 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f7b3d-2cc9-4e99-8e63-42aa69bfd809 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:54.648584 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f7b3d-2cc9-4e99-8e63-42aa69bfd809 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:54.684031 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1327cde6-fc02-4391-a37e-c25bc5b4a410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:54.685483 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327cde6-fc02-4391-a37e-c25bc5b4a410 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:54.685964 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327cde6-fc02-4391-a37e-c25bc5b4a410 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:54.686478 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327cde6-fc02-4391-a37e-c25bc5b4a410 None admin] PATH_INFO: `/v3/users/e3e1307cfd044ace940f37192011c130` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:54.687857 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1327cde6-fc02-4391-a37e-c25bc5b4a410 None admin] RBAC: Authorizing `identity:get_user(user_id=e3e1307cfd044ace940f37192011c130)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:54.689574 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1327cde6-fc02-4391-a37e-c25bc5b4a410 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:54.691786 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 162/315] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 10 02:59:54 2022] GET /identity/v3/users/e3e1307cfd044ace940f37192011c130 => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:54.701083 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee868e8-0d47-4682-922c-1cf9c82dc293 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:54.800983 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee868e8-0d47-4682-922c-1cf9c82dc293 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:54.834186 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a5acf-4243-45f7-a1b4-ebf48fbaa8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:54.834835 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a5acf-4243-45f7-a1b4-ebf48fbaa8c0 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:54.835122 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a5acf-4243-45f7-a1b4-ebf48fbaa8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:54.835429 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a5acf-4243-45f7-a1b4-ebf48fbaa8c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:54.902437 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92a5acf-4243-45f7-a1b4-ebf48fbaa8c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:54.903838 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92a5acf-4243-45f7-a1b4-ebf48fbaa8c0 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:55.004489 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 154/316] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 10 02:59:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 02:59:55.010081 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1327cde6-fc02-4391-a37e-c25bc5b4a410 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:55.166435 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1327cde6-fc02-4391-a37e-c25bc5b4a410 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:55.199194 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6636bb3e-333c-4e6f-b1fb-fa8a9f8439ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:55.200093 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636bb3e-333c-4e6f-b1fb-fa8a9f8439ae None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:55.200368 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636bb3e-333c-4e6f-b1fb-fa8a9f8439ae None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:55.200641 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636bb3e-333c-4e6f-b1fb-fa8a9f8439ae None admin] PATH_INFO: `/v3/projects/d89ba6f6a62842108d74ca873033ee82` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:55.201839 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6636bb3e-333c-4e6f-b1fb-fa8a9f8439ae None admin] RBAC: Authorizing `identity:get_project(project_id=d89ba6f6a62842108d74ca873033ee82)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:55.203259 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6636bb3e-333c-4e6f-b1fb-fa8a9f8439ae None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:55.205303 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 163/317] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 10 02:59:55 2022] GET /identity/v3/projects/d89ba6f6a62842108d74ca873033ee82 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:55.211546 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a5acf-4243-45f7-a1b4-ebf48fbaa8c0 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:55.309240 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a5acf-4243-45f7-a1b4-ebf48fbaa8c0 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:55.343088 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3e4ce3-da3e-42ce-af6e-7646cbc3f13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:55.344098 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e4ce3-da3e-42ce-af6e-7646cbc3f13e None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:55.344579 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e4ce3-da3e-42ce-af6e-7646cbc3f13e None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:55.345045 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e4ce3-da3e-42ce-af6e-7646cbc3f13e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:55.346126 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3e4ce3-da3e-42ce-af6e-7646cbc3f13e None admin] RBAC: Adding query filter params (role.id=d1526e6293dc47b1a0e78c462f588dac, scope.project.id=d89ba6f6a62842108d74ca873033ee82, user.id=e3e1307cfd044ace940f37192011c130) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 02:59:55.346631 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3e4ce3-da3e-42ce-af6e-7646cbc3f13e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:55.348390 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3e4ce3-da3e-42ce-af6e-7646cbc3f13e None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:55.357388 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 155/318] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 10 02:59:55 2022] GET /identity/v3/role_assignments?user.id=e3e1307cfd044ace940f37192011c130&scope.project.id=d89ba6f6a62842108d74ca873033ee82&role.id=d1526e6293dc47b1a0e78c462f588dac => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:55.650130 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806ebd0-7445-40d5-91c4-5aec778c9786 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:55.650629 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806ebd0-7445-40d5-91c4-5aec778c9786 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:55.650701 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806ebd0-7445-40d5-91c4-5aec778c9786 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:55.652304 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 164/319] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 02:59:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 02:59:55.657284 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c4d98-3784-425a-845e-cb087b47bd82 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:55.657834 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c4d98-3784-425a-845e-cb087b47bd82 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:55.658113 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c4d98-3784-425a-845e-cb087b47bd82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:55.674481 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-427c4d98-3784-425a-845e-cb087b47bd82 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 02:59:55.675682 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-427c4d98-3784-425a-845e-cb087b47bd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 02:59:55.739522 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 156/320] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 02:59:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 02:59:55.761728 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f806ebd0-7445-40d5-91c4-5aec778c9786 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:55.868378 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f806ebd0-7445-40d5-91c4-5aec778c9786 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:55.901440 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36deb43-4935-41bb-9401-c6bf3872ecc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:55.902237 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36deb43-4935-41bb-9401-c6bf3872ecc8 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:55.902523 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36deb43-4935-41bb-9401-c6bf3872ecc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:55.902798 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36deb43-4935-41bb-9401-c6bf3872ecc8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:55.903964 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36deb43-4935-41bb-9401-c6bf3872ecc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:55.905419 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36deb43-4935-41bb-9401-c6bf3872ecc8 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:55.907192 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 165/321] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 02:59:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:55.912930 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427c4d98-3784-425a-845e-cb087b47bd82 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:56.008682 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427c4d98-3784-425a-845e-cb087b47bd82 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:56.018179 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5fa848-b5fa-449a-8755-10debda69cc1 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:56.018466 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5fa848-b5fa-449a-8755-10debda69cc1 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:56.018739 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5fa848-b5fa-449a-8755-10debda69cc1 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:56.020240 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 166/322] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 02:59:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 02:59:56.024943 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131d7da-0f2a-417a-9d44-d7a3abab0bf6 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:56.025300 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131d7da-0f2a-417a-9d44-d7a3abab0bf6 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:56.025655 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131d7da-0f2a-417a-9d44-d7a3abab0bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:56.041708 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-8131d7da-0f2a-417a-9d44-d7a3abab0bf6 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 02:59:56.042966 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-8131d7da-0f2a-417a-9d44-d7a3abab0bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 02:59:56.043096 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c866dc-16da-4741-aaa6-7360f9b35a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:56.043706 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c866dc-16da-4741-aaa6-7360f9b35a74 None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:56.043988 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c866dc-16da-4741-aaa6-7360f9b35a74 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:56.044282 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c866dc-16da-4741-aaa6-7360f9b35a74 None admin] PATH_INFO: `/v3/groups` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:56.044965 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c866dc-16da-4741-aaa6-7360f9b35a74 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:56.046403 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c866dc-16da-4741-aaa6-7360f9b35a74 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:56.111083 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 167/323] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 02:59:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 02:59:56.134153 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8131d7da-0f2a-417a-9d44-d7a3abab0bf6 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:56.147910 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 157/324] 10.222.0.65 () {60 vars in 1134 bytes} [Tue May 10 02:59:55 2022] POST /identity/v3/groups => generated 226 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 02:59:56.238987 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8131d7da-0f2a-417a-9d44-d7a3abab0bf6 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:56.260485 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579662a-0f84-4eaf-a00a-e94bb8fc9ef3 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:56.260778 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579662a-0f84-4eaf-a00a-e94bb8fc9ef3 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:56.260980 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579662a-0f84-4eaf-a00a-e94bb8fc9ef3 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:56.262611 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 158/325] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 02:59:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 02:59:56.267887 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538dec29-5fd9-4b21-ae50-797aefb4300b None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:56.268208 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538dec29-5fd9-4b21-ae50-797aefb4300b None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:56.268491 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538dec29-5fd9-4b21-ae50-797aefb4300b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:56.277241 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4833794b-23c4-4dc1-bf79-93de291ff19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:56.278306 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833794b-23c4-4dc1-bf79-93de291ff19b None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:56.278735 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833794b-23c4-4dc1-bf79-93de291ff19b None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:56.279185 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833794b-23c4-4dc1-bf79-93de291ff19b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:56.286092 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-538dec29-5fd9-4b21-ae50-797aefb4300b None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 02:59:56.287325 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-538dec29-5fd9-4b21-ae50-797aefb4300b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 02:59:56.292393 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4833794b-23c4-4dc1-bf79-93de291ff19b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 02:59:56.300594 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-4833794b-23c4-4dc1-bf79-93de291ff19b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 02:59:56.300594 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 02:59:56.300594 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 02:59:56.300594 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 02:59:56.300594 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 02:59:56.300594 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 02:59:56.300594 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 02:59:56.300594 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 02:59:56.300594 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 02:59:56.300594 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 02:59:56.300594 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 02:59:56.300594 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 02:59:56.300594 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 02:59:56.300594 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 02:59:56.300594 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 02:59:56.300594 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 02:59:56.301723 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 02:59:56.301723 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 02:59:56.301723 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 02:59:56.301723 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 02:59:56.301723 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 02:59:56.301723 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 02:59:56.301723 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 02:59:56.301723 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 02:59:56.301723 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 02:59:56.301723 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 02:59:56.301723 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 02:59:56.301723 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 02:59:56.301723 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 02:59:56.301723 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 02:59:56.301723 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 02:59:56.301723 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 02:59:56.302745 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 02:59:56.302745 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 02:59:56.302745 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 02:59:56.302745 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 02:59:56.302745 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 02:59:56.302745 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 02:59:56.302745 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 02:59:56.302745 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 02:59:56.302745 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 02:59:56.302745 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 02:59:56.302745 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 02:59:56.302745 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 02:59:56.310272 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 168/326] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 10 02:59:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 02:59:56.311539 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4833794b-23c4-4dc1-bf79-93de291ff19b None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:56.361532 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 159/327] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 02:59:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 02:59:56.384936 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538dec29-5fd9-4b21-ae50-797aefb4300b None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:56.420434 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4833794b-23c4-4dc1-bf79-93de291ff19b None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:56.474654 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb9a9fc-00c9-45ba-ad81-0d257fa9d004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:56.475341 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9a9fc-00c9-45ba-ad81-0d257fa9d004 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:56.475625 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9a9fc-00c9-45ba-ad81-0d257fa9d004 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:56.475902 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9a9fc-00c9-45ba-ad81-0d257fa9d004 None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:56.477450 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb9a9fc-00c9-45ba-ad81-0d257fa9d004 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 02:59:56.477555 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb9a9fc-00c9-45ba-ad81-0d257fa9d004 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:56.478930 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb9a9fc-00c9-45ba-ad81-0d257fa9d004 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:56.489587 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 169/328] 10.222.0.65 () {56 vars in 1101 bytes} [Tue May 10 02:59:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:56.498169 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb9a9fc-00c9-45ba-ad81-0d257fa9d004 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:56.510281 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538dec29-5fd9-4b21-ae50-797aefb4300b None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:56.559804 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6d69fe-3d2d-4b02-b4d0-efd81108b924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:56.560917 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d69fe-3d2d-4b02-b4d0-efd81108b924 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:56.561380 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d69fe-3d2d-4b02-b4d0-efd81108b924 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:56.561810 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d69fe-3d2d-4b02-b4d0-efd81108b924 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:56.573577 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6d69fe-3d2d-4b02-b4d0-efd81108b924 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 02:59:56.581460 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-5c6d69fe-3d2d-4b02-b4d0-efd81108b924 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 02:59:56.581460 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 02:59:56.581460 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 02:59:56.581460 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 02:59:56.581460 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 02:59:56.581460 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 02:59:56.581460 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 02:59:56.581460 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 02:59:56.581460 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 02:59:56.581460 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 02:59:56.581460 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 02:59:56.581460 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 02:59:56.581460 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 02:59:56.581460 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 02:59:56.581460 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 02:59:56.581460 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 02:59:56.582354 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 02:59:56.582354 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 02:59:56.582354 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 02:59:56.582354 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 02:59:56.582354 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 02:59:56.582354 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 02:59:56.582354 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 02:59:56.582354 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 02:59:56.582354 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 02:59:56.582354 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 02:59:56.582354 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 02:59:56.582354 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 02:59:56.582354 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 02:59:56.582354 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 02:59:56.582354 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 02:59:56.582354 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 02:59:56.583120 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 02:59:56.583120 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 02:59:56.583120 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 02:59:56.583120 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 02:59:56.583120 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 02:59:56.583120 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 02:59:56.583120 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 02:59:56.583120 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 02:59:56.583120 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 02:59:56.583120 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 02:59:56.583120 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 02:59:56.583120 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 02:59:56.583120 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 160/329] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 10 02:59:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 02:59:56.588940 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6d69fe-3d2d-4b02-b4d0-efd81108b924 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:56.624057 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb9a9fc-00c9-45ba-ad81-0d257fa9d004 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:56.671585 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ae5ea0-46cf-435e-898a-2fac15e4972b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:56.674171 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae5ea0-46cf-435e-898a-2fac15e4972b None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:56.674532 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae5ea0-46cf-435e-898a-2fac15e4972b None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:56.674815 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae5ea0-46cf-435e-898a-2fac15e4972b None admin] PATH_INFO: `/v3/users/afb127fa5a5749b786d881428cbb048b` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:56.676684 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ae5ea0-46cf-435e-898a-2fac15e4972b None admin] RBAC: Authorizing `identity:get_user(user_id=afb127fa5a5749b786d881428cbb048b)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:56.678470 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ae5ea0-46cf-435e-898a-2fac15e4972b None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:56.681675 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 170/330] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 10 02:59:56 2022] GET /identity/v3/users/afb127fa5a5749b786d881428cbb048b => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:56.689986 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ae5ea0-46cf-435e-898a-2fac15e4972b None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:56.715974 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6d69fe-3d2d-4b02-b4d0-efd81108b924 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:56.751490 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8010815-31c0-4cb8-84c2-832e83de8ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:56.752612 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8010815-31c0-4cb8-84c2-832e83de8ba6 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:56.753181 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8010815-31c0-4cb8-84c2-832e83de8ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:56.753681 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8010815-31c0-4cb8-84c2-832e83de8ba6 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:56.754708 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8010815-31c0-4cb8-84c2-832e83de8ba6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 02:59:56.755224 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8010815-31c0-4cb8-84c2-832e83de8ba6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:56.756862 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8010815-31c0-4cb8-84c2-832e83de8ba6 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:56.766104 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 161/331] 10.222.0.65 () {56 vars in 1101 bytes} [Tue May 10 02:59:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:56.772040 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8010815-31c0-4cb8-84c2-832e83de8ba6 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:56.798989 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ae5ea0-46cf-435e-898a-2fac15e4972b None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:56.834282 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2180f2ee-f0e8-471b-ad35-84f1278b2651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:56.835074 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2180f2ee-f0e8-471b-ad35-84f1278b2651 None admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:56.835887 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2180f2ee-f0e8-471b-ad35-84f1278b2651 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:56.836198 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2180f2ee-f0e8-471b-ad35-84f1278b2651 None admin] PATH_INFO: `/v3/system/users/afb127fa5a5749b786d881428cbb048b/roles/d1526e6293dc47b1a0e78c462f588dac` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:56.837796 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2180f2ee-f0e8-471b-ad35-84f1278b2651 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=afb127fa5a5749b786d881428cbb048b, role_id=d1526e6293dc47b1a0e78c462f588dac)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:56.839075 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2180f2ee-f0e8-471b-ad35-84f1278b2651 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:56.879918 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8010815-31c0-4cb8-84c2-832e83de8ba6 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:56.916359 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ed774-2ece-484d-b91b-d95d154a963e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:56.918016 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ed774-2ece-484d-b91b-d95d154a963e None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:56.918311 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ed774-2ece-484d-b91b-d95d154a963e None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:56.918594 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ed774-2ece-484d-b91b-d95d154a963e None admin] PATH_INFO: `/v3/users/10553f47f2a84eb9abf0dbd36ee7d012` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:56.919892 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1ed774-2ece-484d-b91b-d95d154a963e None admin] RBAC: Authorizing `identity:get_user(user_id=10553f47f2a84eb9abf0dbd36ee7d012)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:56.921412 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1ed774-2ece-484d-b91b-d95d154a963e None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:56.923365 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 162/332] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 10 02:59:56 2022] GET /identity/v3/users/10553f47f2a84eb9abf0dbd36ee7d012 => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:56.928708 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ed774-2ece-484d-b91b-d95d154a963e None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:57.050103 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ed774-2ece-484d-b91b-d95d154a963e None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:57.063226 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 171/333] 10.222.0.65 () {58 vars in 1334 bytes} [Tue May 10 02:59:56 2022] PUT /identity/v3/system/users/afb127fa5a5749b786d881428cbb048b/roles/d1526e6293dc47b1a0e78c462f588dac => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 02:59:57.097840 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c8673-48ea-4658-bd73-d3a083de0ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:57.098864 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c8673-48ea-4658-bd73-d3a083de0ff6 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:57.099367 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c8673-48ea-4658-bd73-d3a083de0ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:57.099848 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c8673-48ea-4658-bd73-d3a083de0ff6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:57.101424 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310c8673-48ea-4658-bd73-d3a083de0ff6 None admin] RBAC: Adding query filter params (role.id=bab81fd8d58945b8a1ea63c93b3b4857, user.id=10553f47f2a84eb9abf0dbd36ee7d012, scope.system=all) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 02:59:57.101971 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310c8673-48ea-4658-bd73-d3a083de0ff6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:57.103669 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310c8673-48ea-4658-bd73-d3a083de0ff6 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:57.118836 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 163/334] 10.222.0.65 () {56 vars in 1308 bytes} [Tue May 10 02:59:56 2022] GET /identity/v3/role_assignments?user.id=10553f47f2a84eb9abf0dbd36ee7d012&scope.system=all&role.id=bab81fd8d58945b8a1ea63c93b3b4857 => generated 510 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:58.672069 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d39ae9-db6a-4e1d-bcd3-242c5eefa412 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:58.672640 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d39ae9-db6a-4e1d-bcd3-242c5eefa412 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:58.672920 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d39ae9-db6a-4e1d-bcd3-242c5eefa412 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:58.675405 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 172/335] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 02:59:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 02:59:58.685057 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61daeb5f-dfaa-4d16-967e-ebb8bf31b703 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:58.685988 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61daeb5f-dfaa-4d16-967e-ebb8bf31b703 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:58.686480 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61daeb5f-dfaa-4d16-967e-ebb8bf31b703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:58.705773 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-61daeb5f-dfaa-4d16-967e-ebb8bf31b703 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 02:59:58.707324 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-61daeb5f-dfaa-4d16-967e-ebb8bf31b703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 02:59:58.790028 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 164/336] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 02:59:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 02:59:58.824681 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d39ae9-db6a-4e1d-bcd3-242c5eefa412 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:58.954763 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d39ae9-db6a-4e1d-bcd3-242c5eefa412 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:58.989566 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef9277-a2a1-4dcd-bb10-3c4867146b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:58.990282 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef9277-a2a1-4dcd-bb10-3c4867146b73 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:58.990559 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef9277-a2a1-4dcd-bb10-3c4867146b73 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:58.990825 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef9277-a2a1-4dcd-bb10-3c4867146b73 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:59.001928 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ef9277-a2a1-4dcd-bb10-3c4867146b73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 02:59:59.012506 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-b1ef9277-a2a1-4dcd-bb10-3c4867146b73 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 02:59:59.012506 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 02:59:59.012506 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 02:59:59.012506 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 02:59:59.012506 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 02:59:59.012506 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 02:59:59.012506 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 02:59:59.012506 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 02:59:59.012506 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 02:59:59.012506 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 02:59:59.012506 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 02:59:59.012506 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 02:59:59.012506 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 02:59:59.012506 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 02:59:59.012506 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 02:59:59.012506 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 02:59:59.013499 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 02:59:59.013499 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 02:59:59.013499 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 02:59:59.013499 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 02:59:59.013499 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 02:59:59.013499 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 02:59:59.013499 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 02:59:59.013499 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 02:59:59.013499 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 02:59:59.013499 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 02:59:59.013499 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 02:59:59.013499 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 02:59:59.013499 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 02:59:59.013499 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 02:59:59.013499 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 02:59:59.013499 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 02:59:59.014323 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 02:59:59.014323 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 02:59:59.014323 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 02:59:59.014323 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 02:59:59.014323 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 02:59:59.014323 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 02:59:59.014323 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 02:59:59.014323 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 02:59:59.014323 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 02:59:59.014323 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 02:59:59.014323 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 02:59:59.014323 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 02:59:59.014323 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 173/337] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 10 02:59:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 02:59:59.021491 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61daeb5f-dfaa-4d16-967e-ebb8bf31b703 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:59.158091 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61daeb5f-dfaa-4d16-967e-ebb8bf31b703 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:59.200526 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61033719-270d-4561-9633-04b2e495d3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:59.201516 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61033719-270d-4561-9633-04b2e495d3ff None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:59.201986 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61033719-270d-4561-9633-04b2e495d3ff None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:59.202437 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61033719-270d-4561-9633-04b2e495d3ff None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:59.203367 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61033719-270d-4561-9633-04b2e495d3ff None admin] RBAC: Adding query filter params (name=member) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 02:59:59.203862 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61033719-270d-4561-9633-04b2e495d3ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:59.205533 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61033719-270d-4561-9633-04b2e495d3ff None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:59.221035 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 165/338] 10.222.0.65 () {56 vars in 1101 bytes} [Tue May 10 02:59:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:59.226948 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef9277-a2a1-4dcd-bb10-3c4867146b73 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:59.362864 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef9277-a2a1-4dcd-bb10-3c4867146b73 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:59.403345 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869773e8-0075-4aea-baed-ff680224db71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:59.404043 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869773e8-0075-4aea-baed-ff680224db71 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:59.404330 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869773e8-0075-4aea-baed-ff680224db71 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:59.404604 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869773e8-0075-4aea-baed-ff680224db71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:59.478825 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869773e8-0075-4aea-baed-ff680224db71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:59.480363 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869773e8-0075-4aea-baed-ff680224db71 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:59.587126 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 174/339] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 10 02:59:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 02:59:59.592451 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61033719-270d-4561-9633-04b2e495d3ff None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:59.700437 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61033719-270d-4561-9633-04b2e495d3ff None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:59.735337 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cdeb86-67bf-40fa-8a56-df75f92448b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:59.736228 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cdeb86-67bf-40fa-8a56-df75f92448b5 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:59.736509 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cdeb86-67bf-40fa-8a56-df75f92448b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:59.736780 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cdeb86-67bf-40fa-8a56-df75f92448b5 None admin] PATH_INFO: `/v3/projects/2db4f8a4c66d4ca684aabd3e75eafbc2` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:59.737995 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cdeb86-67bf-40fa-8a56-df75f92448b5 None admin] RBAC: Authorizing `identity:get_project(project_id=2db4f8a4c66d4ca684aabd3e75eafbc2)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:59.739446 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cdeb86-67bf-40fa-8a56-df75f92448b5 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:59.741545 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 166/340] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 10 02:59:59 2022] GET /identity/v3/projects/2db4f8a4c66d4ca684aabd3e75eafbc2 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 02:59:59.744238 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ec6ed7-bc46-46aa-a930-4202d395bbca None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:59.745107 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ec6ed7-bc46-46aa-a930-4202d395bbca None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:59.745580 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ec6ed7-bc46-46aa-a930-4202d395bbca None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:59.746829 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cdeb86-67bf-40fa-8a56-df75f92448b5 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:59.747669 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 175/341] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 02:59:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 02:59:59.761666 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e8268-430d-4042-bd4b-f49de9a60d38 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:59.762294 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e8268-430d-4042-bd4b-f49de9a60d38 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:59.762779 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e8268-430d-4042-bd4b-f49de9a60d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:59.801092 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-cd4e8268-430d-4042-bd4b-f49de9a60d38 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 02:59:59.802665 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-cd4e8268-430d-4042-bd4b-f49de9a60d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 02:59:59.846707 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cdeb86-67bf-40fa-8a56-df75f92448b5 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 02:59:59.889076 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd95ca-93b0-4b19-8a3d-e67391c23f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 02:59:59.890333 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd95ca-93b0-4b19-8a3d-e67391c23f80 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:59.891574 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd95ca-93b0-4b19-8a3d-e67391c23f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:59.892104 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd95ca-93b0-4b19-8a3d-e67391c23f80 None admin] PATH_INFO: `/v3/groups/21312eb024514c1a84d1a2a797d37185` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:59.904885 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 176/342] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 02:59:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 02:59:59.905830 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd95ca-93b0-4b19-8a3d-e67391c23f80 None admin] RBAC: Authorizing `identity:get_group(group_id=21312eb024514c1a84d1a2a797d37185)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 02:59:59.907770 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd95ca-93b0-4b19-8a3d-e67391c23f80 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 02:59:59.914481 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 167/343] 10.222.0.65 () {56 vars in 1180 bytes} [Tue May 10 02:59:59 2022] GET /identity/v3/groups/21312eb024514c1a84d1a2a797d37185 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 02:59:59.917106 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f538007-77b1-48ae-9457-82c580961f8a None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:59.917640 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f538007-77b1-48ae-9457-82c580961f8a None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:59.918116 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f538007-77b1-48ae-9457-82c580961f8a None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:59.919900 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 177/344] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 02:59:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 02:59:59.921344 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd95ca-93b0-4b19-8a3d-e67391c23f80 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 02:59:59.929581 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f35207-0c00-4019-b37e-d34652293e5f None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 02:59:59.930134 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f35207-0c00-4019-b37e-d34652293e5f None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 02:59:59.930606 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f35207-0c00-4019-b37e-d34652293e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 02:59:59.966244 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-a6f35207-0c00-4019-b37e-d34652293e5f None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 02:59:59.967935 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-a6f35207-0c00-4019-b37e-d34652293e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:00.105938 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd95ca-93b0-4b19-8a3d-e67391c23f80 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:00.107684 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 178/345] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 02:59:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 03:00:00.110227 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f35207-0c00-4019-b37e-d34652293e5f None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:00.181556 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf0445-22a1-4292-8206-987fc0725a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:00.182623 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf0445-22a1-4292-8206-987fc0725a5f None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:00.183128 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf0445-22a1-4292-8206-987fc0725a5f None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:00.183600 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf0445-22a1-4292-8206-987fc0725a5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:00.184752 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbf0445-22a1-4292-8206-987fc0725a5f None admin] RBAC: Adding query filter params (group.id=21312eb024514c1a84d1a2a797d37185, role.id=bab81fd8d58945b8a1ea63c93b3b4857, scope.project.id=2db4f8a4c66d4ca684aabd3e75eafbc2) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:00.185280 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbf0445-22a1-4292-8206-987fc0725a5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:00.186947 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbf0445-22a1-4292-8206-987fc0725a5f None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:00.201671 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 168/346] 10.222.0.65 () {56 vars in 1376 bytes} [Tue May 10 02:59:59 2022] GET /identity/v3/role_assignments?group.id=21312eb024514c1a84d1a2a797d37185&scope.project.id=2db4f8a4c66d4ca684aabd3e75eafbc2&role.id=bab81fd8d58945b8a1ea63c93b3b4857 => generated 260 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:00.202866 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf0445-22a1-4292-8206-987fc0725a5f None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:00.308821 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f35207-0c00-4019-b37e-d34652293e5f None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:00.377358 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf0445-22a1-4292-8206-987fc0725a5f None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:00.394151 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4fcdfa-78bd-49ea-98f8-beee9c7a0e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:00.394968 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4fcdfa-78bd-49ea-98f8-beee9c7a0e40 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:00.395255 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4fcdfa-78bd-49ea-98f8-beee9c7a0e40 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:00.395533 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4fcdfa-78bd-49ea-98f8-beee9c7a0e40 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:00.422545 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde128c-f9de-4931-a177-82a959d49307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:00.423796 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde128c-f9de-4931-a177-82a959d49307 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:00.424606 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde128c-f9de-4931-a177-82a959d49307 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:00.425033 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4fcdfa-78bd-49ea-98f8-beee9c7a0e40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:00.425327 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde128c-f9de-4931-a177-82a959d49307 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:00.433654 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-9b4fcdfa-78bd-49ea-98f8-beee9c7a0e40 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 03:00:00.433654 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:00.433654 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:00.433654 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:00.433654 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:00.433654 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:00.433654 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:00.433654 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:00.433654 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:00.433654 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:00.433654 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:00.433654 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:00.433654 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:00.433654 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:00.433654 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:00.433654 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:00.434677 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:00.434677 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:00.434677 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:00.434677 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:00.434677 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:00.434677 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:00.434677 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:00.434677 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:00.434677 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:00.434677 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:00.434677 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:00.434677 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:00.434677 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:00.434677 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:00.434677 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:00.434677 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:00.435458 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:00.435458 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:00.435458 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:00.435458 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:00.435458 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:00.435458 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:00.435458 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:00.435458 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:00.435458 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:00.435458 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:00.435458 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 03:00:00.435458 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:00.441875 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 179/347] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 10 03:00:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:00.442842 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4fcdfa-78bd-49ea-98f8-beee9c7a0e40 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:00.474409 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecde128c-f9de-4931-a177-82a959d49307 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:00.485400 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-ecde128c-f9de-4931-a177-82a959d49307 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 03:00:00.485400 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:00.485400 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:00.485400 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:00.485400 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:00.485400 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:00.485400 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:00.485400 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:00.485400 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:00.485400 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:00.485400 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:00.485400 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:00.485400 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:00.485400 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:00.485400 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:00.485400 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:00.486410 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:00.486410 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:00.486410 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:00.486410 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:00.486410 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:00.486410 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:00.486410 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:00.486410 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:00.486410 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:00.486410 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:00.486410 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:00.486410 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:00.486410 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:00.486410 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:00.486410 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:00.486410 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:00.487229 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:00.487229 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:00.487229 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:00.487229 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:00.487229 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:00.487229 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:00.487229 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:00.487229 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:00.487229 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:00.487229 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:00.487229 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 03:00:00.487229 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:00.487229 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 169/348] 10.222.0.65 () {56 vars in 1114 bytes} [Tue May 10 03:00:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:00.493639 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde128c-f9de-4931-a177-82a959d49307 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:00.609595 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4fcdfa-78bd-49ea-98f8-beee9c7a0e40 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:00.644934 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f2d73-fa6b-4748-8e14-c04d5ee1be33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:00.645615 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f2d73-fa6b-4748-8e14-c04d5ee1be33 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:00.645940 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f2d73-fa6b-4748-8e14-c04d5ee1be33 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:00.646178 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f2d73-fa6b-4748-8e14-c04d5ee1be33 None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:00.646933 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9f2d73-fa6b-4748-8e14-c04d5ee1be33 None admin] RBAC: Adding query filter params (name=member) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:00.647243 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9f2d73-fa6b-4748-8e14-c04d5ee1be33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:00.649128 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9f2d73-fa6b-4748-8e14-c04d5ee1be33 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:00.658645 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 180/349] 10.222.0.65 () {56 vars in 1101 bytes} [Tue May 10 03:00:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:00.669283 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f2d73-fa6b-4748-8e14-c04d5ee1be33 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:00.727032 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde128c-f9de-4931-a177-82a959d49307 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:00.795791 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d9f631-d5d1-4e44-83a5-cc49eaa755f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:00.796519 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9f631-d5d1-4e44-83a5-cc49eaa755f8 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:00.796807 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9f631-d5d1-4e44-83a5-cc49eaa755f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:00.797088 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9f631-d5d1-4e44-83a5-cc49eaa755f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:00.797852 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d9f631-d5d1-4e44-83a5-cc49eaa755f8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:00.798167 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d9f631-d5d1-4e44-83a5-cc49eaa755f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:00.799559 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d9f631-d5d1-4e44-83a5-cc49eaa755f8 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:00.818074 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 170/350] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 10 03:00:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:00.819957 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c907b93-fdfe-4f36-a5b5-ae90d5cfac33 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:00.820498 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c907b93-fdfe-4f36-a5b5-ae90d5cfac33 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:00.820985 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c907b93-fdfe-4f36-a5b5-ae90d5cfac33 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:00.822427 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 171/351] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:00:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:00.824106 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ab6e5-5c26-45a1-936d-955195c149ac None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:00.824889 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ab6e5-5c26-45a1-936d-955195c149ac None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:00.825368 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ab6e5-5c26-45a1-936d-955195c149ac None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:00.826990 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 172/352] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:00:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:00.832560 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ab6e5-5c26-45a1-936d-955195c149ac None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:00.836039 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f2d73-fa6b-4748-8e14-c04d5ee1be33 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:00.887027 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687083e-c608-40bb-8e42-e1a440987607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:00.887944 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687083e-c608-40bb-8e42-e1a440987607 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:00.888408 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687083e-c608-40bb-8e42-e1a440987607 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:00.888828 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687083e-c608-40bb-8e42-e1a440987607 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:00.957405 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ab6e5-5c26-45a1-936d-955195c149ac None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:00.968503 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9687083e-c608-40bb-8e42-e1a440987607 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:00.972371 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9687083e-c608-40bb-8e42-e1a440987607 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:00.998662 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2932f5-033e-4b12-91d5-a9203e6b8ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:00.999695 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2932f5-033e-4b12-91d5-a9203e6b8ea9 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:01.000523 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2932f5-033e-4b12-91d5-a9203e6b8ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:01.000924 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2932f5-033e-4b12-91d5-a9203e6b8ea9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:01.087275 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2932f5-033e-4b12-91d5-a9203e6b8ea9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:01.088780 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2932f5-033e-4b12-91d5-a9203e6b8ea9 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:01.089071 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 181/353] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 10 03:00:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 03:00:01.090414 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa7e3b-a9a2-4629-8def-7540fd5d265c None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:01.090708 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa7e3b-a9a2-4629-8def-7540fd5d265c None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:01.090989 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa7e3b-a9a2-4629-8def-7540fd5d265c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:01.109966 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-0afa7e3b-a9a2-4629-8def-7540fd5d265c None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:01.111178 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-0afa7e3b-a9a2-4629-8def-7540fd5d265c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:01.198573 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 182/354] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:00:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:01.199793 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79caa9-94ba-4c34-8f5b-c589f8f3b9f2 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:01.200108 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79caa9-94ba-4c34-8f5b-c589f8f3b9f2 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:01.200391 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79caa9-94ba-4c34-8f5b-c589f8f3b9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:01.212612 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 173/355] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 10 03:00:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 03:00:01.213471 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2932f5-033e-4b12-91d5-a9203e6b8ea9 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:01.216866 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-8b79caa9-94ba-4c34-8f5b-c589f8f3b9f2 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:01.218161 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-8b79caa9-94ba-4c34-8f5b-c589f8f3b9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:01.295851 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 183/356] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:00:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:01.296560 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b79caa9-94ba-4c34-8f5b-c589f8f3b9f2 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:01.341672 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2932f5-033e-4b12-91d5-a9203e6b8ea9 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:01.398518 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6874d3ec-228e-496e-9002-f52570219ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:01.399413 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874d3ec-228e-496e-9002-f52570219ba5 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:01.399863 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874d3ec-228e-496e-9002-f52570219ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:01.400194 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874d3ec-228e-496e-9002-f52570219ba5 None admin] PATH_INFO: `/v3/projects/d89ba6f6a62842108d74ca873033ee82` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:01.402959 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6874d3ec-228e-496e-9002-f52570219ba5 None admin] RBAC: Authorizing `identity:get_project(project_id=d89ba6f6a62842108d74ca873033ee82)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:01.404595 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6874d3ec-228e-496e-9002-f52570219ba5 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:01.406930 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 174/357] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 10 03:00:01 2022] GET /identity/v3/projects/d89ba6f6a62842108d74ca873033ee82 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:01.408443 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6874d3ec-228e-496e-9002-f52570219ba5 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:01.430007 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b79caa9-94ba-4c34-8f5b-c589f8f3b9f2 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:01.486514 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51801aa1-cebe-4eb2-992c-6bc50857d309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:01.487716 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51801aa1-cebe-4eb2-992c-6bc50857d309 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:01.488226 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51801aa1-cebe-4eb2-992c-6bc50857d309 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:01.488683 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51801aa1-cebe-4eb2-992c-6bc50857d309 None admin] PATH_INFO: `/v3/projects/2db4f8a4c66d4ca684aabd3e75eafbc2` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:01.490076 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51801aa1-cebe-4eb2-992c-6bc50857d309 None admin] RBAC: Authorizing `identity:get_project(project_id=2db4f8a4c66d4ca684aabd3e75eafbc2)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:01.494636 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51801aa1-cebe-4eb2-992c-6bc50857d309 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:01.497126 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 184/358] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 10 03:00:01 2022] GET /identity/v3/projects/2db4f8a4c66d4ca684aabd3e75eafbc2 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:01.498120 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51801aa1-cebe-4eb2-992c-6bc50857d309 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:01.533783 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6874d3ec-228e-496e-9002-f52570219ba5 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:01.571576 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa2f7e-64df-452f-a098-070046aaa96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:01.572810 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa2f7e-64df-452f-a098-070046aaa96b None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:01.573299 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa2f7e-64df-452f-a098-070046aaa96b None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:01.573780 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa2f7e-64df-452f-a098-070046aaa96b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:01.585659 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfa2f7e-64df-452f-a098-070046aaa96b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:01.594026 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-1dfa2f7e-64df-452f-a098-070046aaa96b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 03:00:01.594026 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:01.594026 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:01.594026 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:01.594026 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:01.594026 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:01.594026 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:01.594026 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:01.594026 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:01.594026 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:01.594026 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:01.594026 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:01.594026 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:01.594026 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:01.594026 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:01.594026 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:01.594994 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:01.594994 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:01.594994 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:01.594994 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:01.594994 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:01.594994 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:01.594994 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:01.594994 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:01.594994 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:01.594994 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:01.594994 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:01.594994 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:01.594994 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:01.594994 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:01.594994 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:01.594994 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:01.595774 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:01.595774 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:01.595774 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:01.595774 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:01.595774 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:01.595774 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:01.595774 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:01.595774 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:01.595774 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:01.595774 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:01.595774 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 03:00:01.595774 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:01.604178 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 175/359] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 10 03:00:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:01.605290 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa2f7e-64df-452f-a098-070046aaa96b None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:01.610326 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51801aa1-cebe-4eb2-992c-6bc50857d309 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:01.656173 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c007bf-0f4c-4094-8fee-275260502ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:01.657614 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c007bf-0f4c-4094-8fee-275260502ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:01.660081 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c007bf-0f4c-4094-8fee-275260502ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:01.660081 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c007bf-0f4c-4094-8fee-275260502ea5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:01.670996 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c007bf-0f4c-4094-8fee-275260502ea5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:01.679670 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-69c007bf-0f4c-4094-8fee-275260502ea5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 03:00:01.679670 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:01.679670 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:01.679670 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:01.679670 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:01.679670 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:01.679670 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:01.679670 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:01.679670 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:01.679670 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:01.679670 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:01.679670 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:01.679670 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:01.679670 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:01.679670 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:01.679670 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:01.680733 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:01.680733 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:01.680733 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:01.680733 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:01.680733 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:01.680733 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:01.680733 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:01.680733 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:01.680733 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:01.680733 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:01.680733 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:01.680733 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:01.680733 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:01.680733 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:01.680733 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:01.680733 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:01.681518 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:01.681518 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:01.681518 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:01.681518 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:01.681518 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:01.681518 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:01.681518 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:01.681518 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:01.681518 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:01.681518 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:01.681518 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 03:00:01.681518 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:01.682778 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 185/360] 10.222.0.65 () {56 vars in 1114 bytes} [Tue May 10 03:00:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:01.683015 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c007bf-0f4c-4094-8fee-275260502ea5 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:01.719144 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa2f7e-64df-452f-a098-070046aaa96b None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:01.759486 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e81759d-4fe6-45d3-b4bc-d9a578571634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:01.760467 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81759d-4fe6-45d3-b4bc-d9a578571634 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:01.760752 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81759d-4fe6-45d3-b4bc-d9a578571634 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:01.761030 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81759d-4fe6-45d3-b4bc-d9a578571634 None admin] PATH_INFO: `/v3/groups/21312eb024514c1a84d1a2a797d37185` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:01.762207 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e81759d-4fe6-45d3-b4bc-d9a578571634 None admin] RBAC: Authorizing `identity:get_group(group_id=21312eb024514c1a84d1a2a797d37185)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:01.763654 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e81759d-4fe6-45d3-b4bc-d9a578571634 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:01.768235 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 176/361] 10.222.0.65 () {56 vars in 1180 bytes} [Tue May 10 03:00:01 2022] GET /identity/v3/groups/21312eb024514c1a84d1a2a797d37185 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:01.768235 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e81759d-4fe6-45d3-b4bc-d9a578571634 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:01.807018 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c007bf-0f4c-4094-8fee-275260502ea5 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:01.850342 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef9f9a8-d347-469d-b621-c11b902a96a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:01.853615 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9f9a8-d347-469d-b621-c11b902a96a0 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:01.853615 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9f9a8-d347-469d-b621-c11b902a96a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:01.853615 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9f9a8-d347-469d-b621-c11b902a96a0 None admin] PATH_INFO: `/v3/groups/21312eb024514c1a84d1a2a797d37185` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:01.855733 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef9f9a8-d347-469d-b621-c11b902a96a0 None admin] RBAC: Authorizing `identity:get_group(group_id=21312eb024514c1a84d1a2a797d37185)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:01.856814 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef9f9a8-d347-469d-b621-c11b902a96a0 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:01.863527 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 186/362] 10.222.0.65 () {56 vars in 1180 bytes} [Tue May 10 03:00:01 2022] GET /identity/v3/groups/21312eb024514c1a84d1a2a797d37185 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:01.863527 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969b2df-0b5a-4c02-bcbf-971862b2c87a None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:01.863527 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969b2df-0b5a-4c02-bcbf-971862b2c87a None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:01.863527 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969b2df-0b5a-4c02-bcbf-971862b2c87a None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:01.863527 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 187/363] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:00:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:01.863527 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3969b2df-0b5a-4c02-bcbf-971862b2c87a None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:01.901414 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e81759d-4fe6-45d3-b4bc-d9a578571634 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:01.942194 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad5a252-daf5-436a-8b64-b021da3bfcd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:01.943200 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad5a252-daf5-436a-8b64-b021da3bfcd1 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:01.943484 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad5a252-daf5-436a-8b64-b021da3bfcd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:01.943762 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad5a252-daf5-436a-8b64-b021da3bfcd1 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:01.944586 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad5a252-daf5-436a-8b64-b021da3bfcd1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:01.944900 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad5a252-daf5-436a-8b64-b021da3bfcd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:01.946368 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad5a252-daf5-436a-8b64-b021da3bfcd1 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:01.955141 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 177/364] 10.222.0.65 () {56 vars in 1101 bytes} [Tue May 10 03:00:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:01.955771 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad5a252-daf5-436a-8b64-b021da3bfcd1 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:01.995144 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3969b2df-0b5a-4c02-bcbf-971862b2c87a None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:02.046596 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b1a38-7dc0-491c-a5f2-01dcc4783f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:02.047274 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b1a38-7dc0-491c-a5f2-01dcc4783f6f None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:02.047558 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b1a38-7dc0-491c-a5f2-01dcc4783f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:02.047835 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b1a38-7dc0-491c-a5f2-01dcc4783f6f None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:02.048652 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02b1a38-7dc0-491c-a5f2-01dcc4783f6f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:02.048959 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02b1a38-7dc0-491c-a5f2-01dcc4783f6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:02.050320 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02b1a38-7dc0-491c-a5f2-01dcc4783f6f None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:02.063631 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 188/365] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 10 03:00:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:02.063631 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b1a38-7dc0-491c-a5f2-01dcc4783f6f None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:02.090191 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad5a252-daf5-436a-8b64-b021da3bfcd1 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:02.134829 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2925d00f-966f-4064-83bf-25912d32f8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:02.135492 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925d00f-966f-4064-83bf-25912d32f8bc None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:02.135775 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925d00f-966f-4064-83bf-25912d32f8bc None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:02.136081 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925d00f-966f-4064-83bf-25912d32f8bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:02.136921 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2925d00f-966f-4064-83bf-25912d32f8bc None admin] RBAC: Adding query filter params (group.id=21312eb024514c1a84d1a2a797d37185, role.id=bab81fd8d58945b8a1ea63c93b3b4857, scope.project.id=d89ba6f6a62842108d74ca873033ee82) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:02.137233 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2925d00f-966f-4064-83bf-25912d32f8bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:02.138678 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2925d00f-966f-4064-83bf-25912d32f8bc None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:02.145343 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 178/366] 10.222.0.65 () {56 vars in 1376 bytes} [Tue May 10 03:00:01 2022] GET /identity/v3/role_assignments?group.id=21312eb024514c1a84d1a2a797d37185&scope.project.id=d89ba6f6a62842108d74ca873033ee82&role.id=bab81fd8d58945b8a1ea63c93b3b4857 => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:02.146295 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603f1b8-e483-4b5e-b37f-356e21b82837 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:02.146583 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603f1b8-e483-4b5e-b37f-356e21b82837 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:02.146861 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603f1b8-e483-4b5e-b37f-356e21b82837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:02.167606 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-7603f1b8-e483-4b5e-b37f-356e21b82837 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:02.168868 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-7603f1b8-e483-4b5e-b37f-356e21b82837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:02.189464 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b1a38-7dc0-491c-a5f2-01dcc4783f6f None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:02.236797 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45af7fd8-5ce6-45ee-914b-b934c4f53962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:02.237886 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af7fd8-5ce6-45ee-914b-b934c4f53962 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:02.238373 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af7fd8-5ce6-45ee-914b-b934c4f53962 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:02.238845 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af7fd8-5ce6-45ee-914b-b934c4f53962 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:02.240583 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45af7fd8-5ce6-45ee-914b-b934c4f53962 None admin] RBAC: Adding query filter params (group.id=21312eb024514c1a84d1a2a797d37185, role.id=b2cf4d51cc0b4532adcb7021d474177e, scope.project.id=2db4f8a4c66d4ca684aabd3e75eafbc2) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:02.240907 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45af7fd8-5ce6-45ee-914b-b934c4f53962 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:02.242408 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45af7fd8-5ce6-45ee-914b-b934c4f53962 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:02.248731 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 189/367] 10.222.0.65 () {56 vars in 1376 bytes} [Tue May 10 03:00:02 2022] GET /identity/v3/role_assignments?group.id=21312eb024514c1a84d1a2a797d37185&scope.project.id=2db4f8a4c66d4ca684aabd3e75eafbc2&role.id=b2cf4d51cc0b4532adcb7021d474177e => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:02.249505 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45af7fd8-5ce6-45ee-914b-b934c4f53962 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:02.261008 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 179/368] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:00:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:02.262271 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7603f1b8-e483-4b5e-b37f-356e21b82837 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:02.376455 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7603f1b8-e483-4b5e-b37f-356e21b82837 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:02.380870 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45af7fd8-5ce6-45ee-914b-b934c4f53962 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:02.431889 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa56a0b-1040-4b7d-ac98-4b895d0ef7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:02.432745 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa56a0b-1040-4b7d-ac98-4b895d0ef7cd None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:02.433033 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa56a0b-1040-4b7d-ac98-4b895d0ef7cd None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:02.433311 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa56a0b-1040-4b7d-ac98-4b895d0ef7cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:02.440837 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837dc5c2-e379-4309-89eb-4245ff225360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:02.442188 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837dc5c2-e379-4309-89eb-4245ff225360 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:02.442707 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837dc5c2-e379-4309-89eb-4245ff225360 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:02.443215 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837dc5c2-e379-4309-89eb-4245ff225360 None admin] PATH_INFO: `/v3/users/afb127fa5a5749b786d881428cbb048b` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:02.445981 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837dc5c2-e379-4309-89eb-4245ff225360 None admin] RBAC: Authorizing `identity:get_user(user_id=afb127fa5a5749b786d881428cbb048b)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:02.447816 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837dc5c2-e379-4309-89eb-4245ff225360 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:02.452984 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 190/369] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 10 03:00:02 2022] GET /identity/v3/users/afb127fa5a5749b786d881428cbb048b => generated 293 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:02.454143 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837dc5c2-e379-4309-89eb-4245ff225360 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:02.565998 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa56a0b-1040-4b7d-ac98-4b895d0ef7cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:02.567925 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa56a0b-1040-4b7d-ac98-4b895d0ef7cd None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:02.583407 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837dc5c2-e379-4309-89eb-4245ff225360 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:02.621158 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a7e9da-3c3c-4c29-9111-a54d6731af11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:02.621950 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7e9da-3c3c-4c29-9111-a54d6731af11 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:02.622230 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7e9da-3c3c-4c29-9111-a54d6731af11 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:02.622500 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7e9da-3c3c-4c29-9111-a54d6731af11 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:02.634065 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a7e9da-3c3c-4c29-9111-a54d6731af11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:02.643174 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-25a7e9da-3c3c-4c29-9111-a54d6731af11 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:00:02.643174 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:02.643174 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:02.643174 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:02.643174 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:02.643174 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:02.643174 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:02.643174 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:02.643174 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:02.643174 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:02.643174 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:02.643174 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:02.643174 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:02.643174 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:02.643174 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:02.643174 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:02.644127 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:02.644127 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:02.644127 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:02.644127 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:02.644127 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:02.644127 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:02.644127 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:02.644127 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:02.644127 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:02.644127 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:02.644127 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:02.644127 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:02.644127 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:02.644127 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:02.644127 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:02.644127 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:02.644927 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:02.644927 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:02.644927 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:02.644927 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:02.644927 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:02.644927 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:02.644927 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:02.644927 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:02.644927 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:02.644927 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:02.644927 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:00:02.644927 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:02.644927 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 191/370] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 10 03:00:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:02.645576 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a7e9da-3c3c-4c29-9111-a54d6731af11 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:02.701906 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 180/371] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 10 03:00:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 03:00:02.702690 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa56a0b-1040-4b7d-ac98-4b895d0ef7cd None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:02.758099 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a7e9da-3c3c-4c29-9111-a54d6731af11 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:02.797664 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd15247-4ebb-4286-ae9f-a45b8b5fafd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:02.798722 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd15247-4ebb-4286-ae9f-a45b8b5fafd1 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:02.799204 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd15247-4ebb-4286-ae9f-a45b8b5fafd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:02.799740 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd15247-4ebb-4286-ae9f-a45b8b5fafd1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:02.800817 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd15247-4ebb-4286-ae9f-a45b8b5fafd1 None admin] RBAC: Adding query filter params (role.id=d1526e6293dc47b1a0e78c462f588dac, user.id=afb127fa5a5749b786d881428cbb048b, scope.system=all) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:02.801343 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd15247-4ebb-4286-ae9f-a45b8b5fafd1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:02.802996 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd15247-4ebb-4286-ae9f-a45b8b5fafd1 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:02.806985 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa56a0b-1040-4b7d-ac98-4b895d0ef7cd None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:02.823186 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 192/372] 10.222.0.65 () {56 vars in 1308 bytes} [Tue May 10 03:00:02 2022] GET /identity/v3/role_assignments?user.id=afb127fa5a5749b786d881428cbb048b&scope.system=all&role.id=d1526e6293dc47b1a0e78c462f588dac => generated 510 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:02.824327 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd15247-4ebb-4286-ae9f-a45b8b5fafd1 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:02.844052 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306b910-5615-4374-b477-61ad79a7ab5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:02.844052 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306b910-5615-4374-b477-61ad79a7ab5a None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:02.844340 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306b910-5615-4374-b477-61ad79a7ab5a None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:02.844600 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306b910-5615-4374-b477-61ad79a7ab5a None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:02.845566 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9306b910-5615-4374-b477-61ad79a7ab5a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:02.845671 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9306b910-5615-4374-b477-61ad79a7ab5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:02.847013 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9306b910-5615-4374-b477-61ad79a7ab5a None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:02.860044 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 181/373] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 10 03:00:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:02.862418 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306b910-5615-4374-b477-61ad79a7ab5a None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:02.982542 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306b910-5615-4374-b477-61ad79a7ab5a None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:03.024604 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e56e80c-6dd8-4086-baa0-88c19f7b282f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:03.025520 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e56e80c-6dd8-4086-baa0-88c19f7b282f None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:03.025799 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e56e80c-6dd8-4086-baa0-88c19f7b282f None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:03.026072 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e56e80c-6dd8-4086-baa0-88c19f7b282f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:03.047233 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd15247-4ebb-4286-ae9f-a45b8b5fafd1 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:03.089795 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b60684-3e1f-453a-a515-abcf0bc3cf27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:03.090632 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b60684-3e1f-453a-a515-abcf0bc3cf27 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:03.090865 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b60684-3e1f-453a-a515-abcf0bc3cf27 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:03.091133 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b60684-3e1f-453a-a515-abcf0bc3cf27 None admin] PATH_INFO: `/v3/projects/d89ba6f6a62842108d74ca873033ee82` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:03.092892 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b60684-3e1f-453a-a515-abcf0bc3cf27 None admin] RBAC: Authorizing `identity:get_project(project_id=d89ba6f6a62842108d74ca873033ee82)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:03.094569 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b60684-3e1f-453a-a515-abcf0bc3cf27 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:03.096854 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 193/374] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 10 03:00:02 2022] GET /identity/v3/projects/d89ba6f6a62842108d74ca873033ee82 => generated 302 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:03.102656 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b60684-3e1f-453a-a515-abcf0bc3cf27 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:03.181785 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e56e80c-6dd8-4086-baa0-88c19f7b282f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:03.183651 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e56e80c-6dd8-4086-baa0-88c19f7b282f None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:03.228285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b60684-3e1f-453a-a515-abcf0bc3cf27 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:03.269713 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c437f14f-d1f3-48b7-9e81-789099dcddea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:03.270717 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c437f14f-d1f3-48b7-9e81-789099dcddea None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:03.271097 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c437f14f-d1f3-48b7-9e81-789099dcddea None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:03.271819 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c437f14f-d1f3-48b7-9e81-789099dcddea None admin] PATH_INFO: `/v3/groups/21312eb024514c1a84d1a2a797d37185` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:03.274046 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c437f14f-d1f3-48b7-9e81-789099dcddea None admin] RBAC: Authorizing `identity:get_group(group_id=21312eb024514c1a84d1a2a797d37185)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:03.275888 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c437f14f-d1f3-48b7-9e81-789099dcddea None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:03.278296 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 194/375] 10.222.0.65 () {56 vars in 1180 bytes} [Tue May 10 03:00:03 2022] GET /identity/v3/groups/21312eb024514c1a84d1a2a797d37185 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:03.279986 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755042d1-35c0-4ea5-85a9-327b72135d55 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:03.280391 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755042d1-35c0-4ea5-85a9-327b72135d55 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:03.280872 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755042d1-35c0-4ea5-85a9-327b72135d55 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:03.283030 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 195/376] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:00:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:03.284301 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755042d1-35c0-4ea5-85a9-327b72135d55 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:03.299106 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 182/377] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 10 03:00:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 03:00:03.300953 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c3b13-47e4-456d-8702-cf2bd1b201fa None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:03.301440 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c3b13-47e4-456d-8702-cf2bd1b201fa None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:03.301932 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c3b13-47e4-456d-8702-cf2bd1b201fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:03.320398 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-ad6c3b13-47e4-456d-8702-cf2bd1b201fa None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:03.321942 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-ad6c3b13-47e4-456d-8702-cf2bd1b201fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:03.412797 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 183/378] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:00:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:03.414916 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c3b13-47e4-456d-8702-cf2bd1b201fa None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:03.418095 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755042d1-35c0-4ea5-85a9-327b72135d55 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:03.458621 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1567ef35-4bce-4019-b4bc-b2ab606fa860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:03.458621 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567ef35-4bce-4019-b4bc-b2ab606fa860 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:03.458621 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567ef35-4bce-4019-b4bc-b2ab606fa860 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:03.458621 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567ef35-4bce-4019-b4bc-b2ab606fa860 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:03.461211 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1567ef35-4bce-4019-b4bc-b2ab606fa860 None admin] RBAC: Adding query filter params (group.id=21312eb024514c1a84d1a2a797d37185, role.id=b2cf4d51cc0b4532adcb7021d474177e, scope.project.id=d89ba6f6a62842108d74ca873033ee82) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:03.461564 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1567ef35-4bce-4019-b4bc-b2ab606fa860 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:03.463012 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1567ef35-4bce-4019-b4bc-b2ab606fa860 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:03.469074 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 196/379] 10.222.0.65 () {56 vars in 1376 bytes} [Tue May 10 03:00:03 2022] GET /identity/v3/role_assignments?group.id=21312eb024514c1a84d1a2a797d37185&scope.project.id=d89ba6f6a62842108d74ca873033ee82&role.id=b2cf4d51cc0b4532adcb7021d474177e => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:03.469884 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1567ef35-4bce-4019-b4bc-b2ab606fa860 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:03.531345 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c3b13-47e4-456d-8702-cf2bd1b201fa None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:03.573069 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8552c2d5-4669-4aa9-83dc-080b9defee26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:03.573941 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552c2d5-4669-4aa9-83dc-080b9defee26 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:03.574219 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552c2d5-4669-4aa9-83dc-080b9defee26 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:03.574492 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552c2d5-4669-4aa9-83dc-080b9defee26 None admin] PATH_INFO: `/v3/projects/b2907edfa2f14a3b85299455266c251c` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:03.581516 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8552c2d5-4669-4aa9-83dc-080b9defee26 None admin] RBAC: Authorizing `identity:get_project(project_id=b2907edfa2f14a3b85299455266c251c)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:03.583226 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8552c2d5-4669-4aa9-83dc-080b9defee26 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:03.588069 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 184/380] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 10 03:00:03 2022] GET /identity/v3/projects/b2907edfa2f14a3b85299455266c251c => generated 344 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:03.618872 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8552c2d5-4669-4aa9-83dc-080b9defee26 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:03.713835 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1567ef35-4bce-4019-b4bc-b2ab606fa860 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:03.739631 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8552c2d5-4669-4aa9-83dc-080b9defee26 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:03.754840 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27619868-74c7-4cf2-aaf0-dfa13e63c614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:03.755637 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27619868-74c7-4cf2-aaf0-dfa13e63c614 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:03.755919 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27619868-74c7-4cf2-aaf0-dfa13e63c614 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:03.756220 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27619868-74c7-4cf2-aaf0-dfa13e63c614 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:03.767978 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27619868-74c7-4cf2-aaf0-dfa13e63c614 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:03.776247 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-27619868-74c7-4cf2-aaf0-dfa13e63c614 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 03:00:03.776247 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:03.776247 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:03.776247 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:03.776247 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:03.776247 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:03.776247 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:03.776247 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:03.776247 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:03.776247 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:03.776247 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:03.776247 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:03.776247 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:03.776247 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:03.776247 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:03.776247 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:03.777335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:03.777335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:03.777335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:03.777335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:03.777335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:03.777335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:03.777335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:03.777335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:03.777335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:03.777335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:03.777335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:03.777335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:03.777335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:03.777335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:03.777335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:03.777335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:03.778480 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:03.778480 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:03.778480 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:03.778480 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:03.778480 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:03.778480 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:03.778480 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:03.778480 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:03.778480 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:03.778480 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:03.778480 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 03:00:03.778480 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:03.778480 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 197/381] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 10 03:00:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:03.781981 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561e0e0c-0cbf-4238-a219-8971bdbb9471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:03.783417 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e0e0c-0cbf-4238-a219-8971bdbb9471 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:03.783540 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27619868-74c7-4cf2-aaf0-dfa13e63c614 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:03.783990 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e0e0c-0cbf-4238-a219-8971bdbb9471 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:03.784421 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e0e0c-0cbf-4238-a219-8971bdbb9471 None admin] PATH_INFO: `/v3/groups/dba083d85f4049b7baeca20d6bd1b039` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:03.795094 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561e0e0c-0cbf-4238-a219-8971bdbb9471 None admin] RBAC: Authorizing `identity:get_group(group_id=dba083d85f4049b7baeca20d6bd1b039)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:03.797428 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561e0e0c-0cbf-4238-a219-8971bdbb9471 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:03.804159 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 185/382] 10.222.0.65 () {56 vars in 1180 bytes} [Tue May 10 03:00:03 2022] GET /identity/v3/groups/dba083d85f4049b7baeca20d6bd1b039 => generated 229 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:03.806610 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561e0e0c-0cbf-4238-a219-8971bdbb9471 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:03.905082 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27619868-74c7-4cf2-aaf0-dfa13e63c614 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:03.927710 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561e0e0c-0cbf-4238-a219-8971bdbb9471 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:03.947603 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b17cd3-1619-494b-9013-78960b18421f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:03.948736 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b17cd3-1619-494b-9013-78960b18421f None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:03.949447 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b17cd3-1619-494b-9013-78960b18421f None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:03.949892 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b17cd3-1619-494b-9013-78960b18421f None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:03.950814 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b17cd3-1619-494b-9013-78960b18421f None admin] RBAC: Adding query filter params (name=member) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:03.951315 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b17cd3-1619-494b-9013-78960b18421f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:03.953717 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b17cd3-1619-494b-9013-78960b18421f None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:03.965717 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 198/383] 10.222.0.65 () {56 vars in 1101 bytes} [Tue May 10 03:00:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:03.971850 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b17cd3-1619-494b-9013-78960b18421f None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:03.973074 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bcce96-ac38-403a-a461-ec6dea39cbf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:03.973984 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bcce96-ac38-403a-a461-ec6dea39cbf6 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:03.974449 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bcce96-ac38-403a-a461-ec6dea39cbf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:03.975153 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bcce96-ac38-403a-a461-ec6dea39cbf6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:03.977311 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bcce96-ac38-403a-a461-ec6dea39cbf6 None admin] RBAC: Adding query filter params (group.id=dba083d85f4049b7baeca20d6bd1b039, role.id=43105000610f402ca2486e7648018cca, scope.project.id=b2907edfa2f14a3b85299455266c251c) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:03.977847 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bcce96-ac38-403a-a461-ec6dea39cbf6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:03.979530 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bcce96-ac38-403a-a461-ec6dea39cbf6 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:03.992274 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 186/384] 10.222.0.65 () {56 vars in 1376 bytes} [Tue May 10 03:00:03 2022] GET /identity/v3/role_assignments?group.id=dba083d85f4049b7baeca20d6bd1b039&scope.project.id=b2907edfa2f14a3b85299455266c251c&role.id=43105000610f402ca2486e7648018cca => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:04.107364 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b17cd3-1619-494b-9013-78960b18421f None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:04.145397 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca6e904-d375-4faf-b953-a669152a8428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:04.146329 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6e904-d375-4faf-b953-a669152a8428 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:04.146611 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6e904-d375-4faf-b953-a669152a8428 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:04.146889 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6e904-d375-4faf-b953-a669152a8428 None admin] PATH_INFO: `/v3/groups/21312eb024514c1a84d1a2a797d37185` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:04.148243 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca6e904-d375-4faf-b953-a669152a8428 None admin] RBAC: Authorizing `identity:get_group(group_id=21312eb024514c1a84d1a2a797d37185)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:04.149763 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca6e904-d375-4faf-b953-a669152a8428 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:04.151768 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 199/385] 10.222.0.65 () {56 vars in 1180 bytes} [Tue May 10 03:00:03 2022] GET /identity/v3/groups/21312eb024514c1a84d1a2a797d37185 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:04.157172 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bcce96-ac38-403a-a461-ec6dea39cbf6 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:04.268731 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bcce96-ac38-403a-a461-ec6dea39cbf6 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:04.306247 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9adb339-bb64-4ce4-ad8c-b05eecfc42cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:04.307121 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9adb339-bb64-4ce4-ad8c-b05eecfc42cc None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:04.307401 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9adb339-bb64-4ce4-ad8c-b05eecfc42cc None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:04.307676 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9adb339-bb64-4ce4-ad8c-b05eecfc42cc None admin] PATH_INFO: `/v3/projects/2db4f8a4c66d4ca684aabd3e75eafbc2` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:04.308932 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9adb339-bb64-4ce4-ad8c-b05eecfc42cc None admin] RBAC: Authorizing `identity:get_project(project_id=2db4f8a4c66d4ca684aabd3e75eafbc2)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:04.310375 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9adb339-bb64-4ce4-ad8c-b05eecfc42cc None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:04.312404 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 187/386] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 10 03:00:04 2022] GET /identity/v3/projects/2db4f8a4c66d4ca684aabd3e75eafbc2 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:04.321101 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca6e904-d375-4faf-b953-a669152a8428 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:04.434442 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca6e904-d375-4faf-b953-a669152a8428 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:04.479745 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7937bb-a385-4bc3-8dac-d78b9800657e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:04.480656 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7937bb-a385-4bc3-8dac-d78b9800657e None admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:04.480935 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7937bb-a385-4bc3-8dac-d78b9800657e None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:04.481206 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7937bb-a385-4bc3-8dac-d78b9800657e None admin] PATH_INFO: `/v3/projects/2db4f8a4c66d4ca684aabd3e75eafbc2/groups/21312eb024514c1a84d1a2a797d37185/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:04.486199 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7937bb-a385-4bc3-8dac-d78b9800657e None admin] RBAC: Authorizing `identity:create_grant(project_id=2db4f8a4c66d4ca684aabd3e75eafbc2, group_id=21312eb024514c1a84d1a2a797d37185, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:04.487638 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7937bb-a385-4bc3-8dac-d78b9800657e None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:04.582967 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 200/387] 10.222.0.65 () {58 vars in 1442 bytes} [Tue May 10 03:00:04 2022] PUT /identity/v3/projects/2db4f8a4c66d4ca684aabd3e75eafbc2/groups/21312eb024514c1a84d1a2a797d37185/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:00:05.412212 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1542ee96-7821-492a-b82a-f61042abc61b None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:05.412747 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1542ee96-7821-492a-b82a-f61042abc61b None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:05.412747 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1542ee96-7821-492a-b82a-f61042abc61b None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:05.414436 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 188/388] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:00:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:05.419392 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9369bd1e-3497-434e-9d86-a1d2501ef1b6 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:05.419811 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9369bd1e-3497-434e-9d86-a1d2501ef1b6 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:05.420031 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9369bd1e-3497-434e-9d86-a1d2501ef1b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:05.440977 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-9369bd1e-3497-434e-9d86-a1d2501ef1b6 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:05.442168 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-9369bd1e-3497-434e-9d86-a1d2501ef1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:05.521673 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 201/389] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:00:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:05.543825 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a45380-630a-4bb9-9d4f-53a83016cc69 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:05.544168 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a45380-630a-4bb9-9d4f-53a83016cc69 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:05.544418 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a45380-630a-4bb9-9d4f-53a83016cc69 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:05.545797 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 189/390] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:00:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:05.551113 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce76f2-5147-4c28-9418-a3eb26cede46 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:05.551400 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce76f2-5147-4c28-9418-a3eb26cede46 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:05.551675 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce76f2-5147-4c28-9418-a3eb26cede46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:05.564879 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a45380-630a-4bb9-9d4f-53a83016cc69 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:05.573074 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-1bce76f2-5147-4c28-9418-a3eb26cede46 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:05.574470 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-1bce76f2-5147-4c28-9418-a3eb26cede46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:05.692551 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 202/391] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:00:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:05.733511 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a45380-630a-4bb9-9d4f-53a83016cc69 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:05.766592 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce76f2-5147-4c28-9418-a3eb26cede46 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:05.791236 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c7f239-e256-40f4-b509-e31b1c04c21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:05.792077 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7f239-e256-40f4-b509-e31b1c04c21a None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:05.792376 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7f239-e256-40f4-b509-e31b1c04c21a None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:05.792649 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7f239-e256-40f4-b509-e31b1c04c21a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:05.813367 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c7f239-e256-40f4-b509-e31b1c04c21a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:05.830414 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-85c7f239-e256-40f4-b509-e31b1c04c21a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 03:00:05.830414 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:05.830414 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:05.830414 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:05.830414 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:05.830414 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:05.830414 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:05.830414 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:05.830414 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:05.830414 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:05.830414 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:05.830414 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:05.830414 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:05.830414 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:05.830414 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:05.830414 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:05.831347 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:05.831347 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:05.831347 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:05.831347 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:05.831347 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:05.831347 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:05.831347 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:05.831347 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:05.831347 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:05.831347 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:05.831347 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:05.831347 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:05.831347 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:05.831347 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:05.831347 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:05.831347 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:05.832149 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:05.832149 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:05.832149 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:05.832149 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:05.832149 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:05.832149 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:05.832149 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:05.832149 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:05.832149 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:05.832149 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:05.832149 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 03:00:05.832149 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:05.832149 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 190/392] 10.222.0.65 () {56 vars in 1114 bytes} [Tue May 10 03:00:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:00:05.837639 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c7f239-e256-40f4-b509-e31b1c04c21a None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:05.886027 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce76f2-5147-4c28-9418-a3eb26cede46 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:05.923882 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657648ab-f461-4267-841b-26032ccaa94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:05.924729 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657648ab-f461-4267-841b-26032ccaa94b None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:05.925012 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657648ab-f461-4267-841b-26032ccaa94b None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:05.925286 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657648ab-f461-4267-841b-26032ccaa94b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:05.938194 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657648ab-f461-4267-841b-26032ccaa94b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:05.946246 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-657648ab-f461-4267-841b-26032ccaa94b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 03:00:05.946246 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:05.946246 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:05.946246 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:05.946246 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:05.946246 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:05.946246 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:05.946246 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:05.946246 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:05.946246 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:05.946246 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:05.946246 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:05.946246 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:05.946246 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:05.946246 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:05.946246 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:05.948342 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:05.948342 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:05.948342 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:05.948342 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:05.948342 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:05.948342 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:05.948342 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:05.948342 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:05.948342 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:05.948342 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:05.948342 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:05.948342 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:05.948342 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:05.948342 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:05.948342 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:05.948342 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:05.950230 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:05.950230 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:05.950230 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:05.950230 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:05.950230 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:05.950230 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:05.950230 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:05.950230 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:05.950230 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:05.950230 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:05.950230 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 03:00:05.950230 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:05.950230 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 203/393] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 10 03:00:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:05.957547 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657648ab-f461-4267-841b-26032ccaa94b None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:05.981292 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c7f239-e256-40f4-b509-e31b1c04c21a None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:06.034115 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5346ba8-8207-45b5-891b-c260de4bbff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:06.034806 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5346ba8-8207-45b5-891b-c260de4bbff1 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:06.035088 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5346ba8-8207-45b5-891b-c260de4bbff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:06.035366 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5346ba8-8207-45b5-891b-c260de4bbff1 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:06.036162 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5346ba8-8207-45b5-891b-c260de4bbff1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:06.036471 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5346ba8-8207-45b5-891b-c260de4bbff1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:06.037854 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5346ba8-8207-45b5-891b-c260de4bbff1 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:06.051260 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 191/394] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 10 03:00:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:06.057412 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5346ba8-8207-45b5-891b-c260de4bbff1 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:06.068528 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657648ab-f461-4267-841b-26032ccaa94b None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:06.110137 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6417a5db-522c-42b0-9d8b-aac15cd92ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:06.110869 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417a5db-522c-42b0-9d8b-aac15cd92ba6 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:06.111156 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417a5db-522c-42b0-9d8b-aac15cd92ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:06.111416 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417a5db-522c-42b0-9d8b-aac15cd92ba6 None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:06.116886 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6417a5db-522c-42b0-9d8b-aac15cd92ba6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:06.117208 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6417a5db-522c-42b0-9d8b-aac15cd92ba6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:06.118655 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6417a5db-522c-42b0-9d8b-aac15cd92ba6 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:06.134638 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 204/395] 10.222.0.65 () {56 vars in 1101 bytes} [Tue May 10 03:00:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:06.141381 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6417a5db-522c-42b0-9d8b-aac15cd92ba6 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:06.232772 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5346ba8-8207-45b5-891b-c260de4bbff1 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:06.269403 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78efbe2-e358-4e92-9514-5a304f260f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:06.270272 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78efbe2-e358-4e92-9514-5a304f260f80 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:06.270554 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78efbe2-e358-4e92-9514-5a304f260f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:06.270833 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78efbe2-e358-4e92-9514-5a304f260f80 None admin] PATH_INFO: `/v3/groups/21312eb024514c1a84d1a2a797d37185` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:06.272054 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78efbe2-e358-4e92-9514-5a304f260f80 None admin] RBAC: Authorizing `identity:get_group(group_id=21312eb024514c1a84d1a2a797d37185)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:06.274422 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78efbe2-e358-4e92-9514-5a304f260f80 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:06.277134 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 192/396] 10.222.0.65 () {56 vars in 1180 bytes} [Tue May 10 03:00:06 2022] GET /identity/v3/groups/21312eb024514c1a84d1a2a797d37185 => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:06.282814 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78efbe2-e358-4e92-9514-5a304f260f80 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:06.283551 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6417a5db-522c-42b0-9d8b-aac15cd92ba6 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:06.318654 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857f0eca-1641-4fd2-ad83-79a6b92dc6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:06.319598 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f0eca-1641-4fd2-ad83-79a6b92dc6f1 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:06.324158 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f0eca-1641-4fd2-ad83-79a6b92dc6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:06.324158 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f0eca-1641-4fd2-ad83-79a6b92dc6f1 None admin] PATH_INFO: `/v3/groups/21312eb024514c1a84d1a2a797d37185` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:06.324158 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857f0eca-1641-4fd2-ad83-79a6b92dc6f1 None admin] RBAC: Authorizing `identity:get_group(group_id=21312eb024514c1a84d1a2a797d37185)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:06.324158 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857f0eca-1641-4fd2-ad83-79a6b92dc6f1 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:06.325289 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 205/397] 10.222.0.65 () {56 vars in 1180 bytes} [Tue May 10 03:00:06 2022] GET /identity/v3/groups/21312eb024514c1a84d1a2a797d37185 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:06.330752 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857f0eca-1641-4fd2-ad83-79a6b92dc6f1 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:06.388769 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78efbe2-e358-4e92-9514-5a304f260f80 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:06.424452 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dcb296-4117-43d8-b21b-95f0cc159f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:06.425307 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dcb296-4117-43d8-b21b-95f0cc159f45 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:06.425756 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dcb296-4117-43d8-b21b-95f0cc159f45 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:06.426202 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dcb296-4117-43d8-b21b-95f0cc159f45 None admin] PATH_INFO: `/v3/projects/2db4f8a4c66d4ca684aabd3e75eafbc2` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:06.427564 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dcb296-4117-43d8-b21b-95f0cc159f45 None admin] RBAC: Authorizing `identity:get_project(project_id=2db4f8a4c66d4ca684aabd3e75eafbc2)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:06.429245 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dcb296-4117-43d8-b21b-95f0cc159f45 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:06.431487 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 193/398] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 10 03:00:06 2022] GET /identity/v3/projects/2db4f8a4c66d4ca684aabd3e75eafbc2 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:06.437161 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dcb296-4117-43d8-b21b-95f0cc159f45 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:06.461396 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857f0eca-1641-4fd2-ad83-79a6b92dc6f1 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:06.502511 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ba029-8ad1-433c-a305-94236407f2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:06.503300 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ba029-8ad1-433c-a305-94236407f2ac None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:06.503580 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ba029-8ad1-433c-a305-94236407f2ac None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:06.503857 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ba029-8ad1-433c-a305-94236407f2ac None admin] PATH_INFO: `/v3/projects/d89ba6f6a62842108d74ca873033ee82` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:06.505095 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009ba029-8ad1-433c-a305-94236407f2ac None admin] RBAC: Authorizing `identity:get_project(project_id=d89ba6f6a62842108d74ca873033ee82)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:06.506537 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009ba029-8ad1-433c-a305-94236407f2ac None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:06.508594 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 206/399] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 10 03:00:06 2022] GET /identity/v3/projects/d89ba6f6a62842108d74ca873033ee82 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:06.509853 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b78502-3465-4003-8c5c-90841475bf13 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:06.510137 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b78502-3465-4003-8c5c-90841475bf13 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:06.510418 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b78502-3465-4003-8c5c-90841475bf13 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:06.511635 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 207/400] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:00:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:06.516603 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b78502-3465-4003-8c5c-90841475bf13 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:06.550643 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dcb296-4117-43d8-b21b-95f0cc159f45 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:06.595046 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e35372-6ac8-4652-bbe4-ff2ba2f674e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:06.596021 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e35372-6ac8-4652-bbe4-ff2ba2f674e4 None admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:06.596337 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e35372-6ac8-4652-bbe4-ff2ba2f674e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:06.596614 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e35372-6ac8-4652-bbe4-ff2ba2f674e4 None admin] PATH_INFO: `/v3/projects/2db4f8a4c66d4ca684aabd3e75eafbc2/groups/21312eb024514c1a84d1a2a797d37185/roles/b2cf4d51cc0b4532adcb7021d474177e` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:06.599107 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e35372-6ac8-4652-bbe4-ff2ba2f674e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=2db4f8a4c66d4ca684aabd3e75eafbc2, group_id=21312eb024514c1a84d1a2a797d37185, role_id=b2cf4d51cc0b4532adcb7021d474177e)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:06.601351 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e35372-6ac8-4652-bbe4-ff2ba2f674e4 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:06.644621 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b78502-3465-4003-8c5c-90841475bf13 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:06.671127 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 194/401] 10.222.0.65 () {58 vars in 1442 bytes} [Tue May 10 03:00:06 2022] PUT /identity/v3/projects/2db4f8a4c66d4ca684aabd3e75eafbc2/groups/21312eb024514c1a84d1a2a797d37185/roles/b2cf4d51cc0b4532adcb7021d474177e => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:00:06.676267 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeac807-d247-4108-a5eb-9892356fde65 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:06.676267 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeac807-d247-4108-a5eb-9892356fde65 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:06.676267 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeac807-d247-4108-a5eb-9892356fde65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:06.705040 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d614e85-29ad-4085-be20-52c6c37e015c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:06.705953 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d614e85-29ad-4085-be20-52c6c37e015c None admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:06.706238 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d614e85-29ad-4085-be20-52c6c37e015c None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:06.706506 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d614e85-29ad-4085-be20-52c6c37e015c None admin] PATH_INFO: `/v3/projects/d89ba6f6a62842108d74ca873033ee82/groups/21312eb024514c1a84d1a2a797d37185/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:06.713066 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-ffeac807-d247-4108-a5eb-9892356fde65 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:06.714984 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d614e85-29ad-4085-be20-52c6c37e015c None admin] RBAC: Authorizing `identity:create_grant(project_id=d89ba6f6a62842108d74ca873033ee82, group_id=21312eb024514c1a84d1a2a797d37185, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:06.716463 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-ffeac807-d247-4108-a5eb-9892356fde65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:06.717619 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d614e85-29ad-4085-be20-52c6c37e015c None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:06.807794 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 195/402] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:00:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:06.809291 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc730bff-ca6d-4476-be37-095b0724aec0 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:06.809726 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc730bff-ca6d-4476-be37-095b0724aec0 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:06.810011 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc730bff-ca6d-4476-be37-095b0724aec0 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:06.815562 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 196/403] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:00:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:06.817415 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957747c9-f243-49cd-898e-a681ff432661 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:06.817708 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957747c9-f243-49cd-898e-a681ff432661 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:06.817939 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 208/404] 10.222.0.65 () {58 vars in 1442 bytes} [Tue May 10 03:00:06 2022] PUT /identity/v3/projects/d89ba6f6a62842108d74ca873033ee82/groups/21312eb024514c1a84d1a2a797d37185/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:00:06.818039 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957747c9-f243-49cd-898e-a681ff432661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:06.838812 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d614e85-29ad-4085-be20-52c6c37e015c None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:06.852404 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-957747c9-f243-49cd-898e-a681ff432661 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:06.853658 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-957747c9-f243-49cd-898e-a681ff432661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:06.954961 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 197/405] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:00:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:06.962437 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d614e85-29ad-4085-be20-52c6c37e015c None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:06.978795 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957747c9-f243-49cd-898e-a681ff432661 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:07.030389 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df6f82-5ce1-41ad-8d02-f4e818f08365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:07.031622 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df6f82-5ce1-41ad-8d02-f4e818f08365 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:07.032112 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df6f82-5ce1-41ad-8d02-f4e818f08365 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:07.032839 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df6f82-5ce1-41ad-8d02-f4e818f08365 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:07.062700 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4df6f82-5ce1-41ad-8d02-f4e818f08365 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:07.072502 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-a4df6f82-5ce1-41ad-8d02-f4e818f08365 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 03:00:07.072502 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:07.072502 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:07.072502 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:07.072502 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:07.072502 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:07.072502 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:07.072502 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:07.072502 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:07.072502 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:07.072502 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:07.072502 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:07.072502 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:07.072502 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:07.072502 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:07.072502 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:07.075357 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:07.075357 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:07.075357 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:07.075357 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:07.075357 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:07.075357 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:07.075357 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:07.075357 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:07.075357 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:07.075357 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:07.075357 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:07.075357 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:07.075357 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:07.075357 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:07.075357 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:07.075357 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:07.076199 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:07.076199 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:07.076199 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:07.076199 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:07.076199 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:07.076199 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:07.076199 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:07.076199 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:07.076199 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:07.076199 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:07.076199 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 03:00:07.076199 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:07.076199 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 209/406] 10.222.0.65 () {56 vars in 1114 bytes} [Tue May 10 03:00:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:07.079899 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df6f82-5ce1-41ad-8d02-f4e818f08365 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:07.096571 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957747c9-f243-49cd-898e-a681ff432661 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:07.146833 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49194711-9c3f-49a9-91d6-3a2beb7195f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:07.147681 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49194711-9c3f-49a9-91d6-3a2beb7195f3 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:07.147965 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49194711-9c3f-49a9-91d6-3a2beb7195f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:07.148295 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49194711-9c3f-49a9-91d6-3a2beb7195f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:07.175088 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49194711-9c3f-49a9-91d6-3a2beb7195f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:07.183317 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-49194711-9c3f-49a9-91d6-3a2beb7195f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:00:07.183317 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:07.183317 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:07.183317 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:07.183317 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:07.183317 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:07.183317 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:07.183317 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:07.183317 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:07.183317 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:07.183317 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:07.183317 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:07.183317 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:07.183317 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:07.183317 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:07.183317 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:07.184241 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:07.184241 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:07.184241 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:07.184241 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:07.184241 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:07.184241 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:07.184241 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:07.184241 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:07.184241 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:07.184241 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:07.184241 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:07.184241 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:07.184241 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:07.184241 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:07.184241 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:07.184241 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:07.185039 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:07.185039 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:07.185039 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:07.185039 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:07.185039 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:07.185039 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:07.185039 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:07.185039 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:07.185039 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:07.185039 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:07.185039 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:00:07.185039 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:07.192961 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 198/407] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 10 03:00:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:07.195291 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df6f82-5ce1-41ad-8d02-f4e818f08365 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:07.204995 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49194711-9c3f-49a9-91d6-3a2beb7195f3 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:07.237133 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e2c73-f578-47ec-aaec-a5e8e55b62b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:07.238630 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e2c73-f578-47ec-aaec-a5e8e55b62b3 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:07.239949 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e2c73-f578-47ec-aaec-a5e8e55b62b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:07.242114 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e2c73-f578-47ec-aaec-a5e8e55b62b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:07.243102 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84e2c73-f578-47ec-aaec-a5e8e55b62b3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:07.243617 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84e2c73-f578-47ec-aaec-a5e8e55b62b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:07.248636 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84e2c73-f578-47ec-aaec-a5e8e55b62b3 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:07.267573 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 210/408] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 10 03:00:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:07.289743 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e2c73-f578-47ec-aaec-a5e8e55b62b3 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:07.378592 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49194711-9c3f-49a9-91d6-3a2beb7195f3 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:07.414500 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa81f2-83f8-4378-ad9a-3990724e8929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:07.415542 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa81f2-83f8-4378-ad9a-3990724e8929 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:07.416050 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa81f2-83f8-4378-ad9a-3990724e8929 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:07.416532 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa81f2-83f8-4378-ad9a-3990724e8929 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:07.417551 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaa81f2-83f8-4378-ad9a-3990724e8929 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:07.418089 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaa81f2-83f8-4378-ad9a-3990724e8929 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:07.419771 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaa81f2-83f8-4378-ad9a-3990724e8929 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:07.429660 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 199/409] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 10 03:00:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:07.436295 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa81f2-83f8-4378-ad9a-3990724e8929 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:07.490428 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e2c73-f578-47ec-aaec-a5e8e55b62b3 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:07.526085 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438fe03a-0508-4fff-8aa3-7dc8a0c74305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:07.526941 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438fe03a-0508-4fff-8aa3-7dc8a0c74305 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:07.527225 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438fe03a-0508-4fff-8aa3-7dc8a0c74305 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:07.527500 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438fe03a-0508-4fff-8aa3-7dc8a0c74305 None admin] PATH_INFO: `/v3/groups/21312eb024514c1a84d1a2a797d37185` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:07.528708 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438fe03a-0508-4fff-8aa3-7dc8a0c74305 None admin] RBAC: Authorizing `identity:get_group(group_id=21312eb024514c1a84d1a2a797d37185)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:07.530155 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438fe03a-0508-4fff-8aa3-7dc8a0c74305 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:07.532175 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 211/410] 10.222.0.65 () {56 vars in 1180 bytes} [Tue May 10 03:00:07 2022] GET /identity/v3/groups/21312eb024514c1a84d1a2a797d37185 => generated 226 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:07.538806 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438fe03a-0508-4fff-8aa3-7dc8a0c74305 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:07.560217 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa81f2-83f8-4378-ad9a-3990724e8929 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:07.608743 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337fb5c5-5477-4c33-949e-2a1f583ce2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:07.609632 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337fb5c5-5477-4c33-949e-2a1f583ce2db None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:07.609920 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337fb5c5-5477-4c33-949e-2a1f583ce2db None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:07.610201 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337fb5c5-5477-4c33-949e-2a1f583ce2db None admin] PATH_INFO: `/v3/groups/dba083d85f4049b7baeca20d6bd1b039` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:07.617378 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337fb5c5-5477-4c33-949e-2a1f583ce2db None admin] RBAC: Authorizing `identity:get_group(group_id=dba083d85f4049b7baeca20d6bd1b039)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:07.618868 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337fb5c5-5477-4c33-949e-2a1f583ce2db None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:07.620957 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 200/411] 10.222.0.65 () {56 vars in 1180 bytes} [Tue May 10 03:00:07 2022] GET /identity/v3/groups/dba083d85f4049b7baeca20d6bd1b039 => generated 229 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:07.626309 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337fb5c5-5477-4c33-949e-2a1f583ce2db None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:07.673709 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438fe03a-0508-4fff-8aa3-7dc8a0c74305 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:07.721690 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a497e93-23d1-4a5c-ab21-1b5cc0fbea63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:07.722565 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a497e93-23d1-4a5c-ab21-1b5cc0fbea63 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:07.722847 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a497e93-23d1-4a5c-ab21-1b5cc0fbea63 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:07.723120 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a497e93-23d1-4a5c-ab21-1b5cc0fbea63 None admin] PATH_INFO: `/v3/projects/d89ba6f6a62842108d74ca873033ee82` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:07.728812 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a497e93-23d1-4a5c-ab21-1b5cc0fbea63 None admin] RBAC: Authorizing `identity:get_project(project_id=d89ba6f6a62842108d74ca873033ee82)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:07.730271 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a497e93-23d1-4a5c-ab21-1b5cc0fbea63 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:07.732324 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 212/412] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 10 03:00:07 2022] GET /identity/v3/projects/d89ba6f6a62842108d74ca873033ee82 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:07.737495 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a497e93-23d1-4a5c-ab21-1b5cc0fbea63 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:07.746533 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337fb5c5-5477-4c33-949e-2a1f583ce2db None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:07.795157 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e4f767-63b4-409d-b6ba-b4cd825ea811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:07.796067 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4f767-63b4-409d-b6ba-b4cd825ea811 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:07.796357 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4f767-63b4-409d-b6ba-b4cd825ea811 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:07.796636 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4f767-63b4-409d-b6ba-b4cd825ea811 None admin] PATH_INFO: `/v3/projects/b2907edfa2f14a3b85299455266c251c` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:07.800735 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e4f767-63b4-409d-b6ba-b4cd825ea811 None admin] RBAC: Authorizing `identity:get_project(project_id=b2907edfa2f14a3b85299455266c251c)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:07.802288 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e4f767-63b4-409d-b6ba-b4cd825ea811 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:07.804432 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 201/413] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 10 03:00:07 2022] GET /identity/v3/projects/b2907edfa2f14a3b85299455266c251c => generated 344 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:07.812028 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e4f767-63b4-409d-b6ba-b4cd825ea811 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:07.859373 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a497e93-23d1-4a5c-ab21-1b5cc0fbea63 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:07.906117 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d2163f-5529-4f13-b2c3-dd669909c4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:07.907007 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2163f-5529-4f13-b2c3-dd669909c4e3 None admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:07.907290 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2163f-5529-4f13-b2c3-dd669909c4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:07.907820 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2163f-5529-4f13-b2c3-dd669909c4e3 None admin] PATH_INFO: `/v3/projects/d89ba6f6a62842108d74ca873033ee82/groups/21312eb024514c1a84d1a2a797d37185/roles/b2cf4d51cc0b4532adcb7021d474177e` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:07.916797 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d2163f-5529-4f13-b2c3-dd669909c4e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=d89ba6f6a62842108d74ca873033ee82, group_id=21312eb024514c1a84d1a2a797d37185, role_id=b2cf4d51cc0b4532adcb7021d474177e)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:07.918240 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d2163f-5529-4f13-b2c3-dd669909c4e3 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:07.950719 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e4f767-63b4-409d-b6ba-b4cd825ea811 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:07.984960 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ec7ef1-9d12-4e11-98d3-606b300d19ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:07.985845 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec7ef1-9d12-4e11-98d3-606b300d19ad None admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:07.986133 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec7ef1-9d12-4e11-98d3-606b300d19ad None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:07.986409 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec7ef1-9d12-4e11-98d3-606b300d19ad None admin] PATH_INFO: `/v3/projects/b2907edfa2f14a3b85299455266c251c/groups/dba083d85f4049b7baeca20d6bd1b039/roles/43105000610f402ca2486e7648018cca` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:07.988595 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ec7ef1-9d12-4e11-98d3-606b300d19ad None admin] RBAC: Authorizing `identity:create_grant(project_id=b2907edfa2f14a3b85299455266c251c, group_id=dba083d85f4049b7baeca20d6bd1b039, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:07.993500 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ec7ef1-9d12-4e11-98d3-606b300d19ad None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:08.011590 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 213/414] 10.222.0.65 () {58 vars in 1442 bytes} [Tue May 10 03:00:07 2022] PUT /identity/v3/projects/d89ba6f6a62842108d74ca873033ee82/groups/21312eb024514c1a84d1a2a797d37185/roles/b2cf4d51cc0b4532adcb7021d474177e => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:00:08.017834 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4133a51e-6dba-4788-a657-8f41a68cb633 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:08.018125 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4133a51e-6dba-4788-a657-8f41a68cb633 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:08.018502 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4133a51e-6dba-4788-a657-8f41a68cb633 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:08.019899 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 214/415] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:00:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:08.030620 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd244fa4-34ef-4873-8488-6c0335552155 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:08.030941 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd244fa4-34ef-4873-8488-6c0335552155 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:08.031195 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd244fa4-34ef-4873-8488-6c0335552155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:08.052454 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-fd244fa4-34ef-4873-8488-6c0335552155 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:08.053752 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-fd244fa4-34ef-4873-8488-6c0335552155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:08.086532 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 202/416] 10.222.0.65 () {58 vars in 1442 bytes} [Tue May 10 03:00:07 2022] PUT /identity/v3/projects/b2907edfa2f14a3b85299455266c251c/groups/dba083d85f4049b7baeca20d6bd1b039/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:00:08.158144 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 215/417] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:00:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 03:00:08.184606 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ec7ef1-9d12-4e11-98d3-606b300d19ad None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:08.301562 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ec7ef1-9d12-4e11-98d3-606b300d19ad None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:08.348903 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8811b81-9252-4c2a-b4a5-0ea7b2663b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:08.350120 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8811b81-9252-4c2a-b4a5-0ea7b2663b64 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:08.350661 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8811b81-9252-4c2a-b4a5-0ea7b2663b64 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:08.351136 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8811b81-9252-4c2a-b4a5-0ea7b2663b64 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:08.368092 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8811b81-9252-4c2a-b4a5-0ea7b2663b64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:08.375828 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-b8811b81-9252-4c2a-b4a5-0ea7b2663b64 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 03:00:08.375828 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:08.375828 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:08.375828 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:08.375828 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:08.375828 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:08.375828 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:08.375828 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:08.375828 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:08.375828 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:08.375828 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:08.375828 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:08.375828 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:08.375828 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:08.375828 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:08.375828 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:08.376755 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:08.376755 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:08.376755 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:08.376755 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:08.376755 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:08.376755 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:08.376755 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:08.376755 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:08.376755 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:08.376755 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:08.376755 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:08.376755 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:08.376755 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:08.376755 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:08.376755 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:08.376755 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:08.377560 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:08.377560 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:08.377560 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:08.377560 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:08.377560 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:08.377560 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:08.377560 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:08.377560 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:08.377560 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:08.377560 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:08.377560 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 03:00:08.377560 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:08.378675 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 203/418] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 10 03:00:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:08.384038 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd244fa4-34ef-4873-8488-6c0335552155 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:08.486400 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd244fa4-34ef-4873-8488-6c0335552155 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:08.529316 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e729b54-d6e6-4341-82e8-1760102dd0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:08.530134 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e729b54-d6e6-4341-82e8-1760102dd0dc None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:08.530299 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e729b54-d6e6-4341-82e8-1760102dd0dc None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:08.530569 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e729b54-d6e6-4341-82e8-1760102dd0dc None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:08.531334 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e729b54-d6e6-4341-82e8-1760102dd0dc None admin] RBAC: Adding query filter params (name=member) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:08.531645 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e729b54-d6e6-4341-82e8-1760102dd0dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:08.533329 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e729b54-d6e6-4341-82e8-1760102dd0dc None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:08.542329 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 216/419] 10.222.0.65 () {56 vars in 1101 bytes} [Tue May 10 03:00:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:08.547919 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8811b81-9252-4c2a-b4a5-0ea7b2663b64 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:08.680554 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8811b81-9252-4c2a-b4a5-0ea7b2663b64 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:08.730996 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f214b9-7a47-4a19-a00b-263ff66e2ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:08.732022 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f214b9-7a47-4a19-a00b-263ff66e2ca9 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:08.732515 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f214b9-7a47-4a19-a00b-263ff66e2ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:08.732989 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f214b9-7a47-4a19-a00b-263ff66e2ca9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:08.835743 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f214b9-7a47-4a19-a00b-263ff66e2ca9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:08.837595 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f214b9-7a47-4a19-a00b-263ff66e2ca9 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:08.983899 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 204/420] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 10 03:00:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 03:00:08.989212 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e729b54-d6e6-4341-82e8-1760102dd0dc None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:09.107879 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e729b54-d6e6-4341-82e8-1760102dd0dc None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:09.147400 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8fb8dc-a648-4213-8c13-9b7f2689b813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:09.148298 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8fb8dc-a648-4213-8c13-9b7f2689b813 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:09.148575 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8fb8dc-a648-4213-8c13-9b7f2689b813 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:09.148844 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8fb8dc-a648-4213-8c13-9b7f2689b813 None admin] PATH_INFO: `/v3/projects/2db4f8a4c66d4ca684aabd3e75eafbc2` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:09.150024 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8fb8dc-a648-4213-8c13-9b7f2689b813 None admin] RBAC: Authorizing `identity:get_project(project_id=2db4f8a4c66d4ca684aabd3e75eafbc2)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:09.151444 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8fb8dc-a648-4213-8c13-9b7f2689b813 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:09.153316 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 217/421] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 10 03:00:08 2022] GET /identity/v3/projects/2db4f8a4c66d4ca684aabd3e75eafbc2 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:09.158756 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f214b9-7a47-4a19-a00b-263ff66e2ca9 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:09.234357 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c6616-8776-43c2-8852-ebb3b26d12f2 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:09.234590 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c6616-8776-43c2-8852-ebb3b26d12f2 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:09.234863 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c6616-8776-43c2-8852-ebb3b26d12f2 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:09.236370 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 218/422] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:00:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:00:09.242886 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b2d96-73f8-4eb5-9ecb-eab9ecadb248 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:09.243705 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b2d96-73f8-4eb5-9ecb-eab9ecadb248 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:09.244218 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b2d96-73f8-4eb5-9ecb-eab9ecadb248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:09.264586 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-dc4b2d96-73f8-4eb5-9ecb-eab9ecadb248 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:09.267057 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-dc4b2d96-73f8-4eb5-9ecb-eab9ecadb248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:09.320069 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f214b9-7a47-4a19-a00b-263ff66e2ca9 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:09.392988 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff4ef3-d8c8-460b-8d33-bca868325469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:09.393846 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff4ef3-d8c8-460b-8d33-bca868325469 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:09.394129 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff4ef3-d8c8-460b-8d33-bca868325469 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:09.394404 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff4ef3-d8c8-460b-8d33-bca868325469 None admin] PATH_INFO: `/v3/groups/21312eb024514c1a84d1a2a797d37185` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:09.396690 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ff4ef3-d8c8-460b-8d33-bca868325469 None admin] RBAC: Authorizing `identity:get_group(group_id=21312eb024514c1a84d1a2a797d37185)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:09.398680 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ff4ef3-d8c8-460b-8d33-bca868325469 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:09.401717 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 219/423] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:00:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:09.403263 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 205/424] 10.222.0.65 () {56 vars in 1180 bytes} [Tue May 10 03:00:09 2022] GET /identity/v3/groups/21312eb024514c1a84d1a2a797d37185 => generated 226 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:09.410391 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b2d96-73f8-4eb5-9ecb-eab9ecadb248 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:09.425498 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff4ef3-d8c8-460b-8d33-bca868325469 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:09.517608 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b2d96-73f8-4eb5-9ecb-eab9ecadb248 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:09.557241 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d743b82-a7d6-4e7f-9c2e-a80172993106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:09.557886 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d743b82-a7d6-4e7f-9c2e-a80172993106 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:09.561816 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d743b82-a7d6-4e7f-9c2e-a80172993106 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:09.561816 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d743b82-a7d6-4e7f-9c2e-a80172993106 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:09.561816 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d743b82-a7d6-4e7f-9c2e-a80172993106 None admin] RBAC: Adding query filter params (group.id=21312eb024514c1a84d1a2a797d37185, role.id=bab81fd8d58945b8a1ea63c93b3b4857, scope.project.id=2db4f8a4c66d4ca684aabd3e75eafbc2) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:09.561816 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d743b82-a7d6-4e7f-9c2e-a80172993106 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:09.561816 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d743b82-a7d6-4e7f-9c2e-a80172993106 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:09.576189 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 220/425] 10.222.0.65 () {56 vars in 1376 bytes} [Tue May 10 03:00:09 2022] GET /identity/v3/role_assignments?group.id=21312eb024514c1a84d1a2a797d37185&scope.project.id=2db4f8a4c66d4ca684aabd3e75eafbc2&role.id=bab81fd8d58945b8a1ea63c93b3b4857 => generated 611 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:09.577714 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092680b-296b-4e3a-8b88-cbb9c65aa4af None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:09.579173 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092680b-296b-4e3a-8b88-cbb9c65aa4af None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:09.579173 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092680b-296b-4e3a-8b88-cbb9c65aa4af None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:09.579923 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 221/426] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:00:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:09.586081 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc842372-4111-4ec2-a52c-33b9f97607f7 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:09.586364 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc842372-4111-4ec2-a52c-33b9f97607f7 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:09.586563 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc842372-4111-4ec2-a52c-33b9f97607f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:09.605422 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff4ef3-d8c8-460b-8d33-bca868325469 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:09.616421 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-fc842372-4111-4ec2-a52c-33b9f97607f7 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:09.617696 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-fc842372-4111-4ec2-a52c-33b9f97607f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:09.649362 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919b4da5-54e7-4218-bd75-e7055962cbd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:09.650205 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b4da5-54e7-4218-bd75-e7055962cbd7 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:09.650487 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b4da5-54e7-4218-bd75-e7055962cbd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:09.650759 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b4da5-54e7-4218-bd75-e7055962cbd7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:09.678223 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919b4da5-54e7-4218-bd75-e7055962cbd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:09.686564 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-919b4da5-54e7-4218-bd75-e7055962cbd7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 03:00:09.686564 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:09.686564 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:09.686564 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:09.686564 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:09.686564 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:09.686564 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:09.686564 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:09.686564 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:09.686564 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:09.686564 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:09.686564 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:09.686564 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:09.686564 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:09.686564 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:09.686564 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:09.687528 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:09.687528 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:09.687528 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:09.687528 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:09.687528 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:09.687528 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:09.687528 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:09.687528 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:09.687528 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:09.687528 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:09.687528 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:09.687528 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:09.687528 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:09.687528 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:09.687528 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:09.687528 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:09.688366 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:09.688366 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:09.688366 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:09.688366 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:09.688366 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:09.688366 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:09.688366 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:09.688366 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:09.688366 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:09.688366 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:09.688366 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 03:00:09.688366 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:09.702304 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 206/427] 10.222.0.65 () {56 vars in 1114 bytes} [Tue May 10 03:00:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:00:09.703219 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919b4da5-54e7-4218-bd75-e7055962cbd7 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:09.774595 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 222/428] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:00:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 03:00:09.820746 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919b4da5-54e7-4218-bd75-e7055962cbd7 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:09.825717 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc842372-4111-4ec2-a52c-33b9f97607f7 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:09.864625 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b967d-7db3-4574-88f8-a70d2602c30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:09.865314 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b967d-7db3-4574-88f8-a70d2602c30c None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:09.865597 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b967d-7db3-4574-88f8-a70d2602c30c None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:09.865870 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b967d-7db3-4574-88f8-a70d2602c30c None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:09.866666 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3b967d-7db3-4574-88f8-a70d2602c30c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:09.866972 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3b967d-7db3-4574-88f8-a70d2602c30c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:09.868382 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3b967d-7db3-4574-88f8-a70d2602c30c None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:09.877155 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 207/429] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 10 03:00:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:09.883704 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b967d-7db3-4574-88f8-a70d2602c30c None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:09.963147 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc842372-4111-4ec2-a52c-33b9f97607f7 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:10.003265 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba72e9-a44a-46b0-a801-c49e6fb52bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:10.004158 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba72e9-a44a-46b0-a801-c49e6fb52bce None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:10.004637 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba72e9-a44a-46b0-a801-c49e6fb52bce None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:10.004743 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b967d-7db3-4574-88f8-a70d2602c30c None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:10.004947 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba72e9-a44a-46b0-a801-c49e6fb52bce None admin] PATH_INFO: `/v3/roles/member` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:10.017653 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ba72e9-a44a-46b0-a801-c49e6fb52bce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:10.027796 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-a9ba72e9-a44a-46b0-a801-c49e6fb52bce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 03:00:10.027796 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:10.027796 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:10.027796 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:10.027796 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:10.027796 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:10.027796 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:10.027796 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:10.027796 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:10.027796 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:10.027796 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:10.027796 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:10.027796 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:10.027796 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:10.027796 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:10.027796 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:10.028702 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:10.028702 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:10.028702 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:10.028702 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:10.028702 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:10.028702 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:10.028702 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:10.028702 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:10.028702 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:10.028702 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:10.028702 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:10.028702 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:10.028702 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:10.028702 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:10.028702 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:10.028702 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:10.029493 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:10.029493 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:10.029493 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:10.029493 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:10.029493 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:10.029493 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:10.029493 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:10.029493 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:10.029493 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:10.029493 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:10.029493 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 03:00:10.029493 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:10.029493 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 223/430] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 10 03:00:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:00:10.035157 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba72e9-a44a-46b0-a801-c49e6fb52bce None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:10.044146 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb22b01-0d9c-480b-ba13-a3ba53a099ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:10.044808 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb22b01-0d9c-480b-ba13-a3ba53a099ed None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:10.045090 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb22b01-0d9c-480b-ba13-a3ba53a099ed None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:10.045377 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb22b01-0d9c-480b-ba13-a3ba53a099ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:10.114436 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb22b01-0d9c-480b-ba13-a3ba53a099ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:10.115901 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb22b01-0d9c-480b-ba13-a3ba53a099ed None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:10.151073 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba72e9-a44a-46b0-a801-c49e6fb52bce None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:10.193259 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13018a2-d396-48de-b8a9-be59c66f054c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:10.193928 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13018a2-d396-48de-b8a9-be59c66f054c None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:10.194818 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13018a2-d396-48de-b8a9-be59c66f054c None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:10.195100 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13018a2-d396-48de-b8a9-be59c66f054c None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:10.195853 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13018a2-d396-48de-b8a9-be59c66f054c None admin] RBAC: Adding query filter params (name=member) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:10.196182 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13018a2-d396-48de-b8a9-be59c66f054c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:10.197653 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13018a2-d396-48de-b8a9-be59c66f054c None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:10.206385 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 224/431] 10.222.0.65 () {56 vars in 1101 bytes} [Tue May 10 03:00:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:10.217002 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13018a2-d396-48de-b8a9-be59c66f054c None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:10.223097 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 208/432] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 10 03:00:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 03:00:10.228815 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb22b01-0d9c-480b-ba13-a3ba53a099ed None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:10.336139 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb22b01-0d9c-480b-ba13-a3ba53a099ed None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:10.342861 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13018a2-d396-48de-b8a9-be59c66f054c None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:10.381358 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6c4c0b-a681-40a9-add9-ec6d0d451239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:10.382816 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c4c0b-a681-40a9-add9-ec6d0d451239 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:10.383100 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c4c0b-a681-40a9-add9-ec6d0d451239 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:10.383373 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c4c0b-a681-40a9-add9-ec6d0d451239 None admin] PATH_INFO: `/v3/projects/2db4f8a4c66d4ca684aabd3e75eafbc2` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:10.385046 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6c4c0b-a681-40a9-add9-ec6d0d451239 None admin] RBAC: Authorizing `identity:get_project(project_id=2db4f8a4c66d4ca684aabd3e75eafbc2)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:10.386515 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6c4c0b-a681-40a9-add9-ec6d0d451239 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:10.388570 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 209/433] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 10 03:00:10 2022] GET /identity/v3/projects/2db4f8a4c66d4ca684aabd3e75eafbc2 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:10.393957 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6c4c0b-a681-40a9-add9-ec6d0d451239 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:10.399591 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10299267-98ee-4690-a52d-73cb7ad48014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:10.400551 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10299267-98ee-4690-a52d-73cb7ad48014 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:10.401069 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10299267-98ee-4690-a52d-73cb7ad48014 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:10.401544 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10299267-98ee-4690-a52d-73cb7ad48014 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:10.475067 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10299267-98ee-4690-a52d-73cb7ad48014 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:10.477434 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10299267-98ee-4690-a52d-73cb7ad48014 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:10.499231 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6c4c0b-a681-40a9-add9-ec6d0d451239 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:10.536192 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb7a6c-9d9e-4c94-8ee0-c4ac68409501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:10.537145 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb7a6c-9d9e-4c94-8ee0-c4ac68409501 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:10.537431 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb7a6c-9d9e-4c94-8ee0-c4ac68409501 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:10.537706 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb7a6c-9d9e-4c94-8ee0-c4ac68409501 None admin] PATH_INFO: `/v3/groups/21312eb024514c1a84d1a2a797d37185` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:10.539459 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb7a6c-9d9e-4c94-8ee0-c4ac68409501 None admin] RBAC: Authorizing `identity:get_group(group_id=21312eb024514c1a84d1a2a797d37185)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:10.540939 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb7a6c-9d9e-4c94-8ee0-c4ac68409501 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:10.542873 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 210/434] 10.222.0.65 () {56 vars in 1180 bytes} [Tue May 10 03:00:10 2022] GET /identity/v3/groups/21312eb024514c1a84d1a2a797d37185 => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:10.548542 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb7a6c-9d9e-4c94-8ee0-c4ac68409501 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:10.584549 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 225/435] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 10 03:00:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 03:00:10.591572 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10299267-98ee-4690-a52d-73cb7ad48014 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:10.664117 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb7a6c-9d9e-4c94-8ee0-c4ac68409501 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:10.709626 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a3ae8-03f6-410f-a6b6-f464091b8f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:10.710674 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a3ae8-03f6-410f-a6b6-f464091b8f96 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:10.710966 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a3ae8-03f6-410f-a6b6-f464091b8f96 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:10.711528 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a3ae8-03f6-410f-a6b6-f464091b8f96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:10.712601 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9a3ae8-03f6-410f-a6b6-f464091b8f96 None admin] RBAC: Adding query filter params (group.id=21312eb024514c1a84d1a2a797d37185, role.id=b2cf4d51cc0b4532adcb7021d474177e, scope.project.id=2db4f8a4c66d4ca684aabd3e75eafbc2) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:10.712920 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9a3ae8-03f6-410f-a6b6-f464091b8f96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:10.714956 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9a3ae8-03f6-410f-a6b6-f464091b8f96 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:10.715953 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10299267-98ee-4690-a52d-73cb7ad48014 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:10.722574 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 211/436] 10.222.0.65 () {56 vars in 1376 bytes} [Tue May 10 03:00:10 2022] GET /identity/v3/role_assignments?group.id=21312eb024514c1a84d1a2a797d37185&scope.project.id=2db4f8a4c66d4ca684aabd3e75eafbc2&role.id=b2cf4d51cc0b4532adcb7021d474177e => generated 611 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:10.759730 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee70e71-01cb-41df-a842-1071ecf180bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:10.760647 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee70e71-01cb-41df-a842-1071ecf180bb None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:10.760927 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee70e71-01cb-41df-a842-1071ecf180bb None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:10.761200 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee70e71-01cb-41df-a842-1071ecf180bb None admin] PATH_INFO: `/v3/projects/d89ba6f6a62842108d74ca873033ee82` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:10.762491 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee70e71-01cb-41df-a842-1071ecf180bb None admin] RBAC: Authorizing `identity:get_project(project_id=d89ba6f6a62842108d74ca873033ee82)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:10.763957 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee70e71-01cb-41df-a842-1071ecf180bb None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:10.766100 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 226/437] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 10 03:00:10 2022] GET /identity/v3/projects/d89ba6f6a62842108d74ca873033ee82 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:10.771638 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a3ae8-03f6-410f-a6b6-f464091b8f96 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:10.883925 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd06458-e736-4c33-8712-d507a875355f None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:10.884283 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd06458-e736-4c33-8712-d507a875355f None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:10.884500 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd06458-e736-4c33-8712-d507a875355f None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:10.886060 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 227/438] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:00:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:00:10.891895 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b49b29-1a0d-41db-b034-5972383f81a4 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:10.892516 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b49b29-1a0d-41db-b034-5972383f81a4 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:10.893020 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b49b29-1a0d-41db-b034-5972383f81a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:10.896266 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a3ae8-03f6-410f-a6b6-f464091b8f96 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:10.918425 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-c5b49b29-1a0d-41db-b034-5972383f81a4 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:10.920264 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-c5b49b29-1a0d-41db-b034-5972383f81a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:10.934157 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d729ee9-3fee-4336-b4ad-1bf6ce48373a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:10.935379 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d729ee9-3fee-4336-b4ad-1bf6ce48373a None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:10.935872 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d729ee9-3fee-4336-b4ad-1bf6ce48373a None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:10.936342 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d729ee9-3fee-4336-b4ad-1bf6ce48373a None admin] PATH_INFO: `/v3/groups/21312eb024514c1a84d1a2a797d37185` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:10.937754 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d729ee9-3fee-4336-b4ad-1bf6ce48373a None admin] RBAC: Authorizing `identity:get_group(group_id=21312eb024514c1a84d1a2a797d37185)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:10.939495 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d729ee9-3fee-4336-b4ad-1bf6ce48373a None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:10.941627 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 212/439] 10.222.0.65 () {56 vars in 1180 bytes} [Tue May 10 03:00:10 2022] GET /identity/v3/groups/21312eb024514c1a84d1a2a797d37185 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:10.947359 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d729ee9-3fee-4336-b4ad-1bf6ce48373a None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:11.000858 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 228/440] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:00:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 03:00:11.023581 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d9d73-4462-40dc-bb4b-d5fbf57f18f4 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:11.023870 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d9d73-4462-40dc-bb4b-d5fbf57f18f4 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:11.024182 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d9d73-4462-40dc-bb4b-d5fbf57f18f4 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:11.025529 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 229/441] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:00:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:00:11.028501 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937d9d73-4462-40dc-bb4b-d5fbf57f18f4 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:11.062270 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d729ee9-3fee-4336-b4ad-1bf6ce48373a None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:11.100189 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95341d3-a4df-4119-b483-ecc9ecdfcab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:11.100923 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95341d3-a4df-4119-b483-ecc9ecdfcab3 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:11.101215 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95341d3-a4df-4119-b483-ecc9ecdfcab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:11.101489 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95341d3-a4df-4119-b483-ecc9ecdfcab3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:11.102328 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95341d3-a4df-4119-b483-ecc9ecdfcab3 None admin] RBAC: Adding query filter params (group.id=21312eb024514c1a84d1a2a797d37185, role.id=bab81fd8d58945b8a1ea63c93b3b4857, scope.project.id=d89ba6f6a62842108d74ca873033ee82) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:11.102637 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95341d3-a4df-4119-b483-ecc9ecdfcab3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:11.104450 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95341d3-a4df-4119-b483-ecc9ecdfcab3 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:11.111085 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 213/442] 10.222.0.65 () {56 vars in 1376 bytes} [Tue May 10 03:00:10 2022] GET /identity/v3/role_assignments?group.id=21312eb024514c1a84d1a2a797d37185&scope.project.id=d89ba6f6a62842108d74ca873033ee82&role.id=bab81fd8d58945b8a1ea63c93b3b4857 => generated 611 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:11.112972 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bde173-90a2-4b54-a597-5ed8151042eb None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:11.112972 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bde173-90a2-4b54-a597-5ed8151042eb None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:11.112972 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bde173-90a2-4b54-a597-5ed8151042eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:11.134780 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-10bde173-90a2-4b54-a597-5ed8151042eb None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:11.136930 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-10bde173-90a2-4b54-a597-5ed8151042eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:11.150219 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937d9d73-4462-40dc-bb4b-d5fbf57f18f4 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:11.198146 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6a98ee-c0d6-4323-ac6f-8f7e25769605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:11.199077 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a98ee-c0d6-4323-ac6f-8f7e25769605 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:11.199365 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a98ee-c0d6-4323-ac6f-8f7e25769605 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:11.199642 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a98ee-c0d6-4323-ac6f-8f7e25769605 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:11.218436 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6a98ee-c0d6-4323-ac6f-8f7e25769605 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:11.219479 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 214/443] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:00:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:11.229869 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-0b6a98ee-c0d6-4323-ac6f-8f7e25769605 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 03:00:11.229869 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:11.229869 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:11.229869 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:11.229869 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:11.229869 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:11.229869 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:11.229869 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:11.229869 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:11.229869 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:11.229869 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:11.229869 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:11.229869 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:11.229869 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:11.229869 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:11.229869 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:11.230860 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:11.230860 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:11.230860 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:11.230860 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:11.230860 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:11.230860 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:11.230860 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:11.230860 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:11.230860 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:11.230860 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:11.230860 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:11.230860 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:11.230860 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:11.230860 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:11.230860 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:11.230860 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:11.231647 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:11.231647 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:11.231647 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:11.231647 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:11.231647 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:11.231647 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:11.231647 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:11.231647 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:11.231647 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:11.231647 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:11.231647 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 03:00:11.231647 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:11.231647 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 230/444] 10.222.0.65 () {56 vars in 1114 bytes} [Tue May 10 03:00:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:11.237360 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bde173-90a2-4b54-a597-5ed8151042eb None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:11.245289 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6a98ee-c0d6-4323-ac6f-8f7e25769605 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:11.341963 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bde173-90a2-4b54-a597-5ed8151042eb None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:11.354841 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6a98ee-c0d6-4323-ac6f-8f7e25769605 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:11.380250 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcfe72c-976c-4007-9397-bdd0a9a4d4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:11.381024 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcfe72c-976c-4007-9397-bdd0a9a4d4f9 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:11.381307 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcfe72c-976c-4007-9397-bdd0a9a4d4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:11.381586 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcfe72c-976c-4007-9397-bdd0a9a4d4f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:11.382620 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcfe72c-976c-4007-9397-bdd0a9a4d4f9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:11.384119 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcfe72c-976c-4007-9397-bdd0a9a4d4f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:11.384300 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcfe72c-976c-4007-9397-bdd0a9a4d4f9 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:11.390230 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fbd008-1ea3-4181-81b3-244389d0ee8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:11.390959 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fbd008-1ea3-4181-81b3-244389d0ee8f None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:11.391240 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fbd008-1ea3-4181-81b3-244389d0ee8f None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:11.391511 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fbd008-1ea3-4181-81b3-244389d0ee8f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:11.393026 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 215/445] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 10 03:00:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:11.398218 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcfe72c-976c-4007-9397-bdd0a9a4d4f9 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:11.402217 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fbd008-1ea3-4181-81b3-244389d0ee8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:11.410335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-73fbd008-1ea3-4181-81b3-244389d0ee8f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:00:11.410335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:11.410335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:11.410335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:11.410335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:11.410335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:11.410335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:11.410335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:11.410335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:11.410335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:11.410335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:11.410335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:11.410335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:11.410335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:11.410335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:11.410335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:11.411216 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:11.411216 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:11.411216 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:11.411216 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:11.411216 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:11.411216 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:11.411216 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:11.411216 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:11.411216 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:11.411216 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:11.411216 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:11.411216 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:11.411216 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:11.411216 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:11.411216 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:11.411216 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:11.412333 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:11.412333 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:11.412333 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:11.412333 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:11.412333 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:11.412333 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:11.412333 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:11.412333 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:11.412333 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:11.412333 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:11.412333 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:00:11.412333 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:11.412333 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 231/446] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 10 03:00:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:00:11.418540 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fbd008-1ea3-4181-81b3-244389d0ee8f None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:11.516731 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcfe72c-976c-4007-9397-bdd0a9a4d4f9 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:11.533173 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fbd008-1ea3-4181-81b3-244389d0ee8f None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:11.550299 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7994382-0b84-43cc-9703-56d71fcbad6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:11.550947 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7994382-0b84-43cc-9703-56d71fcbad6c None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:11.551229 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7994382-0b84-43cc-9703-56d71fcbad6c None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:11.551501 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7994382-0b84-43cc-9703-56d71fcbad6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:11.564681 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a601b2-963c-48c3-ab7c-946b3cb17257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:11.565339 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a601b2-963c-48c3-ab7c-946b3cb17257 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:11.565628 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a601b2-963c-48c3-ab7c-946b3cb17257 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:11.565907 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a601b2-963c-48c3-ab7c-946b3cb17257 None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:11.566658 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a601b2-963c-48c3-ab7c-946b3cb17257 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:11.566974 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a601b2-963c-48c3-ab7c-946b3cb17257 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:11.568362 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a601b2-963c-48c3-ab7c-946b3cb17257 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:11.576204 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 232/447] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 10 03:00:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:11.581594 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a601b2-963c-48c3-ab7c-946b3cb17257 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:11.614940 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7994382-0b84-43cc-9703-56d71fcbad6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:11.616472 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7994382-0b84-43cc-9703-56d71fcbad6c None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:11.675004 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a601b2-963c-48c3-ab7c-946b3cb17257 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:11.705378 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566d4b0-4ea1-41a2-9058-d136dfc24299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:11.706005 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566d4b0-4ea1-41a2-9058-d136dfc24299 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:11.706286 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566d4b0-4ea1-41a2-9058-d136dfc24299 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:11.706561 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566d4b0-4ea1-41a2-9058-d136dfc24299 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:11.708508 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 216/448] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 10 03:00:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 03:00:11.714492 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7994382-0b84-43cc-9703-56d71fcbad6c None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:11.768868 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c566d4b0-4ea1-41a2-9058-d136dfc24299 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:11.770315 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c566d4b0-4ea1-41a2-9058-d136dfc24299 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:11.805673 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7994382-0b84-43cc-9703-56d71fcbad6c None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:11.837252 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47e63ed-07da-4d9e-aebf-76a0e63512b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:11.838106 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e63ed-07da-4d9e-aebf-76a0e63512b1 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:11.838388 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e63ed-07da-4d9e-aebf-76a0e63512b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:11.838665 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e63ed-07da-4d9e-aebf-76a0e63512b1 None admin] PATH_INFO: `/v3/projects/d89ba6f6a62842108d74ca873033ee82` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:11.839840 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47e63ed-07da-4d9e-aebf-76a0e63512b1 None admin] RBAC: Authorizing `identity:get_project(project_id=d89ba6f6a62842108d74ca873033ee82)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:11.841381 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47e63ed-07da-4d9e-aebf-76a0e63512b1 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:11.843060 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 217/449] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 10 03:00:11 2022] GET /identity/v3/projects/d89ba6f6a62842108d74ca873033ee82 => generated 302 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:11.848381 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47e63ed-07da-4d9e-aebf-76a0e63512b1 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:11.862301 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 233/450] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 10 03:00:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 03:00:11.867592 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566d4b0-4ea1-41a2-9058-d136dfc24299 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:11.941271 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47e63ed-07da-4d9e-aebf-76a0e63512b1 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:11.958423 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566d4b0-4ea1-41a2-9058-d136dfc24299 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:11.973160 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423118ef-c259-4478-91de-e2587cf248a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:11.973996 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423118ef-c259-4478-91de-e2587cf248a3 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:11.974270 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423118ef-c259-4478-91de-e2587cf248a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:11.974540 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423118ef-c259-4478-91de-e2587cf248a3 None admin] PATH_INFO: `/v3/groups/21312eb024514c1a84d1a2a797d37185` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:11.975699 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423118ef-c259-4478-91de-e2587cf248a3 None admin] RBAC: Authorizing `identity:get_group(group_id=21312eb024514c1a84d1a2a797d37185)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:11.977161 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423118ef-c259-4478-91de-e2587cf248a3 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:11.983378 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 218/451] 10.222.0.65 () {56 vars in 1180 bytes} [Tue May 10 03:00:11 2022] GET /identity/v3/groups/21312eb024514c1a84d1a2a797d37185 => generated 226 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:11.984338 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423118ef-c259-4478-91de-e2587cf248a3 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:11.990281 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d71eb61-f310-422c-9984-fb017ba278e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:11.991128 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71eb61-f310-422c-9984-fb017ba278e3 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:11.991408 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71eb61-f310-422c-9984-fb017ba278e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:11.991681 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71eb61-f310-422c-9984-fb017ba278e3 None admin] PATH_INFO: `/v3/projects/b2907edfa2f14a3b85299455266c251c` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:11.992902 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d71eb61-f310-422c-9984-fb017ba278e3 None admin] RBAC: Authorizing `identity:get_project(project_id=b2907edfa2f14a3b85299455266c251c)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:11.994316 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d71eb61-f310-422c-9984-fb017ba278e3 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:11.995979 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 234/452] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 10 03:00:11 2022] GET /identity/v3/projects/b2907edfa2f14a3b85299455266c251c => generated 344 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:12.001192 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d71eb61-f310-422c-9984-fb017ba278e3 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:12.080921 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423118ef-c259-4478-91de-e2587cf248a3 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:12.094840 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d71eb61-f310-422c-9984-fb017ba278e3 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:12.112968 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd0f26e-ded7-49fb-83ec-6d353bbd2233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:12.113621 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0f26e-ded7-49fb-83ec-6d353bbd2233 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:12.113901 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0f26e-ded7-49fb-83ec-6d353bbd2233 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:12.114176 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0f26e-ded7-49fb-83ec-6d353bbd2233 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:12.115011 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd0f26e-ded7-49fb-83ec-6d353bbd2233 None admin] RBAC: Adding query filter params (group.id=21312eb024514c1a84d1a2a797d37185, role.id=b2cf4d51cc0b4532adcb7021d474177e, scope.project.id=d89ba6f6a62842108d74ca873033ee82) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:12.115323 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd0f26e-ded7-49fb-83ec-6d353bbd2233 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:12.116813 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd0f26e-ded7-49fb-83ec-6d353bbd2233 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:12.122415 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 219/453] 10.222.0.65 () {56 vars in 1376 bytes} [Tue May 10 03:00:11 2022] GET /identity/v3/role_assignments?group.id=21312eb024514c1a84d1a2a797d37185&scope.project.id=d89ba6f6a62842108d74ca873033ee82&role.id=b2cf4d51cc0b4532adcb7021d474177e => generated 611 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:12.127299 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87bf07f-b885-49c7-ac4a-ebb98fb29a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:12.128198 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87bf07f-b885-49c7-ac4a-ebb98fb29a1a None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:12.128484 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87bf07f-b885-49c7-ac4a-ebb98fb29a1a None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:12.128758 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87bf07f-b885-49c7-ac4a-ebb98fb29a1a None admin] PATH_INFO: `/v3/groups/dba083d85f4049b7baeca20d6bd1b039` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:12.129999 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87bf07f-b885-49c7-ac4a-ebb98fb29a1a None admin] RBAC: Authorizing `identity:get_group(group_id=dba083d85f4049b7baeca20d6bd1b039)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:12.131462 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87bf07f-b885-49c7-ac4a-ebb98fb29a1a None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:12.133735 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 235/454] 10.222.0.65 () {56 vars in 1180 bytes} [Tue May 10 03:00:12 2022] GET /identity/v3/groups/dba083d85f4049b7baeca20d6bd1b039 => generated 229 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:12.139795 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd0f26e-ded7-49fb-83ec-6d353bbd2233 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:12.241182 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd0f26e-ded7-49fb-83ec-6d353bbd2233 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:12.275860 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37690066-57e2-4d71-a745-2ee3ada3aac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:12.276553 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37690066-57e2-4d71-a745-2ee3ada3aac3 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:12.276836 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37690066-57e2-4d71-a745-2ee3ada3aac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:12.277108 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37690066-57e2-4d71-a745-2ee3ada3aac3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:12.277949 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37690066-57e2-4d71-a745-2ee3ada3aac3 None admin] RBAC: Adding query filter params (group.id=dba083d85f4049b7baeca20d6bd1b039, role.id=43105000610f402ca2486e7648018cca, scope.project.id=b2907edfa2f14a3b85299455266c251c) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:12.278260 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37690066-57e2-4d71-a745-2ee3ada3aac3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:12.279719 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37690066-57e2-4d71-a745-2ee3ada3aac3 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:12.286366 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 220/455] 10.222.0.65 () {56 vars in 1376 bytes} [Tue May 10 03:00:12 2022] GET /identity/v3/role_assignments?group.id=dba083d85f4049b7baeca20d6bd1b039&scope.project.id=b2907edfa2f14a3b85299455266c251c&role.id=43105000610f402ca2486e7648018cca => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:14.840884 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d4f27-9f2e-46be-a8b3-6ab129901910 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:14.841365 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d4f27-9f2e-46be-a8b3-6ab129901910 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:14.841365 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d4f27-9f2e-46be-a8b3-6ab129901910 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:14.843045 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 236/456] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:00:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:14.850042 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf03a48-8d78-429b-a291-25489c17ad17 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:14.850484 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf03a48-8d78-429b-a291-25489c17ad17 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:14.850652 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf03a48-8d78-429b-a291-25489c17ad17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:14.877008 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-5cf03a48-8d78-429b-a291-25489c17ad17 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:14.878554 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-5cf03a48-8d78-429b-a291-25489c17ad17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:14.974491 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 221/457] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:00:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 10 03:00:15.016491 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d4f27-9f2e-46be-a8b3-6ab129901910 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:15.142010 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d4f27-9f2e-46be-a8b3-6ab129901910 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:15.177138 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f9c48-55fd-4508-9f2b-bdeba04343cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:15.177937 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f9c48-55fd-4508-9f2b-bdeba04343cc None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:15.178221 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f9c48-55fd-4508-9f2b-bdeba04343cc None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:15.179059 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f9c48-55fd-4508-9f2b-bdeba04343cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:15.189339 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4f9c48-55fd-4508-9f2b-bdeba04343cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:15.190818 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4f9c48-55fd-4508-9f2b-bdeba04343cc None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:15.200902 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df8096-3335-43e5-a1f8-165c8fb1a798 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:15.201188 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df8096-3335-43e5-a1f8-165c8fb1a798 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:15.201466 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df8096-3335-43e5-a1f8-165c8fb1a798 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:15.203069 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 222/458] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:00:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:15.207902 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93871cb6-7121-4b54-ab93-d7f7ed879c8b None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:15.208223 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93871cb6-7121-4b54-ab93-d7f7ed879c8b None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:15.208501 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93871cb6-7121-4b54-ab93-d7f7ed879c8b None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:15.209393 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-cc4f9c48-55fd-4508-9f2b-bdeba04343cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:15.209393 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:15.209393 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:15.209393 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:15.209393 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:15.209393 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:15.209393 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:15.209393 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:15.209393 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:15.209393 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:15.209393 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:15.209393 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:15.209393 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:00:15.209393 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:00:15.209393 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:00:15.210250 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:00:15.210250 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:15.210250 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:15.210250 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:15.210250 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:15.210250 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:15.210250 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:15.210250 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:15.210250 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:15.210250 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:15.210250 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:15.210250 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:15.210250 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:15.210250 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:15.210250 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:15.210250 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:15.210250 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:15.211096 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:00:15.211096 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:00:15.211096 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:15.211096 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:15.211325 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 223/459] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:00:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:15.211325 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049cbc1-ee57-435d-b287-87122d337b94 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:15.211325 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049cbc1-ee57-435d-b287-87122d337b94 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:15.211910 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049cbc1-ee57-435d-b287-87122d337b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:15.213420 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 237/460] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:00:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:15.215473 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15d765-407a-4bf4-8a62-e9e54da2064b None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:15.215769 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15d765-407a-4bf4-8a62-e9e54da2064b None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:15.216078 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15d765-407a-4bf4-8a62-e9e54da2064b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:15.236385 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-0f15d765-407a-4bf4-8a62-e9e54da2064b None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:15.236385 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-0f15d765-407a-4bf4-8a62-e9e54da2064b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:15.236825 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-3049cbc1-ee57-435d-b287-87122d337b94 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:15.243759 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-3049cbc1-ee57-435d-b287-87122d337b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:15.306657 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 224/461] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:00:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:15.307485 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3049cbc1-ee57-435d-b287-87122d337b94 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:15.308631 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 238/462] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:00:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 03:00:15.334190 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f15d765-407a-4bf4-8a62-e9e54da2064b None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:15.434349 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3049cbc1-ee57-435d-b287-87122d337b94 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:15.462408 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f15d765-407a-4bf4-8a62-e9e54da2064b None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:15.470771 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580acdbf-32f0-4443-bcaa-1360639921ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:15.471436 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580acdbf-32f0-4443-bcaa-1360639921ab None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:15.471716 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580acdbf-32f0-4443-bcaa-1360639921ab None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:15.471991 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580acdbf-32f0-4443-bcaa-1360639921ab None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:15.472737 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580acdbf-32f0-4443-bcaa-1360639921ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:15.473040 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580acdbf-32f0-4443-bcaa-1360639921ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:15.474423 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580acdbf-32f0-4443-bcaa-1360639921ab None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:15.487963 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 225/463] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:00:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:15.488805 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580acdbf-32f0-4443-bcaa-1360639921ab None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:15.501560 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b197323-5cf4-4267-9315-41b1bd089a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:15.502353 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b197323-5cf4-4267-9315-41b1bd089a3e None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:15.502633 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b197323-5cf4-4267-9315-41b1bd089a3e None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:15.502905 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b197323-5cf4-4267-9315-41b1bd089a3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:15.513735 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b197323-5cf4-4267-9315-41b1bd089a3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:15.515212 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b197323-5cf4-4267-9315-41b1bd089a3e None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:15.533547 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-7b197323-5cf4-4267-9315-41b1bd089a3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:15.533547 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:15.533547 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:15.533547 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:15.533547 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:15.533547 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:15.533547 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:15.533547 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:15.533547 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:15.533547 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:15.533547 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:15.533547 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:15.533547 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:00:15.533547 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:00:15.533547 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:00:15.535554 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:00:15.535554 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:15.535554 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:15.535554 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:15.535554 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:15.535554 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:15.535554 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:15.535554 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:15.535554 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:15.535554 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:15.535554 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:15.535554 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:15.535554 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:15.535554 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:15.535554 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:15.535554 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:15.535554 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:15.537636 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:00:15.537636 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:00:15.537636 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:15.537636 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:15.537636 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 239/464] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:00:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:00:15.537636 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b197323-5cf4-4267-9315-41b1bd089a3e None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:15.593928 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580acdbf-32f0-4443-bcaa-1360639921ab None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:15.636959 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b197323-5cf4-4267-9315-41b1bd089a3e None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:15.640294 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0250a0f2-8a07-41aa-9ba2-4480a9e62f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:15.640506 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250a0f2-8a07-41aa-9ba2-4480a9e62f70 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:15.640660 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250a0f2-8a07-41aa-9ba2-4480a9e62f70 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:15.640861 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250a0f2-8a07-41aa-9ba2-4480a9e62f70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:15.653574 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0250a0f2-8a07-41aa-9ba2-4480a9e62f70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:15.655918 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0250a0f2-8a07-41aa-9ba2-4480a9e62f70 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:15.672536 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9740a97f-e468-4aa0-bd9d-c6bb1099a814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:15.673203 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740a97f-e468-4aa0-bd9d-c6bb1099a814 None admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:15.673486 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740a97f-e468-4aa0-bd9d-c6bb1099a814 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:15.673761 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740a97f-e468-4aa0-bd9d-c6bb1099a814 None admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:15.674460 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9740a97f-e468-4aa0-bd9d-c6bb1099a814 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:15.675868 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9740a97f-e468-4aa0-bd9d-c6bb1099a814 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:15.685190 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-0250a0f2-8a07-41aa-9ba2-4480a9e62f70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:15.685190 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:15.685190 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:15.685190 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:15.685190 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:15.685190 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:15.685190 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:15.685190 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:15.685190 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:15.685190 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:15.685190 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:15.685190 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:15.685190 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:00:15.685190 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:00:15.685190 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:00:15.687384 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:00:15.687384 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:15.687384 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:15.687384 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:15.687384 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:15.687384 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:15.687384 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:15.687384 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:15.687384 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:15.687384 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:15.687384 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:15.687384 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:15.687384 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:15.687384 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:15.687384 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:15.687384 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:15.687384 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:15.689764 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:00:15.689764 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:00:15.689764 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:15.689764 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:15.689764 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 226/465] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:00:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:15.689764 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0250a0f2-8a07-41aa-9ba2-4480a9e62f70 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:15.772229 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 240/466] 10.222.0.65 () {60 vars in 1132 bytes} [Tue May 10 03:00:15 2022] POST /identity/v3/users => generated 246 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:00:15.775683 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9740a97f-e468-4aa0-bd9d-c6bb1099a814 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:15.826610 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0250a0f2-8a07-41aa-9ba2-4480a9e62f70 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:15.918881 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff22a6-104b-4482-9ed1-0c8c68ba1e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:15.919673 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff22a6-104b-4482-9ed1-0c8c68ba1e99 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:15.919830 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff22a6-104b-4482-9ed1-0c8c68ba1e99 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:15.920130 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff22a6-104b-4482-9ed1-0c8c68ba1e99 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:15.920866 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff22a6-104b-4482-9ed1-0c8c68ba1e99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:15.921170 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff22a6-104b-4482-9ed1-0c8c68ba1e99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:15.924694 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff22a6-104b-4482-9ed1-0c8c68ba1e99 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:15.943308 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 227/467] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:00:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:15.950338 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d89a9-7649-410e-8af1-ec04015aa87c None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:15.950659 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d89a9-7649-410e-8af1-ec04015aa87c None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:15.950915 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d89a9-7649-410e-8af1-ec04015aa87c None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:15.956687 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 228/468] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:00:15 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:15.957610 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d89a9-7649-410e-8af1-ec04015aa87c None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:15.962498 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9740a97f-e468-4aa0-bd9d-c6bb1099a814 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:16.014312 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf453798-6c2d-4fd6-9c6b-1663d14490fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:16.015460 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf453798-6c2d-4fd6-9c6b-1663d14490fc None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:16.016203 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf453798-6c2d-4fd6-9c6b-1663d14490fc None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:16.016436 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf453798-6c2d-4fd6-9c6b-1663d14490fc None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:16.017504 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf453798-6c2d-4fd6-9c6b-1663d14490fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:16.017973 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf453798-6c2d-4fd6-9c6b-1663d14490fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:16.020153 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf453798-6c2d-4fd6-9c6b-1663d14490fc None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:16.045506 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 241/469] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:00:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:16.046812 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da437277-146e-44f7-8b31-53aac779cd54 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:16.047103 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da437277-146e-44f7-8b31-53aac779cd54 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:16.047383 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da437277-146e-44f7-8b31-53aac779cd54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:16.069835 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-da437277-146e-44f7-8b31-53aac779cd54 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:16.070898 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-da437277-146e-44f7-8b31-53aac779cd54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:16.086571 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d89a9-7649-410e-8af1-ec04015aa87c None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:16.125001 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7299f1f0-3bdb-44b8-a483-45d05321fa9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:16.125001 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7299f1f0-3bdb-44b8-a483-45d05321fa9c None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:16.125316 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7299f1f0-3bdb-44b8-a483-45d05321fa9c None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:16.125400 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7299f1f0-3bdb-44b8-a483-45d05321fa9c None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:16.126107 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7299f1f0-3bdb-44b8-a483-45d05321fa9c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:16.127556 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7299f1f0-3bdb-44b8-a483-45d05321fa9c None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:16.147366 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 242/470] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:00:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:16.148232 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da437277-146e-44f7-8b31-53aac779cd54 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:16.229003 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 229/471] 10.222.0.65 () {60 vars in 1132 bytes} [Tue May 10 03:00:15 2022] POST /identity/v3/users => generated 248 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:00:16.230197 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7299f1f0-3bdb-44b8-a483-45d05321fa9c None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:16.256393 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da437277-146e-44f7-8b31-53aac779cd54 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:16.302756 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1781bfae-edfd-41d0-967d-f1f87b3ede4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:16.304870 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781bfae-edfd-41d0-967d-f1f87b3ede4c None admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:16.305529 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781bfae-edfd-41d0-967d-f1f87b3ede4c None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:16.306453 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781bfae-edfd-41d0-967d-f1f87b3ede4c None admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:16.307708 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1781bfae-edfd-41d0-967d-f1f87b3ede4c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:16.310303 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1781bfae-edfd-41d0-967d-f1f87b3ede4c None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:16.366364 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7299f1f0-3bdb-44b8-a483-45d05321fa9c None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:16.408660 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e394e6-69a6-412d-93c8-e83628177a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:16.409579 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e394e6-69a6-412d-93c8-e83628177a4e None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:16.409860 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e394e6-69a6-412d-93c8-e83628177a4e None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:16.410133 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e394e6-69a6-412d-93c8-e83628177a4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:16.423096 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e394e6-69a6-412d-93c8-e83628177a4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:16.426652 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e394e6-69a6-412d-93c8-e83628177a4e None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:16.426987 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 243/472] 10.222.0.65 () {60 vars in 1132 bytes} [Tue May 10 03:00:16 2022] POST /identity/v3/users => generated 248 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:00:16.445340 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-a4e394e6-69a6-412d-93c8-e83628177a4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:16.445340 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:16.445340 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:16.445340 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:16.445340 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:16.445340 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:16.445340 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:16.445340 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:16.445340 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:16.445340 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:16.445340 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:16.445340 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:16.445340 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:00:16.445340 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:00:16.445340 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:00:16.446268 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:00:16.446268 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:16.446268 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:16.446268 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:16.446268 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:16.446268 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:16.446268 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:16.446268 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:16.446268 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:16.446268 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:16.446268 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:16.446268 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:16.446268 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:16.446268 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:16.446268 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:16.446268 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:16.446268 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:16.447130 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:00:16.447130 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:00:16.447130 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:16.447130 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:16.447130 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 230/473] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:00:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:16.452979 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1781bfae-edfd-41d0-967d-f1f87b3ede4c None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:16.565050 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1781bfae-edfd-41d0-967d-f1f87b3ede4c None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:16.588065 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad36d3e-e372-413a-a6bf-879287109ffb None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:16.588354 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad36d3e-e372-413a-a6bf-879287109ffb None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:16.588637 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad36d3e-e372-413a-a6bf-879287109ffb None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:16.590292 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 231/474] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:00:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:00:16.599909 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c900c2-0e4e-4060-adf4-87a1384fb28e None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:16.600757 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c900c2-0e4e-4060-adf4-87a1384fb28e None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:16.601002 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c900c2-0e4e-4060-adf4-87a1384fb28e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:16.612818 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6eaa4c-9b38-4bda-9c7d-1262c26d8c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:16.613505 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6eaa4c-9b38-4bda-9c7d-1262c26d8c5f None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:16.613852 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6eaa4c-9b38-4bda-9c7d-1262c26d8c5f None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:16.614125 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6eaa4c-9b38-4bda-9c7d-1262c26d8c5f None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:16.614917 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6eaa4c-9b38-4bda-9c7d-1262c26d8c5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:16.615224 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6eaa4c-9b38-4bda-9c7d-1262c26d8c5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:16.617308 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6eaa4c-9b38-4bda-9c7d-1262c26d8c5f None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:16.623319 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-96c900c2-0e4e-4060-adf4-87a1384fb28e None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:16.624632 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-96c900c2-0e4e-4060-adf4-87a1384fb28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:16.644308 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 244/475] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:00:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:16.649089 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6eaa4c-9b38-4bda-9c7d-1262c26d8c5f None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:16.729302 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 232/476] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:00:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 03:00:16.754312 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c900c2-0e4e-4060-adf4-87a1384fb28e None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:16.788943 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6eaa4c-9b38-4bda-9c7d-1262c26d8c5f None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:16.830835 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec165c-bea9-473d-9d26-f97956cc1cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:16.832214 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec165c-bea9-473d-9d26-f97956cc1cce None admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:16.832500 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec165c-bea9-473d-9d26-f97956cc1cce None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:16.832778 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec165c-bea9-473d-9d26-f97956cc1cce None admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:16.833491 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec165c-bea9-473d-9d26-f97956cc1cce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:16.835454 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec165c-bea9-473d-9d26-f97956cc1cce None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:16.863268 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c900c2-0e4e-4060-adf4-87a1384fb28e None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:16.899511 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b09645-f766-46a1-a6f0-50edf16fb847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:16.900275 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b09645-f766-46a1-a6f0-50edf16fb847 None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:16.900566 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b09645-f766-46a1-a6f0-50edf16fb847 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:16.900847 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b09645-f766-46a1-a6f0-50edf16fb847 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:16.901715 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b09645-f766-46a1-a6f0-50edf16fb847 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:16.903112 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b09645-f766-46a1-a6f0-50edf16fb847 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:16.936952 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 245/477] 10.222.0.65 () {60 vars in 1132 bytes} [Tue May 10 03:00:16 2022] POST /identity/v3/users => generated 249 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:00:16.954077 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.sql.core [None req-e4b09645-f766-46a1-a6f0-50edf16fb847 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 10 03:00:16.954077 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 10 03:00:16.954077 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [parameters: {'id': '75cc73df8f3544c4a81a501c5053d899', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 10 03:00:16.954077 dv-cinder-830094-4-smb devstack@keystone.service[80198]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80198) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 10 03:00:16.976826 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-e4b09645-f766-46a1-a6f0-50edf16fb847 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 10 03:00:16.976826 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:16.976826 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 03:00:16.976826 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 03:00:16.976826 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 03:00:16.976826 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 03:00:16.976826 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 03:00:16.976826 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application result = self._query(query) May 10 03:00:16.976826 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 03:00:16.976826 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application conn.query(q) May 10 03:00:16.976826 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 03:00:16.976826 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 03:00:16.976826 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 03:00:16.976826 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application result.read() May 10 03:00:16.976826 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 03:00:16.977773 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 03:00:16.977773 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 03:00:16.977773 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 03:00:16.977773 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 03:00:16.977773 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 03:00:16.977773 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 03:00:16.977773 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 03:00:16.977773 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 10 03:00:16.977773 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:16.977773 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 10 03:00:16.977773 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:16.977773 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:16.977773 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 10 03:00:16.977773 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 10 03:00:16.977773 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 10 03:00:16.977773 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return ref.to_dict() May 10 03:00:16.977773 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 03:00:16.977773 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application next(self.gen) May 10 03:00:16.978682 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 10 03:00:16.978682 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application yield resource May 10 03:00:16.978682 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 03:00:16.978682 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application next(self.gen) May 10 03:00:16.978682 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 10 03:00:16.978682 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self.session.rollback() May 10 03:00:16.978682 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 03:00:16.978682 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self.force_reraise() May 10 03:00:16.978682 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 03:00:16.978682 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise self.value May 10 03:00:16.978682 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 10 03:00:16.978682 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 10 03:00:16.978682 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 10 03:00:16.978682 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application session.commit() May 10 03:00:16.978682 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 10 03:00:16.978682 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 10 03:00:16.978682 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 10 03:00:16.979513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._prepare_impl() May 10 03:00:16.979513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 10 03:00:16.979513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self.session.flush() May 10 03:00:16.979513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 10 03:00:16.979513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._flush(objects) May 10 03:00:16.979513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 10 03:00:16.979513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 10 03:00:16.979513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 10 03:00:16.979513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application compat.raise_( May 10 03:00:16.979513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 03:00:16.979513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception May 10 03:00:16.979513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 10 03:00:16.979513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application flush_context.execute() May 10 03:00:16.979513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 10 03:00:16.979513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rec.execute(self) May 10 03:00:16.979513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 10 03:00:16.979513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 10 03:00:16.980580 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 10 03:00:16.980580 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application _emit_insert_statements( May 10 03:00:16.980580 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 10 03:00:16.980580 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application c = connection._execute_20( May 10 03:00:16.980580 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 10 03:00:16.980580 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 10 03:00:16.980580 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 10 03:00:16.980580 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 10 03:00:16.980580 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 10 03:00:16.980580 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ret = self._execute_context( May 10 03:00:16.980580 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 10 03:00:16.980580 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 10 03:00:16.980580 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 10 03:00:16.980580 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 10 03:00:16.980580 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 03:00:16.980580 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception May 10 03:00:16.982322 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 03:00:16.982322 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 03:00:16.982322 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 03:00:16.982322 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 03:00:16.982322 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 03:00:16.982322 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application result = self._query(query) May 10 03:00:16.982322 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 03:00:16.982322 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application conn.query(q) May 10 03:00:16.982322 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 03:00:16.982322 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 03:00:16.982322 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 03:00:16.982322 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application result.read() May 10 03:00:16.982322 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 03:00:16.982322 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 03:00:16.982322 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 03:00:16.982322 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 03:00:16.984027 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 03:00:16.984027 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 03:00:16.984027 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 03:00:16.984027 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 03:00:16.984027 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 10 03:00:16.984027 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 10 03:00:16.984027 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [parameters: {'id': '75cc73df8f3544c4a81a501c5053d899', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 10 03:00:16.984027 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 10 03:00:16.984027 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:16.984027 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 03:00:16.984027 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:16.984027 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:16.984027 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:16.984027 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:16.984027 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:16.984027 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:16.985854 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:16.985854 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:16.985854 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:16.985854 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:16.985854 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:16.985854 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:16.985854 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 10 03:00:16.985854 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 10 03:00:16.985854 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:16.985854 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:16.985854 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 10 03:00:16.985854 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 10 03:00:16.985854 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 10 03:00:16.985854 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 10 03:00:16.985854 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 10 03:00:16.985854 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:16.987676 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 233/478] 10.222.0.65 () {60 vars in 1131 bytes} [Tue May 10 03:00:16 2022] POST /identity/v3/roles => generated 144 bytes in 225 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:16.987847 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec165c-bea9-473d-9d26-f97956cc1cce None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:17.135860 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec165c-bea9-473d-9d26-f97956cc1cce None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:17.172663 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ac8c3-636b-4b9b-9e91-db2ea6dbbaf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:17.173490 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ac8c3-636b-4b9b-9e91-db2ea6dbbaf1 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:17.173770 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ac8c3-636b-4b9b-9e91-db2ea6dbbaf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:17.174047 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ac8c3-636b-4b9b-9e91-db2ea6dbbaf1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:17.185494 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712ac8c3-636b-4b9b-9e91-db2ea6dbbaf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:17.193575 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-712ac8c3-636b-4b9b-9e91-db2ea6dbbaf1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 03:00:17.193575 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:17.193575 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:17.193575 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:17.193575 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:17.193575 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:17.193575 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:17.193575 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:17.193575 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:17.193575 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:17.193575 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:17.193575 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:17.193575 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:17.193575 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:17.193575 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:17.193575 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:17.195805 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:17.195805 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:17.195805 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:17.195805 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:17.195805 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:17.195805 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:17.195805 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:17.195805 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:17.195805 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:17.195805 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:17.195805 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:17.195805 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:17.195805 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:17.195805 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:17.195805 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:17.195805 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:17.196935 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:17.196935 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:17.196935 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:17.196935 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:17.196935 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:17.196935 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:17.196935 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:17.196935 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:17.196935 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:17.196935 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:17.196935 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 03:00:17.196935 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:17.196935 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 246/479] 10.222.0.65 () {56 vars in 1114 bytes} [Tue May 10 03:00:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:00:17.202184 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b09645-f766-46a1-a6f0-50edf16fb847 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:17.308339 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b09645-f766-46a1-a6f0-50edf16fb847 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:17.342729 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751e91f-21e5-4153-a3f9-4436055cff7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:17.343426 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751e91f-21e5-4153-a3f9-4436055cff7e None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:17.343710 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751e91f-21e5-4153-a3f9-4436055cff7e None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:17.343990 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751e91f-21e5-4153-a3f9-4436055cff7e None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:17.344771 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9751e91f-21e5-4153-a3f9-4436055cff7e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:17.345081 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9751e91f-21e5-4153-a3f9-4436055cff7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:17.346460 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9751e91f-21e5-4153-a3f9-4436055cff7e None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:17.356330 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 234/480] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 10 03:00:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:18.652761 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b2c2b-e307-47f9-8027-0e3720d2b39e None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:18.653263 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b2c2b-e307-47f9-8027-0e3720d2b39e None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:18.653337 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b2c2b-e307-47f9-8027-0e3720d2b39e None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:18.654952 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 247/481] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:00:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:18.660491 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd92bc7-1ffb-42cb-9c9e-7378c34424f0 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:18.660887 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd92bc7-1ffb-42cb-9c9e-7378c34424f0 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:18.661053 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd92bc7-1ffb-42cb-9c9e-7378c34424f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:18.679127 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-bfd92bc7-1ffb-42cb-9c9e-7378c34424f0 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:18.680370 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-bfd92bc7-1ffb-42cb-9c9e-7378c34424f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:18.751603 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 235/482] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:00:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:18.775283 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b2c2b-e307-47f9-8027-0e3720d2b39e None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:18.882002 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b2c2b-e307-47f9-8027-0e3720d2b39e None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:18.930267 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc9ba8-79c1-4ffd-bc0b-9279eab67ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:18.931097 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc9ba8-79c1-4ffd-bc0b-9279eab67ea7 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:18.931380 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc9ba8-79c1-4ffd-bc0b-9279eab67ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:18.931663 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc9ba8-79c1-4ffd-bc0b-9279eab67ea7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:18.953153 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cc9ba8-79c1-4ffd-bc0b-9279eab67ea7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:18.961384 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-83cc9ba8-79c1-4ffd-bc0b-9279eab67ea7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 03:00:18.961384 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:18.961384 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:18.961384 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:18.961384 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:18.961384 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:18.961384 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:18.961384 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:18.961384 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:18.961384 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:18.961384 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:18.961384 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:18.961384 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:18.961384 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:18.961384 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:18.961384 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:18.962334 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:18.962334 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:18.962334 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:18.962334 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:18.962334 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:18.962334 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:18.962334 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:18.962334 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:18.962334 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:18.962334 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:18.962334 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:18.962334 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:18.962334 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:18.962334 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:18.962334 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:18.962334 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:18.963110 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:18.963110 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:18.963110 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:18.963110 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:18.963110 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:18.963110 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:18.963110 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:18.963110 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:18.963110 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:18.963110 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:18.963110 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 03:00:18.963110 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:18.963110 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 248/483] 10.222.0.65 () {56 vars in 1102 bytes} [Tue May 10 03:00:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:18.969080 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd92bc7-1ffb-42cb-9c9e-7378c34424f0 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:19.126582 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79704fa1-8158-4def-b936-6bb32bdc7799 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:19.126928 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79704fa1-8158-4def-b936-6bb32bdc7799 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:19.127115 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79704fa1-8158-4def-b936-6bb32bdc7799 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:19.128785 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 249/484] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:00:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:00:19.129001 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd92bc7-1ffb-42cb-9c9e-7378c34424f0 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:19.134064 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5d6e1-30ad-4334-9b8c-d30145b29ad9 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:19.134349 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5d6e1-30ad-4334-9b8c-d30145b29ad9 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:19.134626 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5d6e1-30ad-4334-9b8c-d30145b29ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:19.165793 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-99b5d6e1-30ad-4334-9b8c-d30145b29ad9 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:19.166967 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-99b5d6e1-30ad-4334-9b8c-d30145b29ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:19.169592 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e037866-5d53-4902-b025-e02867c77add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:19.170282 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e037866-5d53-4902-b025-e02867c77add None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:19.170574 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e037866-5d53-4902-b025-e02867c77add None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:19.170856 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e037866-5d53-4902-b025-e02867c77add None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:19.171613 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e037866-5d53-4902-b025-e02867c77add None admin] RBAC: Adding query filter params (name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:19.171924 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e037866-5d53-4902-b025-e02867c77add None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:19.173335 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e037866-5d53-4902-b025-e02867c77add None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:19.191369 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 236/485] 10.222.0.65 () {56 vars in 1103 bytes} [Tue May 10 03:00:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:19.197927 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e037866-5d53-4902-b025-e02867c77add None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:19.260078 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 250/486] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:00:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:19.261716 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dbafbe-e5e0-4cf1-8c04-a8d771617abf None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:19.262197 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dbafbe-e5e0-4cf1-8c04-a8d771617abf None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:19.262663 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dbafbe-e5e0-4cf1-8c04-a8d771617abf None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:19.264234 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 251/487] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:00:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:19.273924 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fabd5c8-cd8d-4dc6-bc4e-9d4fa97eb558 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:19.274494 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fabd5c8-cd8d-4dc6-bc4e-9d4fa97eb558 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:19.275014 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fabd5c8-cd8d-4dc6-bc4e-9d4fa97eb558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:19.305176 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-1fabd5c8-cd8d-4dc6-bc4e-9d4fa97eb558 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:19.306719 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-1fabd5c8-cd8d-4dc6-bc4e-9d4fa97eb558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:19.341319 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e037866-5d53-4902-b025-e02867c77add None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:19.378939 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 252/488] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:00:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:19.380150 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fabd5c8-cd8d-4dc6-bc4e-9d4fa97eb558 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:19.388964 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f56920-a2e2-4567-aa07-d7be41dc5869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:19.390042 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f56920-a2e2-4567-aa07-d7be41dc5869 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:19.390518 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f56920-a2e2-4567-aa07-d7be41dc5869 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:19.390981 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f56920-a2e2-4567-aa07-d7be41dc5869 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:19.409052 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f56920-a2e2-4567-aa07-d7be41dc5869 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:19.411067 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f56920-a2e2-4567-aa07-d7be41dc5869 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:19.433305 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-91f56920-a2e2-4567-aa07-d7be41dc5869 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:19.433305 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:19.433305 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:19.433305 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:19.433305 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:19.433305 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:19.433305 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:19.433305 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:19.433305 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:19.433305 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:19.433305 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:19.433305 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:19.433305 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:00:19.433305 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:00:19.433305 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:00:19.434179 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:00:19.434179 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:19.434179 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:19.434179 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:19.434179 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:19.434179 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:19.434179 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:19.434179 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:19.434179 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:19.434179 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:19.434179 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:19.434179 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:19.434179 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:19.434179 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:19.434179 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:19.434179 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:19.434179 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:19.435003 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:00:19.435003 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:00:19.435003 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:19.435003 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:19.435003 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 237/489] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:00:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:00:19.435663 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f56920-a2e2-4567-aa07-d7be41dc5869 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:19.514867 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fabd5c8-cd8d-4dc6-bc4e-9d4fa97eb558 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:19.554767 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5752a515-aa98-4cd0-b2c0-f0eb56bd8004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:19.555810 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752a515-aa98-4cd0-b2c0-f0eb56bd8004 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:19.556140 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752a515-aa98-4cd0-b2c0-f0eb56bd8004 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:19.556763 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752a515-aa98-4cd0-b2c0-f0eb56bd8004 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:19.563117 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f56920-a2e2-4567-aa07-d7be41dc5869 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:19.569647 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5752a515-aa98-4cd0-b2c0-f0eb56bd8004 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:19.579618 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-5752a515-aa98-4cd0-b2c0-f0eb56bd8004 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 03:00:19.579618 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:19.579618 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:19.579618 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:19.579618 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:19.579618 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:19.579618 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:19.579618 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:19.579618 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:19.579618 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:19.579618 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:19.579618 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:19.579618 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:19.579618 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:19.579618 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:19.579618 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:19.580652 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:19.580652 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:19.580652 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:19.580652 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:19.580652 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:19.580652 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:19.580652 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:19.580652 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:19.580652 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:19.580652 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:19.580652 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:19.580652 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:19.580652 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:19.580652 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:19.580652 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:19.580652 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:19.581619 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:19.581619 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:19.581619 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:19.581619 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:19.581619 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:19.581619 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:19.581619 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:19.581619 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:19.581619 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:19.581619 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:19.581619 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 03:00:19.581619 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:19.584076 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 253/490] 10.222.0.65 () {56 vars in 1102 bytes} [Tue May 10 03:00:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:19.585602 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5752a515-aa98-4cd0-b2c0-f0eb56bd8004 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:19.611117 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d6e9e2-a039-40b7-87b1-d1cddf5fa689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:19.611966 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6e9e2-a039-40b7-87b1-d1cddf5fa689 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:19.612282 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6e9e2-a039-40b7-87b1-d1cddf5fa689 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:19.613019 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6e9e2-a039-40b7-87b1-d1cddf5fa689 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:19.626792 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d6e9e2-a039-40b7-87b1-d1cddf5fa689 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:19.637310 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-a2d6e9e2-a039-40b7-87b1-d1cddf5fa689 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 03:00:19.637310 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:19.637310 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:19.637310 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:19.637310 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:19.637310 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:19.637310 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:19.637310 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:19.637310 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:19.637310 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:19.637310 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:19.637310 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:19.637310 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:19.637310 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:19.637310 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:19.637310 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:19.638184 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:19.638184 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:19.638184 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:19.638184 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:19.638184 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:19.638184 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:19.638184 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:19.638184 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:19.638184 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:19.638184 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:19.638184 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:19.638184 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:19.638184 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:19.638184 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:19.638184 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:19.638184 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:19.638991 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:19.638991 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:19.638991 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:19.638991 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:19.638991 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:19.638991 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:19.638991 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:19.638991 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:19.638991 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:19.638991 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:19.638991 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 03:00:19.638991 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:19.638991 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 238/491] 10.222.0.65 () {56 vars in 1102 bytes} [Tue May 10 03:00:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:19.639651 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d6e9e2-a039-40b7-87b1-d1cddf5fa689 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:19.698155 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5752a515-aa98-4cd0-b2c0-f0eb56bd8004 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:19.733069 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd439a2-cf32-428b-9770-e286f1195732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:19.734121 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd439a2-cf32-428b-9770-e286f1195732 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:19.734629 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd439a2-cf32-428b-9770-e286f1195732 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:19.735116 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd439a2-cf32-428b-9770-e286f1195732 None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:19.736164 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd439a2-cf32-428b-9770-e286f1195732 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:19.736698 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd439a2-cf32-428b-9770-e286f1195732 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:19.738341 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd439a2-cf32-428b-9770-e286f1195732 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:19.743139 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d6e9e2-a039-40b7-87b1-d1cddf5fa689 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:19.752849 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 254/492] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:00:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:19.754113 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd439a2-cf32-428b-9770-e286f1195732 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:19.780517 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006221f5-49d4-469b-b2dc-e50392fc349b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:19.781465 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006221f5-49d4-469b-b2dc-e50392fc349b None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:19.781758 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006221f5-49d4-469b-b2dc-e50392fc349b None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:19.782031 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006221f5-49d4-469b-b2dc-e50392fc349b None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:19.783090 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006221f5-49d4-469b-b2dc-e50392fc349b None admin] RBAC: Adding query filter params (name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:19.783434 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006221f5-49d4-469b-b2dc-e50392fc349b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:19.784885 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006221f5-49d4-469b-b2dc-e50392fc349b None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:19.798595 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 239/493] 10.222.0.65 () {56 vars in 1103 bytes} [Tue May 10 03:00:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:19.798954 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006221f5-49d4-469b-b2dc-e50392fc349b None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:19.858253 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd439a2-cf32-428b-9770-e286f1195732 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:19.893557 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a3a11-503b-456a-96cc-d7d5d4ce2593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:19.894549 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a3a11-503b-456a-96cc-d7d5d4ce2593 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:19.895032 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a3a11-503b-456a-96cc-d7d5d4ce2593 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:19.895523 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a3a11-503b-456a-96cc-d7d5d4ce2593 None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:19.896503 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1a3a11-503b-456a-96cc-d7d5d4ce2593 None admin] RBAC: Adding query filter params (name=service) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:19.897076 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1a3a11-503b-456a-96cc-d7d5d4ce2593 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:19.898636 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1a3a11-503b-456a-96cc-d7d5d4ce2593 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:19.899381 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006221f5-49d4-469b-b2dc-e50392fc349b None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:19.912336 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 255/494] 10.222.0.65 () {56 vars in 1103 bytes} [Tue May 10 03:00:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:19.913552 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a3a11-503b-456a-96cc-d7d5d4ce2593 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:19.933658 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c988c0d-ec41-4b1e-903d-b1dbe7ce1cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:19.934459 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c988c0d-ec41-4b1e-903d-b1dbe7ce1cf8 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:19.934741 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c988c0d-ec41-4b1e-903d-b1dbe7ce1cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:19.935017 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c988c0d-ec41-4b1e-903d-b1dbe7ce1cf8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:19.943028 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c988c0d-ec41-4b1e-903d-b1dbe7ce1cf8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:19.945137 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c988c0d-ec41-4b1e-903d-b1dbe7ce1cf8 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:19.960039 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-2c988c0d-ec41-4b1e-903d-b1dbe7ce1cf8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 03:00:19.960039 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:19.960039 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:19.960039 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:19.960039 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:19.960039 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:19.960039 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:19.960039 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:19.960039 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:19.960039 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:19.960039 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:19.960039 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:19.960039 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:00:19.960039 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:00:19.960039 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:00:19.960039 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:00:19.961039 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:19.961039 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:19.961039 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:00:19.961039 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:00:19.961039 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:00:19.961039 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:00:19.961039 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:19.961039 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:19.961039 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:19.961039 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:19.961039 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:19.961039 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:19.961039 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:19.961039 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:19.961039 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:19.961039 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:19.961039 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:19.961039 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:19.962533 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:19.962533 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:19.962533 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:00:19.962533 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:00:19.962533 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:00:19.962533 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:00:19.962533 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:00:19.962533 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:00:19.962533 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 03:00:19.962533 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:19.962533 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 240/495] 10.222.0.65 () {56 vars in 1093 bytes} [Tue May 10 03:00:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:19.962533 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c988c0d-ec41-4b1e-903d-b1dbe7ce1cf8 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:20.015124 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a3a11-503b-456a-96cc-d7d5d4ce2593 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:20.048823 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be67a84-9939-4950-a039-7d3a7bfca06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:20.049608 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be67a84-9939-4950-a039-7d3a7bfca06c None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:20.049890 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be67a84-9939-4950-a039-7d3a7bfca06c None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:20.050163 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be67a84-9939-4950-a039-7d3a7bfca06c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:20.060815 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be67a84-9939-4950-a039-7d3a7bfca06c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:20.062308 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be67a84-9939-4950-a039-7d3a7bfca06c None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:20.063297 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c988c0d-ec41-4b1e-903d-b1dbe7ce1cf8 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:20.081020 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-5be67a84-9939-4950-a039-7d3a7bfca06c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:20.081020 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:20.081020 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:20.081020 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:20.081020 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:20.081020 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:20.081020 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:20.081020 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:20.081020 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:20.081020 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:20.081020 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:20.081020 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:20.081020 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:00:20.081020 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:00:20.081020 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:00:20.081952 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:00:20.081952 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:20.081952 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:20.081952 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:20.081952 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:20.081952 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:20.081952 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:20.081952 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:20.081952 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:20.081952 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:20.081952 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:20.081952 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:20.081952 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:20.081952 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:20.081952 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:20.081952 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:20.081952 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:20.082786 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:00:20.082786 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:00:20.082786 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:20.082786 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:20.082786 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 256/496] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:00:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:20.083739 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e46772-0f02-4ab7-b90c-096357b21b4f None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:20.084201 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e46772-0f02-4ab7-b90c-096357b21b4f None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:20.084380 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e46772-0f02-4ab7-b90c-096357b21b4f None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:20.088291 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 257/497] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:00:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:20.089078 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e46772-0f02-4ab7-b90c-096357b21b4f None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:20.110513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2419b0f4-fb37-47d2-86fb-dbca17233198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:20.111616 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2419b0f4-fb37-47d2-86fb-dbca17233198 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:20.111892 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2419b0f4-fb37-47d2-86fb-dbca17233198 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:20.112203 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2419b0f4-fb37-47d2-86fb-dbca17233198 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:20.124365 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2419b0f4-fb37-47d2-86fb-dbca17233198 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:20.126134 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2419b0f4-fb37-47d2-86fb-dbca17233198 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:20.143709 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-2419b0f4-fb37-47d2-86fb-dbca17233198 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:20.143709 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:20.143709 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:20.143709 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:20.143709 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:20.143709 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:20.143709 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:20.143709 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:20.143709 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:20.143709 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:20.143709 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:20.143709 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:20.143709 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:00:20.143709 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:00:20.143709 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:00:20.144608 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:00:20.144608 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:20.144608 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:20.144608 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:20.144608 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:20.144608 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:20.144608 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:20.144608 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:20.144608 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:20.144608 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:20.144608 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:20.144608 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:20.144608 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:20.144608 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:20.144608 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:20.144608 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:20.144608 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:20.145440 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:00:20.145440 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:00:20.145440 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:20.145440 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:20.145440 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 241/498] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:00:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:20.146116 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2419b0f4-fb37-47d2-86fb-dbca17233198 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:20.192925 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e46772-0f02-4ab7-b90c-096357b21b4f None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:20.229830 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46df586-a3fd-48cb-9a1f-7c9690625a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:20.230502 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46df586-a3fd-48cb-9a1f-7c9690625a2c None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:20.230782 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46df586-a3fd-48cb-9a1f-7c9690625a2c None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:20.231056 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46df586-a3fd-48cb-9a1f-7c9690625a2c None admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:20.231899 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46df586-a3fd-48cb-9a1f-7c9690625a2c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:20.232677 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46df586-a3fd-48cb-9a1f-7c9690625a2c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:20.234393 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46df586-a3fd-48cb-9a1f-7c9690625a2c None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:20.244209 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2419b0f4-fb37-47d2-86fb-dbca17233198 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:20.277801 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e3c61d-fef3-469c-8a0c-802159c97a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:20.278468 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3c61d-fef3-469c-8a0c-802159c97a02 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:20.278710 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 258/499] 10.222.0.65 () {56 vars in 1133 bytes} [Tue May 10 03:00:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:20.278811 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3c61d-fef3-469c-8a0c-802159c97a02 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:20.279084 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3c61d-fef3-469c-8a0c-802159c97a02 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:20.279870 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e3c61d-fef3-469c-8a0c-802159c97a02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:20.279965 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b7566-8f26-469c-a98a-df1563169370 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:20.280211 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e3c61d-fef3-469c-8a0c-802159c97a02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:20.280299 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b7566-8f26-469c-a98a-df1563169370 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:20.280522 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b7566-8f26-469c-a98a-df1563169370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:20.281584 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e3c61d-fef3-469c-8a0c-802159c97a02 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:20.293748 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 242/500] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:00:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:20.294563 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e3c61d-fef3-469c-8a0c-802159c97a02 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:20.296335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-856b7566-8f26-469c-a98a-df1563169370 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:20.297515 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-856b7566-8f26-469c-a98a-df1563169370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:20.358611 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 259/501] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:00:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:20.359881 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb176e26-8345-49d8-ad4f-51cf22c25472 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:20.360195 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb176e26-8345-49d8-ad4f-51cf22c25472 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:20.360469 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb176e26-8345-49d8-ad4f-51cf22c25472 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:20.361868 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 260/502] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:00:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:20.362379 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb176e26-8345-49d8-ad4f-51cf22c25472 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:20.393017 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e3c61d-fef3-469c-8a0c-802159c97a02 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:20.425745 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc759fc-9df0-4d7f-ba78-f1cedb26831f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:20.426345 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc759fc-9df0-4d7f-ba78-f1cedb26831f None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:20.426629 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc759fc-9df0-4d7f-ba78-f1cedb26831f None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:20.426907 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc759fc-9df0-4d7f-ba78-f1cedb26831f None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:20.427631 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc759fc-9df0-4d7f-ba78-f1cedb26831f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:20.427937 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc759fc-9df0-4d7f-ba78-f1cedb26831f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:20.429372 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc759fc-9df0-4d7f-ba78-f1cedb26831f None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:20.440026 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 243/503] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:00:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:20.440861 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc759fc-9df0-4d7f-ba78-f1cedb26831f None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:20.460493 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb176e26-8345-49d8-ad4f-51cf22c25472 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:20.492219 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c597c219-97fe-49ae-a35a-f393bf81c08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:20.492857 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597c219-97fe-49ae-a35a-f393bf81c08d None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:20.493138 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597c219-97fe-49ae-a35a-f393bf81c08d None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:20.493408 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597c219-97fe-49ae-a35a-f393bf81c08d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:20.535701 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc759fc-9df0-4d7f-ba78-f1cedb26831f None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:20.556178 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c597c219-97fe-49ae-a35a-f393bf81c08d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:20.557614 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c597c219-97fe-49ae-a35a-f393bf81c08d None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:20.567123 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100e41f5-7f11-4859-9df5-f7ab77ee81aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:20.567921 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e41f5-7f11-4859-9df5-f7ab77ee81aa None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:20.568245 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e41f5-7f11-4859-9df5-f7ab77ee81aa None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:20.568518 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e41f5-7f11-4859-9df5-f7ab77ee81aa None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:20.576288 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100e41f5-7f11-4859-9df5-f7ab77ee81aa None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:20.577716 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100e41f5-7f11-4859-9df5-f7ab77ee81aa None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:20.591618 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-100e41f5-7f11-4859-9df5-f7ab77ee81aa None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 10 03:00:20.591618 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:20.591618 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:20.591618 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:20.591618 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:20.591618 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:20.591618 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:20.591618 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:20.591618 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:20.591618 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:20.591618 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:20.591618 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:20.591618 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:00:20.591618 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:00:20.591618 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:00:20.591618 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:00:20.592509 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:20.592509 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:20.592509 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:00:20.592509 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:00:20.592509 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:00:20.592509 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:00:20.592509 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:20.592509 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:20.592509 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:20.592509 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:20.592509 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:20.592509 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:20.592509 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:20.592509 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:20.592509 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:20.592509 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:20.592509 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:20.592509 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:20.593367 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:20.593367 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:20.593367 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:00:20.593367 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:00:20.593367 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:00:20.593367 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:00:20.593367 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:00:20.593367 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:00:20.593367 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 10 03:00:20.593367 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:20.593367 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 244/504] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 10 03:00:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:20.594070 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d05bc07-0d34-447d-9060-9c0fff3f8707 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:20.594337 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d05bc07-0d34-447d-9060-9c0fff3f8707 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:20.594636 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d05bc07-0d34-447d-9060-9c0fff3f8707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:20.610227 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-1d05bc07-0d34-447d-9060-9c0fff3f8707 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:20.611415 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-1d05bc07-0d34-447d-9060-9c0fff3f8707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:20.655294 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 261/505] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 10 03:00:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 03:00:20.656844 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c597c219-97fe-49ae-a35a-f393bf81c08d None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:20.674895 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 245/506] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:00:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:20.675724 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d05bc07-0d34-447d-9060-9c0fff3f8707 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:20.748735 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c597c219-97fe-49ae-a35a-f393bf81c08d None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:20.767961 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d05bc07-0d34-447d-9060-9c0fff3f8707 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:20.780846 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece3dd6a-8654-4017-8fb8-29b13686710a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:20.781628 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3dd6a-8654-4017-8fb8-29b13686710a None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:20.781910 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3dd6a-8654-4017-8fb8-29b13686710a None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:20.782248 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3dd6a-8654-4017-8fb8-29b13686710a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:20.792149 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece3dd6a-8654-4017-8fb8-29b13686710a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:20.799835 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-ece3dd6a-8654-4017-8fb8-29b13686710a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 03:00:20.799835 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:20.799835 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:20.799835 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:20.799835 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:20.799835 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:20.799835 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:20.799835 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:20.799835 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:20.799835 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:20.799835 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:20.799835 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:20.799835 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:20.799835 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:20.799835 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:20.799835 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:20.800731 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:20.800731 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:20.800731 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:20.800731 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:20.800731 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:20.800731 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:20.800731 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:20.800731 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:20.800731 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:20.800731 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:20.800731 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:20.800731 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:20.800731 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:20.800731 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:20.800731 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:20.800731 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:20.801809 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:20.801809 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:20.801809 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:20.801809 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:20.801809 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:20.801809 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:20.801809 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:20.801809 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:20.801809 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:20.801809 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:20.801809 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 03:00:20.801809 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:20.801809 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 262/507] 10.222.0.65 () {56 vars in 1102 bytes} [Tue May 10 03:00:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:20.801809 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece3dd6a-8654-4017-8fb8-29b13686710a None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:20.803898 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f2dcd8-9100-4359-b804-1a0dc4af9dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:20.804716 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2dcd8-9100-4359-b804-1a0dc4af9dd3 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:20.805001 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2dcd8-9100-4359-b804-1a0dc4af9dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:20.805277 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2dcd8-9100-4359-b804-1a0dc4af9dd3 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:20.812366 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f2dcd8-9100-4359-b804-1a0dc4af9dd3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:20.813815 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f2dcd8-9100-4359-b804-1a0dc4af9dd3 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:20.828492 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-f7f2dcd8-9100-4359-b804-1a0dc4af9dd3 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 10 03:00:20.828492 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:20.828492 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:20.828492 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:20.828492 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:20.828492 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:20.828492 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:20.828492 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:20.828492 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:20.828492 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:20.828492 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:20.828492 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:20.828492 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:00:20.828492 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:00:20.828492 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:00:20.828492 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:00:20.829404 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:20.829404 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:20.829404 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:00:20.829404 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:00:20.829404 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:00:20.829404 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:00:20.829404 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:20.829404 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:20.829404 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:20.829404 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:20.829404 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:20.829404 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:20.829404 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:20.829404 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:20.829404 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:20.829404 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:20.829404 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:20.829404 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:20.830266 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:20.830266 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:20.830266 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:00:20.830266 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:00:20.830266 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:00:20.830266 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:00:20.830266 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:00:20.830266 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:00:20.830266 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 10 03:00:20.830266 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:20.830266 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 246/508] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 10 03:00:20 2022] GET /identity/v3/users/glance => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:20.830815 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f2dcd8-9100-4359-b804-1a0dc4af9dd3 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:20.902733 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece3dd6a-8654-4017-8fb8-29b13686710a None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:20.938048 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9187016-0b65-499e-921a-3034202196a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:20.938587 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f2dcd8-9100-4359-b804-1a0dc4af9dd3 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:20.938691 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9187016-0b65-499e-921a-3034202196a1 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:20.938980 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9187016-0b65-499e-921a-3034202196a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:20.939261 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9187016-0b65-499e-921a-3034202196a1 None admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:20.940137 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9187016-0b65-499e-921a-3034202196a1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:20.940447 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9187016-0b65-499e-921a-3034202196a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:20.941884 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9187016-0b65-499e-921a-3034202196a1 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:20.958625 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 263/509] 10.222.0.65 () {56 vars in 1137 bytes} [Tue May 10 03:00:20 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:20.959454 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9187016-0b65-499e-921a-3034202196a1 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:20.975538 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7d819-1b7e-43eb-9780-ce637fff33fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:20.976417 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7d819-1b7e-43eb-9780-ce637fff33fa None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:20.976699 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7d819-1b7e-43eb-9780-ce637fff33fa None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:20.990323 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7d819-1b7e-43eb-9780-ce637fff33fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:20.990323 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e7d819-1b7e-43eb-9780-ce637fff33fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:20.990323 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e7d819-1b7e-43eb-9780-ce637fff33fa None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:21.005040 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-42e7d819-1b7e-43eb-9780-ce637fff33fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:21.005040 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:21.005040 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:21.005040 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:21.005040 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:21.005040 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:21.005040 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:21.005040 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:21.005040 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:21.005040 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:21.005040 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:21.005040 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:21.005040 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:00:21.005040 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:00:21.005040 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:00:21.005845 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:00:21.005845 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:21.005845 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:21.005845 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:21.005845 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:21.005845 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:21.005845 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:21.005845 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:21.005845 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:21.005845 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:21.005845 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:21.005845 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:21.005845 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:21.005845 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:21.005845 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:21.005845 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:21.005845 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:21.006702 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:00:21.006702 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:00:21.006702 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:21.006702 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:21.006702 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 247/510] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:00:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:21.006956 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7d819-1b7e-43eb-9780-ce637fff33fa None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:21.053957 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9187016-0b65-499e-921a-3034202196a1 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:21.085541 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82581b2e-2652-4c50-8bd7-368bc1a8d3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:21.086331 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82581b2e-2652-4c50-8bd7-368bc1a8d3e0 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:21.086612 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82581b2e-2652-4c50-8bd7-368bc1a8d3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:21.086883 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82581b2e-2652-4c50-8bd7-368bc1a8d3e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:21.096466 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82581b2e-2652-4c50-8bd7-368bc1a8d3e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:21.097899 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82581b2e-2652-4c50-8bd7-368bc1a8d3e0 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:21.103602 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7d819-1b7e-43eb-9780-ce637fff33fa None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:21.115286 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-82581b2e-2652-4c50-8bd7-368bc1a8d3e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:21.115286 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:21.115286 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:21.115286 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:21.115286 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:21.115286 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:21.115286 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:21.115286 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:21.115286 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:21.115286 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:21.115286 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:21.115286 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:21.115286 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:00:21.115286 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:00:21.115286 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:00:21.116718 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:00:21.116718 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:21.116718 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:21.116718 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:21.116718 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:21.116718 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:21.116718 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:21.116718 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:21.116718 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:21.116718 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:21.116718 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:21.116718 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:21.116718 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:21.116718 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:21.116718 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:21.116718 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:21.116718 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:21.117519 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:00:21.117519 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:00:21.117519 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:21.117519 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:21.117519 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 264/511] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:00:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:21.117925 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82581b2e-2652-4c50-8bd7-368bc1a8d3e0 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:21.137778 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b16160-897a-46a4-a048-e27923696437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:21.138440 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b16160-897a-46a4-a048-e27923696437 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:21.138719 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b16160-897a-46a4-a048-e27923696437 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:21.138991 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b16160-897a-46a4-a048-e27923696437 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:21.139729 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b16160-897a-46a4-a048-e27923696437 None admin] RBAC: Adding query filter params (name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:21.140048 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b16160-897a-46a4-a048-e27923696437 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:21.141407 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b16160-897a-46a4-a048-e27923696437 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:21.149092 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 248/512] 10.222.0.65 () {56 vars in 1103 bytes} [Tue May 10 03:00:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:21.149674 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b16160-897a-46a4-a048-e27923696437 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:21.210513 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82581b2e-2652-4c50-8bd7-368bc1a8d3e0 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:21.242402 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b16160-897a-46a4-a048-e27923696437 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:21.242567 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3cd5d4-7190-422e-9710-4ee4c20a9cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:21.243129 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3cd5d4-7190-422e-9710-4ee4c20a9cb7 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:21.243413 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3cd5d4-7190-422e-9710-4ee4c20a9cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:21.243686 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3cd5d4-7190-422e-9710-4ee4c20a9cb7 None admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:21.244577 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3cd5d4-7190-422e-9710-4ee4c20a9cb7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:21.244886 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3cd5d4-7190-422e-9710-4ee4c20a9cb7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:21.246407 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3cd5d4-7190-422e-9710-4ee4c20a9cb7 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:21.262970 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 265/513] 10.222.0.65 () {56 vars in 1137 bytes} [Tue May 10 03:00:21 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:21.263695 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3cd5d4-7190-422e-9710-4ee4c20a9cb7 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:21.274554 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfee49ab-3e3a-4778-9bb2-34025f1d21f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:21.275206 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee49ab-3e3a-4778-9bb2-34025f1d21f7 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:21.275483 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee49ab-3e3a-4778-9bb2-34025f1d21f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:21.275754 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee49ab-3e3a-4778-9bb2-34025f1d21f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:21.338776 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfee49ab-3e3a-4778-9bb2-34025f1d21f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:21.340246 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfee49ab-3e3a-4778-9bb2-34025f1d21f7 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:21.364920 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3cd5d4-7190-422e-9710-4ee4c20a9cb7 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:21.398812 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2bc1af-9e64-4c45-b115-d5cffc2778b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:21.399477 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2bc1af-9e64-4c45-b115-d5cffc2778b6 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:21.399761 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2bc1af-9e64-4c45-b115-d5cffc2778b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:21.400064 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2bc1af-9e64-4c45-b115-d5cffc2778b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:21.400795 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2bc1af-9e64-4c45-b115-d5cffc2778b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:21.401103 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2bc1af-9e64-4c45-b115-d5cffc2778b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:21.402479 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2bc1af-9e64-4c45-b115-d5cffc2778b6 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:21.413997 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 266/514] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:00:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:21.414780 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2bc1af-9e64-4c45-b115-d5cffc2778b6 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:21.434124 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 249/515] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 10 03:00:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 03:00:21.435144 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfee49ab-3e3a-4778-9bb2-34025f1d21f7 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:21.507802 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2bc1af-9e64-4c45-b115-d5cffc2778b6 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:21.528643 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfee49ab-3e3a-4778-9bb2-34025f1d21f7 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:21.539531 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f6a6a-3710-4c56-9407-e6a5ebc4206b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:21.540220 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f6a6a-3710-4c56-9407-e6a5ebc4206b None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:21.540500 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f6a6a-3710-4c56-9407-e6a5ebc4206b None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:21.540774 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f6a6a-3710-4c56-9407-e6a5ebc4206b None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:21.541493 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157f6a6a-3710-4c56-9407-e6a5ebc4206b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:21.541801 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157f6a6a-3710-4c56-9407-e6a5ebc4206b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:21.543150 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157f6a6a-3710-4c56-9407-e6a5ebc4206b None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:21.554190 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 267/516] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:00:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:21.554971 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f6a6a-3710-4c56-9407-e6a5ebc4206b None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:21.561506 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd54add-6acc-4acf-a4fc-7080f7c4219e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:21.562298 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd54add-6acc-4acf-a4fc-7080f7c4219e None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:21.562584 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd54add-6acc-4acf-a4fc-7080f7c4219e None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:21.562860 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd54add-6acc-4acf-a4fc-7080f7c4219e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:21.572570 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd54add-6acc-4acf-a4fc-7080f7c4219e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:21.574023 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd54add-6acc-4acf-a4fc-7080f7c4219e None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:21.591281 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-edd54add-6acc-4acf-a4fc-7080f7c4219e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:21.591281 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:21.591281 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:21.591281 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:21.591281 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:21.591281 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:21.591281 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:21.591281 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:21.591281 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:21.591281 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:21.591281 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:21.591281 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:21.591281 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:00:21.591281 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:00:21.591281 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:00:21.592191 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:00:21.592191 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:21.592191 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:21.592191 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:21.592191 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:21.592191 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:21.592191 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:21.592191 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:21.592191 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:21.592191 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:21.592191 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:21.592191 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:21.592191 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:21.592191 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:21.592191 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:21.592191 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:21.592191 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:21.593013 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:00:21.593013 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:00:21.593013 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:21.593013 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:21.593013 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 250/517] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:00:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:21.593277 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd54add-6acc-4acf-a4fc-7080f7c4219e None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:21.645663 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f6a6a-3710-4c56-9407-e6a5ebc4206b None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:21.677815 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b60acf-5129-44e1-9006-eb1a157dd7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:21.678662 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b60acf-5129-44e1-9006-eb1a157dd7e0 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:21.678939 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b60acf-5129-44e1-9006-eb1a157dd7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:21.679208 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b60acf-5129-44e1-9006-eb1a157dd7e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:21.686204 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd54add-6acc-4acf-a4fc-7080f7c4219e None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:21.718655 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439599c0-2f1b-432c-a12c-7230450f7f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:21.719429 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439599c0-2f1b-432c-a12c-7230450f7f8e None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:21.719710 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439599c0-2f1b-432c-a12c-7230450f7f8e None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:21.719985 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439599c0-2f1b-432c-a12c-7230450f7f8e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:21.726370 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439599c0-2f1b-432c-a12c-7230450f7f8e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:21.727796 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439599c0-2f1b-432c-a12c-7230450f7f8e None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:21.740839 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b60acf-5129-44e1-9006-eb1a157dd7e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:21.741631 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-439599c0-2f1b-432c-a12c-7230450f7f8e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:00:21.741631 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:21.741631 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:21.741631 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:21.741631 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:21.741631 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:21.741631 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:21.741631 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:21.741631 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:21.741631 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:21.741631 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:21.741631 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:21.741631 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:00:21.741631 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:00:21.741631 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:00:21.742513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:00:21.742513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:21.742513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:21.742513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:21.742513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:21.742513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:21.742513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:21.742513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:21.742513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:21.742513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:21.742513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:21.742513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:21.742513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:21.742513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:21.742513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:21.742513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:21.742513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:21.743353 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:00:21.743353 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:00:21.743353 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:00:21.743353 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:00:21.743353 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:00:21.743353 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:00:21.743353 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:00:21.743353 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:21.743761 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b60acf-5129-44e1-9006-eb1a157dd7e0 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:21.744393 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 251/518] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 10 03:00:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:21.744393 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439599c0-2f1b-432c-a12c-7230450f7f8e None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:21.832806 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 268/519] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 10 03:00:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 03:00:21.833526 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b60acf-5129-44e1-9006-eb1a157dd7e0 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:21.837048 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439599c0-2f1b-432c-a12c-7230450f7f8e None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:21.869211 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fa4ef4-a2e7-4621-8618-e8c63f69a543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:21.869997 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa4ef4-a2e7-4621-8618-e8c63f69a543 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:21.870278 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa4ef4-a2e7-4621-8618-e8c63f69a543 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:21.870548 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa4ef4-a2e7-4621-8618-e8c63f69a543 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:21.880704 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fa4ef4-a2e7-4621-8618-e8c63f69a543 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:21.882675 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fa4ef4-a2e7-4621-8618-e8c63f69a543 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:21.899375 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-48fa4ef4-a2e7-4621-8618-e8c63f69a543 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:21.899375 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:21.899375 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:21.899375 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:21.899375 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:21.899375 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:21.899375 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:21.899375 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:21.899375 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:21.899375 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:21.899375 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:21.899375 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:21.899375 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:00:21.899375 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:00:21.899375 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:00:21.900271 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:00:21.900271 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:21.900271 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:21.900271 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:21.900271 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:21.900271 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:21.900271 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:21.900271 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:21.900271 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:21.900271 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:21.900271 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:21.900271 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:21.900271 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:21.900271 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:21.900271 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:21.900271 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:21.900271 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:21.901118 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:00:21.901118 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:00:21.901118 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:21.901118 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:21.901118 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 252/520] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:00:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:21.901417 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fa4ef4-a2e7-4621-8618-e8c63f69a543 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:21.928261 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b60acf-5129-44e1-9006-eb1a157dd7e0 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:21.960593 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fce102-ae44-4859-9aa8-52942bf0f669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:21.961255 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fce102-ae44-4859-9aa8-52942bf0f669 None admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:21.961562 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fce102-ae44-4859-9aa8-52942bf0f669 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:21.961833 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fce102-ae44-4859-9aa8-52942bf0f669 None admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:21.962527 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fce102-ae44-4859-9aa8-52942bf0f669 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:21.963949 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fce102-ae44-4859-9aa8-52942bf0f669 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:21.994196 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fa4ef4-a2e7-4621-8618-e8c63f69a543 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:22.026132 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f0e6f3-cd3a-4e87-8276-7efa23fad069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:22.026774 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f0e6f3-cd3a-4e87-8276-7efa23fad069 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:22.027056 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f0e6f3-cd3a-4e87-8276-7efa23fad069 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:22.027329 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f0e6f3-cd3a-4e87-8276-7efa23fad069 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:22.028057 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f0e6f3-cd3a-4e87-8276-7efa23fad069 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:22.028448 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f0e6f3-cd3a-4e87-8276-7efa23fad069 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:22.029709 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f0e6f3-cd3a-4e87-8276-7efa23fad069 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:22.041024 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 253/521] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:00:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:22.041796 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f0e6f3-cd3a-4e87-8276-7efa23fad069 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:22.057252 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 269/522] 10.222.0.65 () {60 vars in 1132 bytes} [Tue May 10 03:00:21 2022] POST /identity/v3/users => generated 247 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:00:22.057252 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fce102-ae44-4859-9aa8-52942bf0f669 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:22.150146 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fce102-ae44-4859-9aa8-52942bf0f669 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:22.154047 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f0e6f3-cd3a-4e87-8276-7efa23fad069 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:22.185667 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696550e-c9ce-4f76-a57b-e482de97f97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:22.186472 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696550e-c9ce-4f76-a57b-e482de97f97a None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:22.186758 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696550e-c9ce-4f76-a57b-e482de97f97a None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:22.187035 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696550e-c9ce-4f76-a57b-e482de97f97a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:22.193379 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95292673-ac09-4b87-9e61-61f0c6412e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:22.194787 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95292673-ac09-4b87-9e61-61f0c6412e03 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:22.194923 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95292673-ac09-4b87-9e61-61f0c6412e03 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:22.195172 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95292673-ac09-4b87-9e61-61f0c6412e03 None admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:22.195972 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95292673-ac09-4b87-9e61-61f0c6412e03 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:22.196311 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95292673-ac09-4b87-9e61-61f0c6412e03 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:22.197786 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95292673-ac09-4b87-9e61-61f0c6412e03 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:22.199020 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c696550e-c9ce-4f76-a57b-e482de97f97a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:22.200557 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c696550e-c9ce-4f76-a57b-e482de97f97a None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:22.216432 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 254/523] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 10 03:00:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:22.217648 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95292673-ac09-4b87-9e61-61f0c6412e03 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:22.218383 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-c696550e-c9ce-4f76-a57b-e482de97f97a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:22.218383 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:22.218383 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:22.218383 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:22.218383 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:22.218383 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:22.218383 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:22.218383 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:22.218383 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:22.218383 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:22.218383 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:22.218383 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:22.218383 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:00:22.218383 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:00:22.218383 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:00:22.219203 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:00:22.219203 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:22.219203 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:22.219203 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:22.219203 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:22.219203 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:22.219203 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:22.219203 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:22.219203 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:22.219203 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:22.219203 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:22.219203 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:22.219203 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:22.219203 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:22.219203 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:22.219203 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:22.219203 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:22.220061 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:00:22.220061 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:00:22.220061 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:22.220061 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:22.223815 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 270/524] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:00:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:22.224713 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696550e-c9ce-4f76-a57b-e482de97f97a None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:22.327334 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95292673-ac09-4b87-9e61-61f0c6412e03 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:22.328474 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696550e-c9ce-4f76-a57b-e482de97f97a None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:22.362131 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb78da2-cffd-4817-ab5d-71d2c0f3578b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:22.363241 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb78da2-cffd-4817-ab5d-71d2c0f3578b None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:22.363691 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb78da2-cffd-4817-ab5d-71d2c0f3578b None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:22.364133 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba9212-db1f-47df-bc40-b8689595866b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:22.364272 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb78da2-cffd-4817-ab5d-71d2c0f3578b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:22.367123 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba9212-db1f-47df-bc40-b8689595866b None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:22.367508 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba9212-db1f-47df-bc40-b8689595866b None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:22.367883 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba9212-db1f-47df-bc40-b8689595866b None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:22.368832 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba9212-db1f-47df-bc40-b8689595866b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:22.369240 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba9212-db1f-47df-bc40-b8689595866b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:22.370737 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba9212-db1f-47df-bc40-b8689595866b None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:22.373176 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb78da2-cffd-4817-ab5d-71d2c0f3578b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:22.375122 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb78da2-cffd-4817-ab5d-71d2c0f3578b None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:22.384749 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 255/525] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:00:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:22.385843 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba9212-db1f-47df-bc40-b8689595866b None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:22.395321 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-3fb78da2-cffd-4817-ab5d-71d2c0f3578b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 10 03:00:22.395321 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:22.395321 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:22.395321 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:22.395321 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:22.395321 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:22.395321 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:22.395321 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:22.395321 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:22.395321 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:22.395321 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:22.395321 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:22.395321 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:00:22.395321 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:00:22.395321 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:00:22.395321 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:00:22.396426 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:22.396426 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:22.396426 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:00:22.396426 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:00:22.396426 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:00:22.396426 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:00:22.396426 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:22.396426 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:22.396426 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:22.396426 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:22.396426 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:22.396426 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:22.396426 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:22.396426 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:22.396426 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:22.396426 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:22.396426 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:22.396426 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:22.397397 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:22.397397 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:22.397397 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:00:22.397397 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:00:22.397397 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:00:22.397397 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:00:22.397397 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:00:22.397397 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:00:22.397397 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 10 03:00:22.397397 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:22.397397 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 271/526] 10.222.0.65 () {56 vars in 1102 bytes} [Tue May 10 03:00:22 2022] GET /identity/v3/users/neutron => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:22.397935 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb78da2-cffd-4817-ab5d-71d2c0f3578b None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:22.511191 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba9212-db1f-47df-bc40-b8689595866b None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:22.511790 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb78da2-cffd-4817-ab5d-71d2c0f3578b None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:22.547260 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f4003-7147-4321-aa1c-2889b56016c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:22.547930 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f4003-7147-4321-aa1c-2889b56016c5 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:22.548317 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f4003-7147-4321-aa1c-2889b56016c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:22.548601 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f4003-7147-4321-aa1c-2889b56016c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:22.549325 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1f4003-7147-4321-aa1c-2889b56016c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:22.549630 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1f4003-7147-4321-aa1c-2889b56016c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:22.550974 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2496ca0-bfeb-4b88-96db-f3e5f1092985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:22.551088 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1f4003-7147-4321-aa1c-2889b56016c5 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:22.551630 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2496ca0-bfeb-4b88-96db-f3e5f1092985 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:22.551912 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2496ca0-bfeb-4b88-96db-f3e5f1092985 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:22.552217 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2496ca0-bfeb-4b88-96db-f3e5f1092985 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:22.553036 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2496ca0-bfeb-4b88-96db-f3e5f1092985 None admin] RBAC: Adding query filter params (role.id=9a5640186d0940658e691be68ccf9205, scope.project.id=513e6592cd83457b8ff461b0e5e1fd40, user.id=9b7ccdccba0b4f9e86817946f22dbe28) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:22.553964 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2496ca0-bfeb-4b88-96db-f3e5f1092985 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:22.555370 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2496ca0-bfeb-4b88-96db-f3e5f1092985 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:22.572106 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 256/527] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 10 03:00:22 2022] GET /identity/v3/role_assignments?user.id=9b7ccdccba0b4f9e86817946f22dbe28&scope.project.id=513e6592cd83457b8ff461b0e5e1fd40&role.id=9a5640186d0940658e691be68ccf9205 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:22.572106 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2496ca0-bfeb-4b88-96db-f3e5f1092985 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:22.586552 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 272/528] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:00:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:22.587575 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f4003-7147-4321-aa1c-2889b56016c5 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:22.712691 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f4003-7147-4321-aa1c-2889b56016c5 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:22.749534 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da9b98-bd08-4dbe-acd8-73102fa8079f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:22.752113 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da9b98-bd08-4dbe-acd8-73102fa8079f None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:22.752113 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da9b98-bd08-4dbe-acd8-73102fa8079f None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:22.752113 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da9b98-bd08-4dbe-acd8-73102fa8079f None admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:22.752113 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da9b98-bd08-4dbe-acd8-73102fa8079f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:22.752113 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da9b98-bd08-4dbe-acd8-73102fa8079f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:22.756031 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da9b98-bd08-4dbe-acd8-73102fa8079f None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:22.775701 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 273/529] 10.222.0.65 () {56 vars in 1139 bytes} [Tue May 10 03:00:22 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:22.780554 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da9b98-bd08-4dbe-acd8-73102fa8079f None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:22.780654 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2496ca0-bfeb-4b88-96db-f3e5f1092985 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:22.835456 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca83444-8522-440e-a2df-69d6ee1ae1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:22.836286 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca83444-8522-440e-a2df-69d6ee1ae1cd None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:22.836564 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca83444-8522-440e-a2df-69d6ee1ae1cd None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:22.836833 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca83444-8522-440e-a2df-69d6ee1ae1cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:22.843707 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca83444-8522-440e-a2df-69d6ee1ae1cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:22.845194 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca83444-8522-440e-a2df-69d6ee1ae1cd None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:22.874757 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-eca83444-8522-440e-a2df-69d6ee1ae1cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:00:22.874757 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:22.874757 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:22.874757 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:22.874757 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:22.874757 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:22.874757 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:22.874757 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:22.874757 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:22.874757 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:22.874757 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:22.874757 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:22.874757 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:00:22.874757 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:00:22.874757 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:00:22.875918 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:00:22.875918 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:22.875918 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:22.875918 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:22.875918 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:22.875918 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:22.875918 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:22.875918 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:22.875918 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:22.875918 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:22.875918 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:22.875918 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:22.875918 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:22.875918 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:22.875918 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:22.875918 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:22.875918 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:22.876911 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:00:22.876911 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:00:22.876911 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:00:22.876911 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:00:22.876911 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:00:22.876911 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:00:22.876911 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:00:22.876911 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:22.876911 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 257/530] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 10 03:00:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:22.876911 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca83444-8522-440e-a2df-69d6ee1ae1cd None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:22.885006 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da9b98-bd08-4dbe-acd8-73102fa8079f None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:22.925447 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c87a636-4d44-47d9-a92e-868c2b7266f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:22.926456 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c87a636-4d44-47d9-a92e-868c2b7266f2 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:22.926878 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c87a636-4d44-47d9-a92e-868c2b7266f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:22.927157 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c87a636-4d44-47d9-a92e-868c2b7266f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:22.935072 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c87a636-4d44-47d9-a92e-868c2b7266f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:22.936628 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c87a636-4d44-47d9-a92e-868c2b7266f2 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:22.955258 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-4c87a636-4d44-47d9-a92e-868c2b7266f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:00:22.955258 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:22.955258 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:22.955258 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:22.955258 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:22.955258 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:22.955258 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:22.955258 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:22.955258 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:22.955258 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:22.955258 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:22.955258 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:22.955258 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:00:22.955258 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:00:22.955258 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:00:22.956169 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:00:22.956169 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:22.956169 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:22.956169 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:22.956169 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:22.956169 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:22.956169 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:22.956169 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:22.956169 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:22.956169 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:22.956169 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:22.956169 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:22.956169 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:22.956169 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:22.956169 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:22.956169 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:22.956169 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:22.957447 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:00:22.957447 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:00:22.957447 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:00:22.957447 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:00:22.957447 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:00:22.957447 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:00:22.957447 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:00:22.957447 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:22.957447 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 274/531] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 10 03:00:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:22.957447 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c87a636-4d44-47d9-a92e-868c2b7266f2 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:22.986829 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca83444-8522-440e-a2df-69d6ee1ae1cd None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:23.023097 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41e5376-6123-419c-94d4-6a548428f81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:23.024131 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e5376-6123-419c-94d4-6a548428f81c None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:23.024644 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e5376-6123-419c-94d4-6a548428f81c None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:23.025255 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e5376-6123-419c-94d4-6a548428f81c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:23.059562 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c87a636-4d44-47d9-a92e-868c2b7266f2 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:23.096335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e7879c-a6c4-4526-9f90-4ed196d1aa24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:23.097029 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7879c-a6c4-4526-9f90-4ed196d1aa24 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:23.097334 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7879c-a6c4-4526-9f90-4ed196d1aa24 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:23.097783 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7879c-a6c4-4526-9f90-4ed196d1aa24 None admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:23.098475 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e7879c-a6c4-4526-9f90-4ed196d1aa24 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:23.098789 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e7879c-a6c4-4526-9f90-4ed196d1aa24 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:23.100905 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e7879c-a6c4-4526-9f90-4ed196d1aa24 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:23.112316 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41e5376-6123-419c-94d4-6a548428f81c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:23.114057 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41e5376-6123-419c-94d4-6a548428f81c None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:23.118708 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 275/532] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 10 03:00:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:23.119587 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e7879c-a6c4-4526-9f90-4ed196d1aa24 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:23.230252 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e7879c-a6c4-4526-9f90-4ed196d1aa24 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:23.241314 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 258/533] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 10 03:00:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 03:00:23.241314 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41e5376-6123-419c-94d4-6a548428f81c None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:23.276353 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bc19ed-e144-43e4-b15c-eef5555e8ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:23.277022 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc19ed-e144-43e4-b15c-eef5555e8ff1 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:23.277309 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc19ed-e144-43e4-b15c-eef5555e8ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:23.277586 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc19ed-e144-43e4-b15c-eef5555e8ff1 None admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:23.278389 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bc19ed-e144-43e4-b15c-eef5555e8ff1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:23.278697 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bc19ed-e144-43e4-b15c-eef5555e8ff1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:23.280184 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bc19ed-e144-43e4-b15c-eef5555e8ff1 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:23.292847 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 276/534] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 10 03:00:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:23.293720 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bc19ed-e144-43e4-b15c-eef5555e8ff1 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:23.350443 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41e5376-6123-419c-94d4-6a548428f81c None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:23.385869 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115761f2-e1fd-43bb-a946-135723d6b376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:23.386917 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115761f2-e1fd-43bb-a946-135723d6b376 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:23.387401 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115761f2-e1fd-43bb-a946-135723d6b376 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:23.387910 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115761f2-e1fd-43bb-a946-135723d6b376 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:23.388953 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115761f2-e1fd-43bb-a946-135723d6b376 None admin] RBAC: Adding query filter params (role.id=9a5640186d0940658e691be68ccf9205, scope.project.id=513e6592cd83457b8ff461b0e5e1fd40, user.id=3509cdb58f6a4d05a7ed79e46791ac19) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:23.389461 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115761f2-e1fd-43bb-a946-135723d6b376 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:23.391157 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115761f2-e1fd-43bb-a946-135723d6b376 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:23.393375 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bc19ed-e144-43e4-b15c-eef5555e8ff1 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:23.398668 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 259/535] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 10 03:00:23 2022] GET /identity/v3/role_assignments?user.id=3509cdb58f6a4d05a7ed79e46791ac19&scope.project.id=513e6592cd83457b8ff461b0e5e1fd40&role.id=9a5640186d0940658e691be68ccf9205 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:23.399769 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115761f2-e1fd-43bb-a946-135723d6b376 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:23.434664 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc55a8-865b-42ef-a9bc-1732831a1904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:23.435396 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc55a8-865b-42ef-a9bc-1732831a1904 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:23.435684 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc55a8-865b-42ef-a9bc-1732831a1904 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:23.435965 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc55a8-865b-42ef-a9bc-1732831a1904 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:23.447813 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafc55a8-865b-42ef-a9bc-1732831a1904 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:23.449327 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafc55a8-865b-42ef-a9bc-1732831a1904 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:23.468345 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-cafc55a8-865b-42ef-a9bc-1732831a1904 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:23.468345 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:23.468345 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:23.468345 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:23.468345 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:23.468345 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:23.468345 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:23.468345 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:23.468345 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:23.468345 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:23.468345 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:23.468345 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:23.468345 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:00:23.468345 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:00:23.468345 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:00:23.469191 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:00:23.469191 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:23.469191 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:23.469191 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:23.469191 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:23.469191 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:23.469191 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:23.469191 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:23.469191 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:23.469191 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:23.469191 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:23.469191 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:23.469191 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:23.469191 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:23.469191 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:23.469191 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:23.469191 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:23.470039 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:00:23.470039 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:00:23.470039 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:23.470039 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:23.474127 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 277/536] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:00:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:23.475512 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc55a8-865b-42ef-a9bc-1732831a1904 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:23.520954 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115761f2-e1fd-43bb-a946-135723d6b376 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:23.558039 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb07c76c-eef4-4211-bcd9-126bc97ea5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:23.559099 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb07c76c-eef4-4211-bcd9-126bc97ea5be None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:23.559595 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb07c76c-eef4-4211-bcd9-126bc97ea5be None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:23.560097 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb07c76c-eef4-4211-bcd9-126bc97ea5be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:23.561200 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb07c76c-eef4-4211-bcd9-126bc97ea5be None admin] RBAC: Adding query filter params (role.id=9a5640186d0940658e691be68ccf9205, scope.project.id=513e6592cd83457b8ff461b0e5e1fd40, user.id=c79f0a3a3223444c82589da07305469f) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:23.561712 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb07c76c-eef4-4211-bcd9-126bc97ea5be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:23.563354 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb07c76c-eef4-4211-bcd9-126bc97ea5be None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:23.570438 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 260/537] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 10 03:00:23 2022] GET /identity/v3/role_assignments?user.id=c79f0a3a3223444c82589da07305469f&scope.project.id=513e6592cd83457b8ff461b0e5e1fd40&role.id=9a5640186d0940658e691be68ccf9205 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:23.586548 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc55a8-865b-42ef-a9bc-1732831a1904 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:23.631004 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7aba9d-e385-4301-9261-48f87c4c46e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:23.632332 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7aba9d-e385-4301-9261-48f87c4c46e4 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:23.632620 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7aba9d-e385-4301-9261-48f87c4c46e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:23.632897 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7aba9d-e385-4301-9261-48f87c4c46e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:23.633644 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7aba9d-e385-4301-9261-48f87c4c46e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:23.633962 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7aba9d-e385-4301-9261-48f87c4c46e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:23.635399 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7aba9d-e385-4301-9261-48f87c4c46e4 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:23.657606 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 278/538] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:00:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:23.663269 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb07c76c-eef4-4211-bcd9-126bc97ea5be None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:23.803781 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb07c76c-eef4-4211-bcd9-126bc97ea5be None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:23.839249 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a4e569-c7cf-41f0-bc06-d9fc4b635da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:23.840166 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a4e569-c7cf-41f0-bc06-d9fc4b635da7 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:23.840453 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a4e569-c7cf-41f0-bc06-d9fc4b635da7 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:23.840733 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a4e569-c7cf-41f0-bc06-d9fc4b635da7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:23.848706 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a4e569-c7cf-41f0-bc06-d9fc4b635da7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:23.850286 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a4e569-c7cf-41f0-bc06-d9fc4b635da7 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:23.864659 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-81a4e569-c7cf-41f0-bc06-d9fc4b635da7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:00:23.864659 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:23.864659 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:23.864659 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:23.864659 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:23.864659 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:23.864659 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:23.864659 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:23.864659 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:23.864659 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:23.864659 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:23.864659 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:23.864659 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:00:23.864659 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:00:23.864659 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:00:23.865524 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:00:23.865524 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:23.865524 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:23.865524 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:23.865524 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:23.865524 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:23.865524 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:23.865524 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:23.865524 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:23.865524 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:23.865524 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:23.865524 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:23.865524 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:23.865524 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:23.865524 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:23.865524 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:23.865524 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:23.866901 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:00:23.866901 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:00:23.866901 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:00:23.866901 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:00:23.866901 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:00:23.866901 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:00:23.866901 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:00:23.866901 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:23.866901 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 261/539] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 10 03:00:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:23.872188 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7aba9d-e385-4301-9261-48f87c4c46e4 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:24.014971 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7aba9d-e385-4301-9261-48f87c4c46e4 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:24.066095 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f704bc6-8325-4042-8495-df44d36d49d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:24.066662 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f704bc6-8325-4042-8495-df44d36d49d0 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:24.066944 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f704bc6-8325-4042-8495-df44d36d49d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:24.067217 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f704bc6-8325-4042-8495-df44d36d49d0 None admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:24.068032 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f704bc6-8325-4042-8495-df44d36d49d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:24.068355 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f704bc6-8325-4042-8495-df44d36d49d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:24.069811 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f704bc6-8325-4042-8495-df44d36d49d0 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:24.085408 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 279/540] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 10 03:00:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:24.090992 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a4e569-c7cf-41f0-bc06-d9fc4b635da7 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:24.225711 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a4e569-c7cf-41f0-bc06-d9fc4b635da7 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:24.267741 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece867a-8d6b-4dec-896f-2fb9231cca43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:24.268474 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece867a-8d6b-4dec-896f-2fb9231cca43 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:24.268764 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece867a-8d6b-4dec-896f-2fb9231cca43 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:24.269049 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece867a-8d6b-4dec-896f-2fb9231cca43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:24.269913 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece867a-8d6b-4dec-896f-2fb9231cca43 None admin] RBAC: Adding query filter params (role.id=9a5640186d0940658e691be68ccf9205, scope.project.id=513e6592cd83457b8ff461b0e5e1fd40, user.id=ccfba74826234915bc989fede9bde3e8) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:24.270232 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece867a-8d6b-4dec-896f-2fb9231cca43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:24.271757 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece867a-8d6b-4dec-896f-2fb9231cca43 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:24.279017 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 262/541] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 10 03:00:24 2022] GET /identity/v3/role_assignments?user.id=ccfba74826234915bc989fede9bde3e8&scope.project.id=513e6592cd83457b8ff461b0e5e1fd40&role.id=9a5640186d0940658e691be68ccf9205 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:24.509913 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489bb8b7-5be2-4f37-ad0e-b90e570a8050 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:24.510219 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489bb8b7-5be2-4f37-ad0e-b90e570a8050 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:24.510480 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489bb8b7-5be2-4f37-ad0e-b90e570a8050 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:24.511850 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 280/542] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:00:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:24.517308 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b05584-a6f8-41dc-a9f5-fe177210d245 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:24.517601 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b05584-a6f8-41dc-a9f5-fe177210d245 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:24.517884 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b05584-a6f8-41dc-a9f5-fe177210d245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:24.539281 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-b3b05584-a6f8-41dc-a9f5-fe177210d245 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:24.540537 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-b3b05584-a6f8-41dc-a9f5-fe177210d245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:24.625687 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 263/543] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:00:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:24.661330 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489bb8b7-5be2-4f37-ad0e-b90e570a8050 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:24.789798 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489bb8b7-5be2-4f37-ad0e-b90e570a8050 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:24.833591 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f410b68f-1236-438c-a25c-bcaa73e4aa11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:24.834931 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410b68f-1236-438c-a25c-bcaa73e4aa11 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:24.835222 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410b68f-1236-438c-a25c-bcaa73e4aa11 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:24.835502 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410b68f-1236-438c-a25c-bcaa73e4aa11 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:24.849832 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f410b68f-1236-438c-a25c-bcaa73e4aa11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:24.857826 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-f410b68f-1236-438c-a25c-bcaa73e4aa11 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 03:00:24.857826 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:24.857826 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:24.857826 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:24.857826 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:24.857826 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:24.857826 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:24.857826 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:24.857826 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:24.857826 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:24.857826 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:24.857826 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:24.857826 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:24.857826 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:24.857826 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:24.857826 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:24.858683 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:24.858683 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:24.858683 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:24.858683 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:24.858683 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:24.858683 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:24.858683 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:24.858683 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:24.858683 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:24.858683 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:24.858683 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:24.858683 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:24.858683 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:24.858683 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:24.858683 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:24.858683 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:24.859857 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:24.859857 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:24.859857 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:24.859857 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:24.859857 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:24.859857 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:24.859857 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:24.859857 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:24.859857 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:24.859857 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:24.859857 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 03:00:24.859857 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:24.859857 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 281/544] 10.222.0.65 () {56 vars in 1102 bytes} [Tue May 10 03:00:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:24.869100 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b05584-a6f8-41dc-a9f5-fe177210d245 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:24.993434 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b05584-a6f8-41dc-a9f5-fe177210d245 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:25.035978 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa908f43-1e20-42d3-b83b-8e9ece9e9f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:25.036683 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa908f43-1e20-42d3-b83b-8e9ece9e9f73 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:25.036970 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa908f43-1e20-42d3-b83b-8e9ece9e9f73 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:25.037246 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa908f43-1e20-42d3-b83b-8e9ece9e9f73 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:25.038040 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa908f43-1e20-42d3-b83b-8e9ece9e9f73 None admin] RBAC: Adding query filter params (name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:25.038349 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa908f43-1e20-42d3-b83b-8e9ece9e9f73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:25.039732 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa908f43-1e20-42d3-b83b-8e9ece9e9f73 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:25.048692 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 264/545] 10.222.0.65 () {56 vars in 1103 bytes} [Tue May 10 03:00:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:25.054550 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f410b68f-1236-438c-a25c-bcaa73e4aa11 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:25.191718 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f410b68f-1236-438c-a25c-bcaa73e4aa11 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:25.231545 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c6b6ef-9bf3-4a3e-b4cf-ac5dfc8d52bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:25.232376 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6b6ef-9bf3-4a3e-b4cf-ac5dfc8d52bb None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:25.232661 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6b6ef-9bf3-4a3e-b4cf-ac5dfc8d52bb None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:25.232939 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6b6ef-9bf3-4a3e-b4cf-ac5dfc8d52bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:25.247110 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c6b6ef-9bf3-4a3e-b4cf-ac5dfc8d52bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:25.248639 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c6b6ef-9bf3-4a3e-b4cf-ac5dfc8d52bb None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:25.278026 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-a2c6b6ef-9bf3-4a3e-b4cf-ac5dfc8d52bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:25.278026 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:25.278026 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:25.278026 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:25.278026 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:25.278026 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:25.278026 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:25.278026 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:25.278026 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:25.278026 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:25.278026 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:25.278026 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:25.278026 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:00:25.278026 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:00:25.278026 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:00:25.278988 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:00:25.278988 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:25.278988 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:25.278988 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:25.278988 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:25.278988 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:25.278988 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:25.278988 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:25.278988 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:25.278988 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:25.278988 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:25.278988 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:25.278988 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:25.278988 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:25.278988 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:25.278988 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:25.278988 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:25.279826 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:00:25.279826 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:00:25.279826 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:25.279826 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:25.279826 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 282/546] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:00:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:25.285314 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa908f43-1e20-42d3-b83b-8e9ece9e9f73 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:25.333988 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c0f11-c2fd-4ac3-ba70-da1b675d7e69 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:25.334307 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c0f11-c2fd-4ac3-ba70-da1b675d7e69 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:25.334510 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c0f11-c2fd-4ac3-ba70-da1b675d7e69 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:25.335874 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 283/547] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:00:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:25.348991 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7292ef1-2839-4172-8462-b821af43abeb None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:25.349512 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7292ef1-2839-4172-8462-b821af43abeb None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:25.350038 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7292ef1-2839-4172-8462-b821af43abeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:25.371399 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-d7292ef1-2839-4172-8462-b821af43abeb None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:25.373417 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-d7292ef1-2839-4172-8462-b821af43abeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:25.445036 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa908f43-1e20-42d3-b83b-8e9ece9e9f73 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:25.493948 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4050971b-958f-4169-baa0-df66dfb9ea10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:25.494624 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4050971b-958f-4169-baa0-df66dfb9ea10 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:25.494908 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4050971b-958f-4169-baa0-df66dfb9ea10 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:25.495185 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4050971b-958f-4169-baa0-df66dfb9ea10 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:25.495911 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4050971b-958f-4169-baa0-df66dfb9ea10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:25.496251 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4050971b-958f-4169-baa0-df66dfb9ea10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:25.497626 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4050971b-958f-4169-baa0-df66dfb9ea10 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:25.500784 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 284/548] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:00:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:25.511608 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 265/549] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:00:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:25.516696 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7292ef1-2839-4172-8462-b821af43abeb None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:25.552672 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4050971b-958f-4169-baa0-df66dfb9ea10 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:25.668677 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7292ef1-2839-4172-8462-b821af43abeb None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:25.713897 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19baea3c-d1fc-410b-b754-0cee4688296f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:25.714703 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19baea3c-d1fc-410b-b754-0cee4688296f None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:25.714987 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19baea3c-d1fc-410b-b754-0cee4688296f None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:25.715263 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19baea3c-d1fc-410b-b754-0cee4688296f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:25.728386 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19baea3c-d1fc-410b-b754-0cee4688296f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:25.729855 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19baea3c-d1fc-410b-b754-0cee4688296f None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:25.756720 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-19baea3c-d1fc-410b-b754-0cee4688296f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 03:00:25.756720 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:25.756720 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:25.756720 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:25.756720 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:25.756720 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:25.756720 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:25.756720 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:25.756720 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:25.756720 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:25.756720 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:25.756720 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:25.756720 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:00:25.756720 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:00:25.756720 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:00:25.756720 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:00:25.757666 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:25.757666 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:25.757666 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:00:25.757666 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:00:25.757666 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:00:25.757666 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:00:25.757666 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:25.757666 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:25.757666 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:25.757666 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:25.757666 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:25.757666 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:25.757666 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:25.757666 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:25.757666 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:25.757666 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:25.757666 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:25.757666 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:25.758546 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:25.758546 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:25.758546 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:00:25.758546 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:00:25.758546 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:00:25.758546 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:00:25.758546 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:00:25.758546 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:00:25.758546 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 03:00:25.758546 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:25.758546 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 285/550] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 10 03:00:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:25.766759 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4050971b-958f-4169-baa0-df66dfb9ea10 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:25.770611 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19baea3c-d1fc-410b-b754-0cee4688296f None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:25.825194 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475059f4-f231-4f1f-a109-690294ed79a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:25.826007 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475059f4-f231-4f1f-a109-690294ed79a0 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:25.826294 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475059f4-f231-4f1f-a109-690294ed79a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:25.826569 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475059f4-f231-4f1f-a109-690294ed79a0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:25.851590 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475059f4-f231-4f1f-a109-690294ed79a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:25.859421 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-475059f4-f231-4f1f-a109-690294ed79a0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 03:00:25.859421 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:25.859421 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:25.859421 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:25.859421 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:25.859421 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:25.859421 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:25.859421 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:25.859421 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:25.859421 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:25.859421 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:25.859421 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:25.859421 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:25.859421 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:25.859421 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:25.859421 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:25.861491 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:25.861491 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:25.861491 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:25.861491 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:25.861491 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:25.861491 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:25.861491 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:25.861491 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:25.861491 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:25.861491 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:25.861491 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:25.861491 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:25.861491 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:25.861491 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:25.861491 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:25.861491 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:25.863476 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:25.863476 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:25.863476 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:25.863476 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:25.863476 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:25.863476 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:25.863476 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:25.863476 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:25.863476 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:25.863476 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:25.863476 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 03:00:25.863476 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:25.863476 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 266/551] 10.222.0.65 () {56 vars in 1102 bytes} [Tue May 10 03:00:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:25.875032 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475059f4-f231-4f1f-a109-690294ed79a0 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:25.926866 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19baea3c-d1fc-410b-b754-0cee4688296f None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:25.971287 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213d4dba-b2de-491f-acad-781b563cbc66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:25.972316 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d4dba-b2de-491f-acad-781b563cbc66 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:25.972801 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d4dba-b2de-491f-acad-781b563cbc66 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:25.973253 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d4dba-b2de-491f-acad-781b563cbc66 None admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:25.974285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213d4dba-b2de-491f-acad-781b563cbc66 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:25.974795 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213d4dba-b2de-491f-acad-781b563cbc66 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:25.976975 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213d4dba-b2de-491f-acad-781b563cbc66 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:26.011692 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 286/552] 10.222.0.65 () {56 vars in 1135 bytes} [Tue May 10 03:00:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:26.016688 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213d4dba-b2de-491f-acad-781b563cbc66 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:26.057689 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475059f4-f231-4f1f-a109-690294ed79a0 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:26.106351 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a22a327-b73a-4108-8c04-496c29e7380a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:26.107388 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22a327-b73a-4108-8c04-496c29e7380a None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:26.107876 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22a327-b73a-4108-8c04-496c29e7380a None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:26.108376 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22a327-b73a-4108-8c04-496c29e7380a None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:26.109331 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a22a327-b73a-4108-8c04-496c29e7380a None admin] RBAC: Adding query filter params (name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:26.109861 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a22a327-b73a-4108-8c04-496c29e7380a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:26.111432 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a22a327-b73a-4108-8c04-496c29e7380a None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:26.129599 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 267/553] 10.222.0.65 () {56 vars in 1103 bytes} [Tue May 10 03:00:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:26.135104 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a22a327-b73a-4108-8c04-496c29e7380a None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:26.216769 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213d4dba-b2de-491f-acad-781b563cbc66 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:26.274096 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a22a327-b73a-4108-8c04-496c29e7380a None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:26.281178 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c0b2c-b119-4b79-a86a-e3e93096a89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:26.282100 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c0b2c-b119-4b79-a86a-e3e93096a89b None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:26.282839 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c0b2c-b119-4b79-a86a-e3e93096a89b None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:26.283373 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c0b2c-b119-4b79-a86a-e3e93096a89b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:26.309934 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f94ef4-1a3e-4a6c-8a74-b39e107bee73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:26.310529 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f94ef4-1a3e-4a6c-8a74-b39e107bee73 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:26.310817 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f94ef4-1a3e-4a6c-8a74-b39e107bee73 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:26.311097 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f94ef4-1a3e-4a6c-8a74-b39e107bee73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:26.322762 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f94ef4-1a3e-4a6c-8a74-b39e107bee73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:26.324273 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f94ef4-1a3e-4a6c-8a74-b39e107bee73 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:26.342226 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-a6f94ef4-1a3e-4a6c-8a74-b39e107bee73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:26.342226 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:26.342226 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:26.342226 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:26.342226 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:26.342226 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:26.342226 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:26.342226 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:26.342226 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:26.342226 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:26.342226 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:26.342226 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:26.342226 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:00:26.342226 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:00:26.342226 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:00:26.343115 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:00:26.343115 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:26.343115 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:26.343115 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:26.343115 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:26.343115 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:26.343115 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:26.343115 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:26.343115 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:26.343115 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:26.343115 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:26.343115 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:26.343115 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:26.343115 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:26.343115 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:26.343115 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:26.343115 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:26.343936 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:00:26.343936 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:00:26.343936 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:26.343936 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:26.343936 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 268/554] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:00:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:26.345063 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddcb2b1-afae-4035-b425-baed78c704ac None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:26.345292 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddcb2b1-afae-4035-b425-baed78c704ac None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:26.345571 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddcb2b1-afae-4035-b425-baed78c704ac None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:26.346952 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 269/555] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:00:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:26.351900 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddcb2b1-afae-4035-b425-baed78c704ac None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:26.361029 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257c0b2c-b119-4b79-a86a-e3e93096a89b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:26.362782 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257c0b2c-b119-4b79-a86a-e3e93096a89b None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:26.459169 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddcb2b1-afae-4035-b425-baed78c704ac None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:26.474698 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 287/556] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 10 03:00:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 03:00:26.476467 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587bbac-81af-42c4-93bd-51e1832ab8cc None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:26.476955 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587bbac-81af-42c4-93bd-51e1832ab8cc None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:26.477425 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587bbac-81af-42c4-93bd-51e1832ab8cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:26.493777 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-f587bbac-81af-42c4-93bd-51e1832ab8cc None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:26.494995 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-f587bbac-81af-42c4-93bd-51e1832ab8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:26.498428 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ff709-388e-46e9-9c98-43afd61afbd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:26.499109 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ff709-388e-46e9-9c98-43afd61afbd7 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:26.499384 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ff709-388e-46e9-9c98-43afd61afbd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:26.499659 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ff709-388e-46e9-9c98-43afd61afbd7 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:26.500417 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6ff709-388e-46e9-9c98-43afd61afbd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:26.500729 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6ff709-388e-46e9-9c98-43afd61afbd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:26.502104 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6ff709-388e-46e9-9c98-43afd61afbd7 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:26.518357 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 270/557] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:00:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:26.518357 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31684d86-a937-4f11-b7fd-0b3fa1edf9de None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:26.518357 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31684d86-a937-4f11-b7fd-0b3fa1edf9de None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:26.518357 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31684d86-a937-4f11-b7fd-0b3fa1edf9de None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:26.518357 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 271/558] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:00:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:26.518741 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31684d86-a937-4f11-b7fd-0b3fa1edf9de None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:26.567490 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 288/559] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:00:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:26.572051 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f587bbac-81af-42c4-93bd-51e1832ab8cc None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:26.625415 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31684d86-a937-4f11-b7fd-0b3fa1edf9de None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:26.661578 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c225a3-5d4e-4f05-b139-64aa03b094b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:26.662439 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c225a3-5d4e-4f05-b139-64aa03b094b8 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:26.662720 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c225a3-5d4e-4f05-b139-64aa03b094b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:26.662997 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c225a3-5d4e-4f05-b139-64aa03b094b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:26.669763 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f587bbac-81af-42c4-93bd-51e1832ab8cc None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:26.674220 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c225a3-5d4e-4f05-b139-64aa03b094b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:26.675708 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c225a3-5d4e-4f05-b139-64aa03b094b8 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:26.694512 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-36c225a3-5d4e-4f05-b139-64aa03b094b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:26.694512 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:26.694512 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:26.694512 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:26.694512 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:26.694512 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:26.694512 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:26.694512 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:26.694512 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:26.694512 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:26.694512 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:26.694512 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:26.694512 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:00:26.694512 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:00:26.694512 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:00:26.695399 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:00:26.695399 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:26.695399 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:26.695399 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:26.695399 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:26.695399 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:26.695399 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:26.695399 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:26.695399 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:26.695399 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:26.695399 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:26.695399 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:26.695399 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:26.695399 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:26.695399 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:26.695399 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:26.695399 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:26.696262 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:00:26.696262 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:00:26.696262 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:26.696262 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:26.696262 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 272/560] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:00:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:26.697343 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6ba2b-5379-4e71-9049-fbfaffedda19 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:26.697446 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6ba2b-5379-4e71-9049-fbfaffedda19 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:26.704057 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6ba2b-5379-4e71-9049-fbfaffedda19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:26.713664 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f50a5-0d2c-4132-aa8a-06cae4279576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:26.713807 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-b0b6ba2b-5379-4e71-9049-fbfaffedda19 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:26.714462 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f50a5-0d2c-4132-aa8a-06cae4279576 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:26.714742 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f50a5-0d2c-4132-aa8a-06cae4279576 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:26.714913 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-b0b6ba2b-5379-4e71-9049-fbfaffedda19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:26.715023 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f50a5-0d2c-4132-aa8a-06cae4279576 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:26.722212 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8f50a5-0d2c-4132-aa8a-06cae4279576 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:26.723659 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8f50a5-0d2c-4132-aa8a-06cae4279576 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:26.738104 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-bb8f50a5-0d2c-4132-aa8a-06cae4279576 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 03:00:26.738104 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:26.738104 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:26.738104 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:26.738104 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:26.738104 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:26.738104 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:26.738104 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:26.738104 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:26.738104 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:26.738104 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:26.738104 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:26.738104 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:00:26.738104 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:00:26.738104 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:00:26.738104 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:00:26.739017 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:26.739017 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:26.739017 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:00:26.739017 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:00:26.739017 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:00:26.739017 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:00:26.739017 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:26.739017 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:26.739017 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:26.739017 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:26.739017 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:26.739017 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:26.739017 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:26.739017 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:26.739017 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:26.739017 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:26.739017 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:26.739017 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:26.739905 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:26.739905 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:26.739905 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:00:26.739905 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:00:26.739905 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:00:26.739905 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:00:26.739905 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:00:26.739905 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:00:26.739905 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 03:00:26.739905 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:26.742894 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 289/561] 10.222.0.65 () {56 vars in 1093 bytes} [Tue May 10 03:00:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:26.743858 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f50a5-0d2c-4132-aa8a-06cae4279576 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:26.796405 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 273/562] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:00:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:26.798058 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b6ba2b-5379-4e71-9049-fbfaffedda19 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:26.842033 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f50a5-0d2c-4132-aa8a-06cae4279576 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:26.874180 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f0c80a-598b-445c-b463-bb5b61ba890b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:26.875076 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f0c80a-598b-445c-b463-bb5b61ba890b None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:26.875367 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f0c80a-598b-445c-b463-bb5b61ba890b None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:26.875647 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f0c80a-598b-445c-b463-bb5b61ba890b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:26.885886 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f0c80a-598b-445c-b463-bb5b61ba890b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:26.893624 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-a3f0c80a-598b-445c-b463-bb5b61ba890b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 03:00:26.893624 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:26.893624 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:26.893624 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:26.893624 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:26.893624 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:26.893624 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:26.893624 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:26.893624 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:26.893624 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:26.893624 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:26.893624 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:26.893624 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:26.893624 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:26.893624 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:26.893624 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:26.894799 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:26.894799 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:26.894799 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:26.894799 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:26.894799 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:26.894799 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:26.894799 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:26.894799 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:26.894799 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:26.894799 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:26.894799 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:26.894799 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:26.894799 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:26.894799 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:26.894799 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:26.894799 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:26.895587 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:26.895587 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:26.895587 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:26.895587 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:26.895587 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:26.895587 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:26.895587 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:26.895587 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:26.895587 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:26.895587 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:26.895587 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 03:00:26.895587 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:26.895587 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 290/563] 10.222.0.65 () {56 vars in 1102 bytes} [Tue May 10 03:00:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:26.895587 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f0c80a-598b-445c-b463-bb5b61ba890b None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:26.897908 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b6ba2b-5379-4e71-9049-fbfaffedda19 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:26.931186 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848cbcfa-84e2-481f-9011-09e6fe538682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:26.931844 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848cbcfa-84e2-481f-9011-09e6fe538682 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:26.932166 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848cbcfa-84e2-481f-9011-09e6fe538682 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:26.932447 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848cbcfa-84e2-481f-9011-09e6fe538682 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:26.933162 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848cbcfa-84e2-481f-9011-09e6fe538682 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:26.933468 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848cbcfa-84e2-481f-9011-09e6fe538682 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:26.934835 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848cbcfa-84e2-481f-9011-09e6fe538682 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:26.945668 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 274/564] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:00:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:26.946986 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848cbcfa-84e2-481f-9011-09e6fe538682 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:27.003493 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f0c80a-598b-445c-b463-bb5b61ba890b None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:27.035397 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1309375-e726-453a-955c-f92c8ab9330f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:27.036164 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1309375-e726-453a-955c-f92c8ab9330f None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:27.036448 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1309375-e726-453a-955c-f92c8ab9330f None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:27.036723 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1309375-e726-453a-955c-f92c8ab9330f None admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:27.038068 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1309375-e726-453a-955c-f92c8ab9330f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:27.038376 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1309375-e726-453a-955c-f92c8ab9330f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:27.039793 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1309375-e726-453a-955c-f92c8ab9330f None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:27.042468 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848cbcfa-84e2-481f-9011-09e6fe538682 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:27.056539 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 291/565] 10.222.0.65 () {56 vars in 1133 bytes} [Tue May 10 03:00:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:27.057773 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01665cec-f759-4599-8a08-2b78f1175ca3 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:27.058061 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01665cec-f759-4599-8a08-2b78f1175ca3 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:27.058349 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01665cec-f759-4599-8a08-2b78f1175ca3 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:27.059699 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 292/566] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:00:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:27.060246 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01665cec-f759-4599-8a08-2b78f1175ca3 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:27.078834 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981aae9a-4b3c-4e5c-92e2-66f474c52635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:27.079627 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981aae9a-4b3c-4e5c-92e2-66f474c52635 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:27.079912 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981aae9a-4b3c-4e5c-92e2-66f474c52635 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:27.080230 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981aae9a-4b3c-4e5c-92e2-66f474c52635 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:27.089991 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981aae9a-4b3c-4e5c-92e2-66f474c52635 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:27.097555 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-981aae9a-4b3c-4e5c-92e2-66f474c52635 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 03:00:27.097555 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:27.097555 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:27.097555 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:27.097555 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:27.097555 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:27.097555 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:27.097555 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:27.097555 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:27.097555 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:27.097555 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:27.097555 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:27.097555 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:27.097555 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:27.097555 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:27.097555 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:27.098447 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:27.098447 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:27.098447 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:27.098447 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:27.098447 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:27.098447 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:27.098447 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:27.098447 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:27.098447 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:27.098447 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:27.098447 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:27.098447 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:27.098447 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:27.098447 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:27.098447 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:27.098447 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:27.099286 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:27.099286 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:27.099286 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:27.099286 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:27.099286 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:27.099286 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:27.099286 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:27.099286 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:27.099286 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:27.099286 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:27.099286 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 03:00:27.099286 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:27.099286 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 275/567] 10.222.0.65 () {56 vars in 1102 bytes} [Tue May 10 03:00:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:27.100515 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981aae9a-4b3c-4e5c-92e2-66f474c52635 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:27.163987 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01665cec-f759-4599-8a08-2b78f1175ca3 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:27.195351 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a7c18-e45a-4c43-b67a-c342cc8b1ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:27.196030 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a7c18-e45a-4c43-b67a-c342cc8b1ec9 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:27.196306 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a7c18-e45a-4c43-b67a-c342cc8b1ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:27.196578 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a7c18-e45a-4c43-b67a-c342cc8b1ec9 None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:27.197317 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1a7c18-e45a-4c43-b67a-c342cc8b1ec9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:27.197620 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1a7c18-e45a-4c43-b67a-c342cc8b1ec9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:27.198530 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981aae9a-4b3c-4e5c-92e2-66f474c52635 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:27.198974 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1a7c18-e45a-4c43-b67a-c342cc8b1ec9 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:27.206527 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 293/568] 10.222.0.65 () {56 vars in 1103 bytes} [Tue May 10 03:00:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:27.207297 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a7c18-e45a-4c43-b67a-c342cc8b1ec9 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:27.231335 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c5818a-6cac-4d13-9c1d-fa51b24e083f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:27.232170 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c5818a-6cac-4d13-9c1d-fa51b24e083f None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:27.232453 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c5818a-6cac-4d13-9c1d-fa51b24e083f None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:27.232729 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c5818a-6cac-4d13-9c1d-fa51b24e083f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:27.239181 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c5818a-6cac-4d13-9c1d-fa51b24e083f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:27.241243 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c5818a-6cac-4d13-9c1d-fa51b24e083f None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:27.255108 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-86c5818a-6cac-4d13-9c1d-fa51b24e083f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:00:27.255108 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:27.255108 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:27.255108 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:27.255108 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:27.255108 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:27.255108 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:27.255108 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:27.255108 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:27.255108 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:27.255108 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:27.255108 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:27.255108 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:00:27.255108 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:00:27.255108 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:00:27.256153 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:00:27.256153 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:27.256153 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:27.256153 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:27.256153 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:27.256153 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:27.256153 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:27.256153 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:27.256153 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:27.256153 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:27.256153 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:27.256153 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:27.256153 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:27.256153 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:27.256153 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:27.256153 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:27.256153 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:27.261861 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:00:27.261861 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:00:27.261861 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:00:27.261861 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:00:27.261861 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:00:27.261861 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:00:27.261861 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:00:27.261861 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:27.261861 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 276/569] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 10 03:00:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:27.261861 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1cd013-8592-4c93-92c0-26277244faa4 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:27.261861 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1cd013-8592-4c93-92c0-26277244faa4 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:27.262604 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1cd013-8592-4c93-92c0-26277244faa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:27.274054 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-4e1cd013-8592-4c93-92c0-26277244faa4 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:27.275234 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-4e1cd013-8592-4c93-92c0-26277244faa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:27.307755 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a7c18-e45a-4c43-b67a-c342cc8b1ec9 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:27.338068 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 277/570] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:00:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:27.338703 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1cd013-8592-4c93-92c0-26277244faa4 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:27.353606 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8082db7a-1b65-4607-8616-67b15e036369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:27.354413 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082db7a-1b65-4607-8616-67b15e036369 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:27.354698 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082db7a-1b65-4607-8616-67b15e036369 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:27.354975 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082db7a-1b65-4607-8616-67b15e036369 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:27.365948 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8082db7a-1b65-4607-8616-67b15e036369 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:27.367378 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8082db7a-1b65-4607-8616-67b15e036369 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:27.383758 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-8082db7a-1b65-4607-8616-67b15e036369 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:27.383758 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:27.383758 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:27.383758 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:27.383758 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:27.383758 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:27.383758 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:27.383758 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:27.383758 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:27.383758 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:27.383758 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:27.383758 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:27.383758 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:00:27.383758 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:00:27.383758 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:00:27.384813 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:00:27.384813 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:27.384813 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:27.384813 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:27.384813 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:27.384813 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:27.384813 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:27.384813 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:27.384813 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:27.384813 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:27.384813 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:27.384813 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:27.384813 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:27.384813 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:27.384813 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:27.384813 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:27.384813 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:27.386366 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:00:27.386366 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:00:27.386366 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:27.386366 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:27.386366 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 294/571] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:00:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:27.386366 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8082db7a-1b65-4607-8616-67b15e036369 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:27.445301 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1cd013-8592-4c93-92c0-26277244faa4 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:27.479071 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca7e7f-126b-4a6a-a93e-adfa3546a392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:27.479741 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca7e7f-126b-4a6a-a93e-adfa3546a392 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:27.480051 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca7e7f-126b-4a6a-a93e-adfa3546a392 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:27.480334 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca7e7f-126b-4a6a-a93e-adfa3546a392 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:27.481087 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ca7e7f-126b-4a6a-a93e-adfa3546a392 None admin] RBAC: Adding query filter params (name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:27.481393 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ca7e7f-126b-4a6a-a93e-adfa3546a392 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:27.482717 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8082db7a-1b65-4607-8616-67b15e036369 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:27.482845 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ca7e7f-126b-4a6a-a93e-adfa3546a392 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:27.490390 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 278/572] 10.222.0.65 () {56 vars in 1103 bytes} [Tue May 10 03:00:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:27.491177 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca7e7f-126b-4a6a-a93e-adfa3546a392 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:27.514675 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb12716-0dc5-4b9e-af3a-952af248f700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:27.515411 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb12716-0dc5-4b9e-af3a-952af248f700 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:27.515690 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb12716-0dc5-4b9e-af3a-952af248f700 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:27.515964 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb12716-0dc5-4b9e-af3a-952af248f700 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:27.526588 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb12716-0dc5-4b9e-af3a-952af248f700 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:27.528012 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb12716-0dc5-4b9e-af3a-952af248f700 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:27.545110 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-afb12716-0dc5-4b9e-af3a-952af248f700 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:27.545110 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:27.545110 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:27.545110 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:27.545110 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:27.545110 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:27.545110 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:27.545110 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:27.545110 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:27.545110 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:27.545110 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:27.545110 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:27.545110 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:00:27.545110 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:00:27.545110 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:00:27.546254 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:00:27.546254 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:27.546254 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:27.546254 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:27.546254 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:27.546254 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:27.546254 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:27.546254 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:27.546254 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:27.546254 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:27.546254 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:27.546254 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:27.546254 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:27.546254 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:27.546254 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:27.546254 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:27.546254 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:27.547849 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:00:27.547849 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:00:27.547849 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:27.547849 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:27.547849 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 295/573] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:00:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:27.547849 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb12716-0dc5-4b9e-af3a-952af248f700 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:27.588241 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca7e7f-126b-4a6a-a93e-adfa3546a392 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:27.619682 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af55742-8607-4b1d-a1fa-b3b1a792c6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:27.620356 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af55742-8607-4b1d-a1fa-b3b1a792c6c4 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:27.620638 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af55742-8607-4b1d-a1fa-b3b1a792c6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:27.620908 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af55742-8607-4b1d-a1fa-b3b1a792c6c4 None admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:27.621681 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af55742-8607-4b1d-a1fa-b3b1a792c6c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:27.621989 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af55742-8607-4b1d-a1fa-b3b1a792c6c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:27.623419 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af55742-8607-4b1d-a1fa-b3b1a792c6c4 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:27.634815 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 279/574] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 10 03:00:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:27.635595 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af55742-8607-4b1d-a1fa-b3b1a792c6c4 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:27.638633 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb12716-0dc5-4b9e-af3a-952af248f700 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:27.671174 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94688c5f-5761-435e-8099-816a173bbd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:27.671956 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94688c5f-5761-435e-8099-816a173bbd94 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:27.672267 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94688c5f-5761-435e-8099-816a173bbd94 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:27.672537 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94688c5f-5761-435e-8099-816a173bbd94 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:27.682091 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94688c5f-5761-435e-8099-816a173bbd94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:27.689729 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-94688c5f-5761-435e-8099-816a173bbd94 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 03:00:27.689729 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:27.689729 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:27.689729 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:27.689729 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:27.689729 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:27.689729 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:27.689729 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:27.689729 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:27.689729 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:27.689729 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:27.689729 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:27.689729 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:27.689729 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:27.689729 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:27.689729 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:27.690747 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:27.690747 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:27.690747 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:27.690747 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:27.690747 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:27.690747 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:27.690747 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:27.690747 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:27.690747 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:27.690747 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:27.690747 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:27.690747 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:27.690747 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:27.690747 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:27.690747 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:27.690747 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:27.691545 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:27.691545 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:27.691545 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:27.691545 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:27.691545 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:27.691545 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:27.691545 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:27.691545 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:27.691545 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:27.691545 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:27.691545 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 03:00:27.691545 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:27.696049 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 296/575] 10.222.0.65 () {56 vars in 1102 bytes} [Tue May 10 03:00:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:27.696862 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94688c5f-5761-435e-8099-816a173bbd94 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:27.729271 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af55742-8607-4b1d-a1fa-b3b1a792c6c4 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:27.760502 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba643d-0252-4c89-acea-11145a0eba1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:27.761151 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba643d-0252-4c89-acea-11145a0eba1b None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:27.761430 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba643d-0252-4c89-acea-11145a0eba1b None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:27.761809 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba643d-0252-4c89-acea-11145a0eba1b None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:27.762520 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acba643d-0252-4c89-acea-11145a0eba1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:27.762821 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acba643d-0252-4c89-acea-11145a0eba1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:27.764209 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acba643d-0252-4c89-acea-11145a0eba1b None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:27.775323 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 280/576] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:00:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:27.776050 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba643d-0252-4c89-acea-11145a0eba1b None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:27.790080 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94688c5f-5761-435e-8099-816a173bbd94 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:27.826270 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc73765-5cef-4455-96c0-3bdc11e3569c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:27.827054 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc73765-5cef-4455-96c0-3bdc11e3569c None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:27.827334 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc73765-5cef-4455-96c0-3bdc11e3569c None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:27.827609 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc73765-5cef-4455-96c0-3bdc11e3569c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:27.838214 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc73765-5cef-4455-96c0-3bdc11e3569c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:27.839650 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc73765-5cef-4455-96c0-3bdc11e3569c None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:27.855800 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-8fc73765-5cef-4455-96c0-3bdc11e3569c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:27.855800 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:27.855800 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:27.855800 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:27.855800 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:27.855800 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:27.855800 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:27.855800 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:27.855800 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:27.855800 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:27.855800 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:27.855800 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:27.855800 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:00:27.855800 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:00:27.855800 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:00:27.856722 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:00:27.856722 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:27.856722 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:27.856722 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:27.856722 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:27.856722 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:27.856722 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:27.856722 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:27.856722 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:27.856722 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:27.856722 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:27.856722 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:27.856722 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:27.856722 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:27.856722 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:27.856722 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:27.856722 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:27.857590 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:00:27.857590 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:00:27.857590 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:27.857590 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:27.857590 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 297/577] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:00:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:27.857867 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc73765-5cef-4455-96c0-3bdc11e3569c None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:27.876151 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba643d-0252-4c89-acea-11145a0eba1b None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:27.908446 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff1bb4f-36bd-47e9-b3eb-3d83bc305624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:27.909095 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1bb4f-36bd-47e9-b3eb-3d83bc305624 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:27.909376 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1bb4f-36bd-47e9-b3eb-3d83bc305624 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:27.909654 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1bb4f-36bd-47e9-b3eb-3d83bc305624 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:27.910393 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff1bb4f-36bd-47e9-b3eb-3d83bc305624 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:27.910694 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff1bb4f-36bd-47e9-b3eb-3d83bc305624 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:27.912086 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff1bb4f-36bd-47e9-b3eb-3d83bc305624 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:27.923380 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 281/578] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:00:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:27.924199 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff1bb4f-36bd-47e9-b3eb-3d83bc305624 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:27.950758 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc73765-5cef-4455-96c0-3bdc11e3569c None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:27.983444 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642e419f-c3a0-4ef0-a75f-996058e8c0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:27.988135 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e419f-c3a0-4ef0-a75f-996058e8c0d1 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:27.988135 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e419f-c3a0-4ef0-a75f-996058e8c0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:27.988135 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e419f-c3a0-4ef0-a75f-996058e8c0d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:27.988135 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642e419f-c3a0-4ef0-a75f-996058e8c0d1 None admin] RBAC: Adding query filter params (role.id=9a5640186d0940658e691be68ccf9205, scope.project.id=513e6592cd83457b8ff461b0e5e1fd40, user.id=f1cb8ad43a234233ad602f451f0f8ebf) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:27.988135 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642e419f-c3a0-4ef0-a75f-996058e8c0d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:27.988135 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642e419f-c3a0-4ef0-a75f-996058e8c0d1 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:27.992449 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 298/579] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 10 03:00:27 2022] GET /identity/v3/role_assignments?user.id=f1cb8ad43a234233ad602f451f0f8ebf&scope.project.id=513e6592cd83457b8ff461b0e5e1fd40&role.id=9a5640186d0940658e691be68ccf9205 => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:27.993230 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642e419f-c3a0-4ef0-a75f-996058e8c0d1 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:28.019024 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff1bb4f-36bd-47e9-b3eb-3d83bc305624 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:28.100486 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cdc41c-5f7d-4cd9-abc1-2c3e96a3817a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:28.101089 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdc41c-5f7d-4cd9-abc1-2c3e96a3817a None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:28.101368 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdc41c-5f7d-4cd9-abc1-2c3e96a3817a None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:28.101637 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdc41c-5f7d-4cd9-abc1-2c3e96a3817a None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:28.102391 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cdc41c-5f7d-4cd9-abc1-2c3e96a3817a None admin] RBAC: Adding query filter params (name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:28.102693 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cdc41c-5f7d-4cd9-abc1-2c3e96a3817a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:28.104098 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cdc41c-5f7d-4cd9-abc1-2c3e96a3817a None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:28.112671 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 282/580] 10.222.0.65 () {56 vars in 1103 bytes} [Tue May 10 03:00:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:28.113890 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cdc41c-5f7d-4cd9-abc1-2c3e96a3817a None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:28.136267 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642e419f-c3a0-4ef0-a75f-996058e8c0d1 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:28.171404 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a87b5b0-8107-430e-bfea-58b7c517ff49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:28.172236 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87b5b0-8107-430e-bfea-58b7c517ff49 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:28.172520 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87b5b0-8107-430e-bfea-58b7c517ff49 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:28.172794 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87b5b0-8107-430e-bfea-58b7c517ff49 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:28.180223 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a87b5b0-8107-430e-bfea-58b7c517ff49 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:28.181897 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a87b5b0-8107-430e-bfea-58b7c517ff49 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:28.197973 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-7a87b5b0-8107-430e-bfea-58b7c517ff49 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:00:28.197973 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:28.197973 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:28.197973 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:28.197973 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:28.197973 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:28.197973 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:28.197973 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:28.197973 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:28.197973 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:28.197973 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:28.197973 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:28.197973 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:00:28.197973 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:00:28.197973 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:00:28.198933 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:00:28.198933 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:28.198933 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:28.198933 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:28.198933 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:28.198933 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:28.198933 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:28.198933 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:28.198933 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:28.198933 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:28.198933 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:28.198933 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:28.198933 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:28.198933 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:28.198933 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:28.198933 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:28.198933 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:28.200552 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:00:28.200552 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:00:28.200552 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:00:28.200552 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:00:28.200552 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:00:28.200552 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:00:28.200552 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:00:28.200552 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:28.200552 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 299/581] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 10 03:00:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:28.200552 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a87b5b0-8107-430e-bfea-58b7c517ff49 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:28.221325 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cdc41c-5f7d-4cd9-abc1-2c3e96a3817a None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:28.254175 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfc3315-49c5-4e95-b0a8-f64c4bf753dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:28.254843 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc3315-49c5-4e95-b0a8-f64c4bf753dc None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:28.255132 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc3315-49c5-4e95-b0a8-f64c4bf753dc None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:28.255412 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc3315-49c5-4e95-b0a8-f64c4bf753dc None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:28.256798 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfc3315-49c5-4e95-b0a8-f64c4bf753dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:28.257114 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfc3315-49c5-4e95-b0a8-f64c4bf753dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:28.258489 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfc3315-49c5-4e95-b0a8-f64c4bf753dc None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:28.270127 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 283/582] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:00:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:28.270827 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfc3315-49c5-4e95-b0a8-f64c4bf753dc None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:28.299168 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a87b5b0-8107-430e-bfea-58b7c517ff49 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:28.333328 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc1c94-10e8-4ece-b3b0-43fb6d1ebebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:28.334151 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc1c94-10e8-4ece-b3b0-43fb6d1ebebb None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:28.334446 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc1c94-10e8-4ece-b3b0-43fb6d1ebebb None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:28.334721 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc1c94-10e8-4ece-b3b0-43fb6d1ebebb None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:28.341869 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cc1c94-10e8-4ece-b3b0-43fb6d1ebebb None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:28.343292 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cc1c94-10e8-4ece-b3b0-43fb6d1ebebb None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:28.358685 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-30cc1c94-10e8-4ece-b3b0-43fb6d1ebebb None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 10 03:00:28.358685 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:28.358685 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:28.358685 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:28.358685 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:28.358685 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:28.358685 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:28.358685 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:28.358685 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:28.358685 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:28.358685 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:28.358685 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:28.358685 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:00:28.358685 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:00:28.358685 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:00:28.358685 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:00:28.359689 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:28.359689 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:28.359689 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:00:28.359689 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:00:28.359689 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:00:28.359689 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:00:28.359689 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:28.359689 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:28.359689 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:28.359689 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:28.359689 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:28.359689 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:28.359689 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:28.359689 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:28.359689 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:28.359689 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:28.359689 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:28.359689 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:28.361275 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:28.361275 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:28.361275 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:00:28.361275 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:00:28.361275 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:00:28.361275 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:00:28.361275 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:00:28.361275 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:00:28.361275 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 10 03:00:28.361275 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:28.361275 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 300/583] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 10 03:00:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:28.361275 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc1c94-10e8-4ece-b3b0-43fb6d1ebebb None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:28.370443 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfc3315-49c5-4e95-b0a8-f64c4bf753dc None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:28.403827 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec4dc21-6108-486b-92ed-5d7ad77484f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:28.404649 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4dc21-6108-486b-92ed-5d7ad77484f8 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:28.404929 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4dc21-6108-486b-92ed-5d7ad77484f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:28.405200 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4dc21-6108-486b-92ed-5d7ad77484f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:28.415903 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec4dc21-6108-486b-92ed-5d7ad77484f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:28.417453 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec4dc21-6108-486b-92ed-5d7ad77484f8 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:28.436052 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-4ec4dc21-6108-486b-92ed-5d7ad77484f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:28.436052 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:28.436052 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:28.436052 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:28.436052 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:28.436052 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:28.436052 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:28.436052 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:28.436052 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:28.436052 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:28.436052 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:28.436052 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:28.436052 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:00:28.436052 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:00:28.436052 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:00:28.437123 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:00:28.437123 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:28.437123 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:28.437123 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:28.437123 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:28.437123 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:28.437123 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:28.437123 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:28.437123 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:28.437123 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:28.437123 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:28.437123 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:28.437123 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:28.437123 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:28.437123 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:28.437123 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:28.437123 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:28.438011 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:00:28.438011 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:00:28.438011 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:28.438011 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:28.438011 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 284/584] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:00:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:28.438011 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec4dc21-6108-486b-92ed-5d7ad77484f8 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:28.466780 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc1c94-10e8-4ece-b3b0-43fb6d1ebebb None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:28.501964 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece3940-f736-4bce-8f83-63118ab3c56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:28.502622 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece3940-f736-4bce-8f83-63118ab3c56a None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:28.502899 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece3940-f736-4bce-8f83-63118ab3c56a None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:28.503173 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece3940-f736-4bce-8f83-63118ab3c56a None admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:28.503953 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ece3940-f736-4bce-8f83-63118ab3c56a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:28.504288 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ece3940-f736-4bce-8f83-63118ab3c56a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:28.505693 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ece3940-f736-4bce-8f83-63118ab3c56a None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:28.516942 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 301/585] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 10 03:00:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:28.518033 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece3940-f736-4bce-8f83-63118ab3c56a None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:28.546296 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec4dc21-6108-486b-92ed-5d7ad77484f8 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:28.582630 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c8e570-e897-43f7-b167-7384356dc18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:28.583428 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c8e570-e897-43f7-b167-7384356dc18d None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:28.583710 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c8e570-e897-43f7-b167-7384356dc18d None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:28.584019 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c8e570-e897-43f7-b167-7384356dc18d None admin] PATH_INFO: `/v3/users/glance` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:28.591020 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c8e570-e897-43f7-b167-7384356dc18d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:28.592511 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c8e570-e897-43f7-b167-7384356dc18d None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:28.607165 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-f6c8e570-e897-43f7-b167-7384356dc18d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 10 03:00:28.607165 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:28.607165 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:28.607165 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:28.607165 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:28.607165 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:28.607165 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:28.607165 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:28.607165 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:28.607165 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:28.607165 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:28.607165 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:28.607165 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:00:28.607165 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:00:28.607165 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:00:28.607165 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:00:28.608115 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:28.608115 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:28.608115 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:00:28.608115 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:00:28.608115 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:00:28.608115 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:00:28.608115 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:28.608115 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:28.608115 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:28.608115 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:28.608115 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:28.608115 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:28.608115 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:28.608115 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:28.608115 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:28.608115 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:28.608115 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:28.608115 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:28.609082 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:28.609082 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:28.609082 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:00:28.609082 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:00:28.609082 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:00:28.609082 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:00:28.609082 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:00:28.609082 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:00:28.609082 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 10 03:00:28.609082 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:28.609082 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 285/586] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 10 03:00:28 2022] GET /identity/v3/users/glance => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:28.609682 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c8e570-e897-43f7-b167-7384356dc18d None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:28.622449 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece3940-f736-4bce-8f83-63118ab3c56a None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:28.654731 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8751d917-33e6-47e9-b38f-bbe6898c5b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:28.655402 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8751d917-33e6-47e9-b38f-bbe6898c5b51 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:28.655685 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8751d917-33e6-47e9-b38f-bbe6898c5b51 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:28.655963 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8751d917-33e6-47e9-b38f-bbe6898c5b51 None admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:28.656831 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8751d917-33e6-47e9-b38f-bbe6898c5b51 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:28.657143 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8751d917-33e6-47e9-b38f-bbe6898c5b51 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:28.658835 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8751d917-33e6-47e9-b38f-bbe6898c5b51 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:28.680681 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 302/587] 10.222.0.65 () {56 vars in 1137 bytes} [Tue May 10 03:00:28 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:28.680681 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8751d917-33e6-47e9-b38f-bbe6898c5b51 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:28.714494 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c8e570-e897-43f7-b167-7384356dc18d None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:28.747895 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f094530e-949c-4681-bc5b-fffb0f8d06cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:28.748692 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f094530e-949c-4681-bc5b-fffb0f8d06cd None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:28.748973 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f094530e-949c-4681-bc5b-fffb0f8d06cd None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:28.749245 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f094530e-949c-4681-bc5b-fffb0f8d06cd None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:28.749962 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f094530e-949c-4681-bc5b-fffb0f8d06cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:28.750264 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f094530e-949c-4681-bc5b-fffb0f8d06cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:28.751621 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f094530e-949c-4681-bc5b-fffb0f8d06cd None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:28.762713 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 286/588] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:00:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:28.763536 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f094530e-949c-4681-bc5b-fffb0f8d06cd None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:28.782180 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8751d917-33e6-47e9-b38f-bbe6898c5b51 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:28.816284 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756bf420-3809-45e5-8b6c-85dd33349169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:28.817172 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bf420-3809-45e5-8b6c-85dd33349169 None admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:28.817449 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bf420-3809-45e5-8b6c-85dd33349169 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:28.817722 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bf420-3809-45e5-8b6c-85dd33349169 None admin] PATH_INFO: `/v3/projects/513e6592cd83457b8ff461b0e5e1fd40/users/9b7ccdccba0b4f9e86817946f22dbe28/roles/9a5640186d0940658e691be68ccf9205` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:28.831634 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756bf420-3809-45e5-8b6c-85dd33349169 None admin] RBAC: Authorizing `identity:create_grant(project_id=513e6592cd83457b8ff461b0e5e1fd40, user_id=9b7ccdccba0b4f9e86817946f22dbe28, role_id=9a5640186d0940658e691be68ccf9205)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:28.833099 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756bf420-3809-45e5-8b6c-85dd33349169 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:28.860770 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f094530e-949c-4681-bc5b-fffb0f8d06cd None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:28.891624 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92cf9ad-0023-4496-b78f-da22b1505bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:28.892315 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92cf9ad-0023-4496-b78f-da22b1505bdd None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:28.892599 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92cf9ad-0023-4496-b78f-da22b1505bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:28.892873 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92cf9ad-0023-4496-b78f-da22b1505bdd None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:28.893702 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92cf9ad-0023-4496-b78f-da22b1505bdd None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:28.894010 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92cf9ad-0023-4496-b78f-da22b1505bdd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:28.895427 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92cf9ad-0023-4496-b78f-da22b1505bdd None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:28.924045 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 303/589] 10.222.0.65 () {58 vars in 1439 bytes} [Tue May 10 03:00:28 2022] PUT /identity/v3/projects/513e6592cd83457b8ff461b0e5e1fd40/users/9b7ccdccba0b4f9e86817946f22dbe28/roles/9a5640186d0940658e691be68ccf9205 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:00:28.924045 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756bf420-3809-45e5-8b6c-85dd33349169 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:28.934753 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 287/590] 10.222.0.65 () {56 vars in 1137 bytes} [Tue May 10 03:00:28 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:28.935626 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92cf9ad-0023-4496-b78f-da22b1505bdd None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:29.040650 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756bf420-3809-45e5-8b6c-85dd33349169 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:29.051354 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92cf9ad-0023-4496-b78f-da22b1505bdd None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:29.079631 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eaba2f-d93d-45dc-9538-fc8110cd8a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:29.081565 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eaba2f-d93d-45dc-9538-fc8110cd8a77 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:29.082195 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eaba2f-d93d-45dc-9538-fc8110cd8a77 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:29.082725 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eaba2f-d93d-45dc-9538-fc8110cd8a77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:29.090176 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc16945a-2cba-431d-b308-ac343c5548f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:29.091029 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16945a-2cba-431d-b308-ac343c5548f1 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:29.091313 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16945a-2cba-431d-b308-ac343c5548f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:29.091589 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16945a-2cba-431d-b308-ac343c5548f1 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:29.099600 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eaba2f-d93d-45dc-9538-fc8110cd8a77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:29.101686 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eaba2f-d93d-45dc-9538-fc8110cd8a77 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:29.105281 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc16945a-2cba-431d-b308-ac343c5548f1 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:29.106786 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc16945a-2cba-431d-b308-ac343c5548f1 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:29.122361 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-45eaba2f-d93d-45dc-9538-fc8110cd8a77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:29.122361 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:29.122361 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:29.122361 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:29.122361 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:29.122361 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:29.122361 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:29.122361 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:29.122361 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:29.122361 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:29.122361 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:29.122361 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:29.122361 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:00:29.122361 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:00:29.122361 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:00:29.123841 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:00:29.123841 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:29.123841 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:29.123841 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:29.123841 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:29.123841 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:29.123841 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:29.123841 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:29.123841 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:29.123841 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:29.123841 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:29.123841 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:29.123841 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:29.123841 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:29.123841 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:29.123841 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:29.123841 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:29.125364 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:00:29.125364 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:00:29.125364 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:29.125364 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:29.125364 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 304/591] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:00:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:29.125364 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eaba2f-d93d-45dc-9538-fc8110cd8a77 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:29.128755 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-fc16945a-2cba-431d-b308-ac343c5548f1 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 10 03:00:29.128755 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:29.128755 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:29.128755 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:29.128755 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:29.128755 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:29.128755 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:29.128755 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:29.128755 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:29.128755 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:29.128755 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:29.128755 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:29.128755 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:00:29.128755 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:00:29.128755 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:00:29.128755 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:00:29.132421 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:29.132421 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:29.132421 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:00:29.132421 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:00:29.132421 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:00:29.132421 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:00:29.132421 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:29.132421 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:29.132421 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:29.132421 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:29.132421 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:29.132421 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:29.132421 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:29.132421 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:29.132421 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:29.132421 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:29.132421 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:29.132421 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:29.134333 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:29.134333 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:29.134333 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:00:29.134333 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:00:29.134333 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:00:29.134333 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:00:29.134333 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:00:29.134333 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:00:29.134333 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 10 03:00:29.134333 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:29.134333 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 288/592] 10.222.0.65 () {56 vars in 1102 bytes} [Tue May 10 03:00:28 2022] GET /identity/v3/users/neutron => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:29.134333 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc16945a-2cba-431d-b308-ac343c5548f1 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:29.236917 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eaba2f-d93d-45dc-9538-fc8110cd8a77 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:29.242058 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc16945a-2cba-431d-b308-ac343c5548f1 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:29.272496 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b4f22e-4386-4705-a719-b25e062a54b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:29.273286 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b4f22e-4386-4705-a719-b25e062a54b6 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:29.273569 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b4f22e-4386-4705-a719-b25e062a54b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:29.273845 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b4f22e-4386-4705-a719-b25e062a54b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:29.284734 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc997b-e5ed-4799-8bc0-0a74ae757518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:29.285670 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc997b-e5ed-4799-8bc0-0a74ae757518 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:29.285872 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b4f22e-4386-4705-a719-b25e062a54b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:29.285995 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc997b-e5ed-4799-8bc0-0a74ae757518 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:29.286214 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc997b-e5ed-4799-8bc0-0a74ae757518 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:29.286939 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dc997b-e5ed-4799-8bc0-0a74ae757518 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:29.287771 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dc997b-e5ed-4799-8bc0-0a74ae757518 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:29.288179 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b4f22e-4386-4705-a719-b25e062a54b6 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:29.289224 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dc997b-e5ed-4799-8bc0-0a74ae757518 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:29.302738 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 289/593] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:00:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:29.306439 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-45b4f22e-4386-4705-a719-b25e062a54b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:29.306439 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:29.306439 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:29.306439 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:29.306439 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:29.306439 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:29.306439 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:29.306439 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:29.306439 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:29.306439 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:29.306439 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:29.306439 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:29.306439 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:00:29.306439 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:00:29.306439 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:00:29.307479 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:00:29.307479 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:29.307479 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:29.307479 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:29.307479 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:29.307479 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:29.307479 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:29.307479 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:29.307479 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:29.307479 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:29.307479 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:29.307479 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:29.307479 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:29.307479 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:29.307479 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:29.307479 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:29.307479 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:29.309336 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:00:29.309336 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:00:29.309336 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:29.309336 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:29.309768 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc997b-e5ed-4799-8bc0-0a74ae757518 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:29.309896 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 305/594] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:00:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:29.310020 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b4f22e-4386-4705-a719-b25e062a54b6 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:29.415602 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b4f22e-4386-4705-a719-b25e062a54b6 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:29.431382 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc997b-e5ed-4799-8bc0-0a74ae757518 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:29.458485 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea4e48-024d-422f-94bc-728371087fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:29.459316 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea4e48-024d-422f-94bc-728371087fa4 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:29.459602 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea4e48-024d-422f-94bc-728371087fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:29.459877 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea4e48-024d-422f-94bc-728371087fa4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:29.473085 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ea4e48-024d-422f-94bc-728371087fa4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:29.475791 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ea4e48-024d-422f-94bc-728371087fa4 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:29.477532 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93901063-3340-41bb-85c6-82e26582679c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:29.478316 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93901063-3340-41bb-85c6-82e26582679c None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:29.478678 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93901063-3340-41bb-85c6-82e26582679c None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:29.479029 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93901063-3340-41bb-85c6-82e26582679c None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:29.479947 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93901063-3340-41bb-85c6-82e26582679c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:29.480462 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93901063-3340-41bb-85c6-82e26582679c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:29.482227 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93901063-3340-41bb-85c6-82e26582679c None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:29.495933 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-96ea4e48-024d-422f-94bc-728371087fa4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:00:29.495933 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:29.495933 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:29.495933 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:29.495933 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:29.495933 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:29.495933 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:29.495933 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:29.495933 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:29.495933 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:29.495933 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:29.495933 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:29.495933 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:00:29.495933 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:00:29.495933 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:00:29.496901 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:00:29.496901 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:29.496901 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:29.496901 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:29.496901 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:29.496901 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:29.496901 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:29.496901 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:29.496901 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:29.496901 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:29.496901 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:29.496901 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:29.496901 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:29.496901 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:29.496901 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:29.496901 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:29.496901 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:29.497772 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:00:29.497772 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:00:29.497772 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:00:29.497772 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:00:29.497772 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:00:29.497772 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:00:29.497772 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:00:29.497772 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:29.504853 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 290/596] 10.222.0.65 () {56 vars in 1139 bytes} [Tue May 10 03:00:29 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:29.504853 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93901063-3340-41bb-85c6-82e26582679c None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:29.505104 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 306/596] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 10 03:00:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:29.506536 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea4e48-024d-422f-94bc-728371087fa4 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:29.618568 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea4e48-024d-422f-94bc-728371087fa4 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:29.619495 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93901063-3340-41bb-85c6-82e26582679c None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:29.654165 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afaa530-b342-4990-a51d-e4102b0a2e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:29.655025 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afaa530-b342-4990-a51d-e4102b0a2e31 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:29.655370 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afaa530-b342-4990-a51d-e4102b0a2e31 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:29.655749 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afaa530-b342-4990-a51d-e4102b0a2e31 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:29.656627 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afaa530-b342-4990-a51d-e4102b0a2e31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:29.657033 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afaa530-b342-4990-a51d-e4102b0a2e31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:29.658788 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afaa530-b342-4990-a51d-e4102b0a2e31 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:29.661020 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60438d63-412c-42d0-ba09-c7dbe0a6cea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:29.662825 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60438d63-412c-42d0-ba09-c7dbe0a6cea1 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:29.663259 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60438d63-412c-42d0-ba09-c7dbe0a6cea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:29.663685 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60438d63-412c-42d0-ba09-c7dbe0a6cea1 None admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:29.664643 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60438d63-412c-42d0-ba09-c7dbe0a6cea1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:29.665116 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60438d63-412c-42d0-ba09-c7dbe0a6cea1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:29.667198 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60438d63-412c-42d0-ba09-c7dbe0a6cea1 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:29.672063 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 291/597] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:00:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:29.673154 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afaa530-b342-4990-a51d-e4102b0a2e31 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:29.686517 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 307/598] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 10 03:00:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:29.686517 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60438d63-412c-42d0-ba09-c7dbe0a6cea1 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:29.790365 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afaa530-b342-4990-a51d-e4102b0a2e31 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:29.796135 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60438d63-412c-42d0-ba09-c7dbe0a6cea1 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:29.829261 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f013a0-9c9a-431b-b920-b833efabd184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:29.830207 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f013a0-9c9a-431b-b920-b833efabd184 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:29.830592 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f013a0-9c9a-431b-b920-b833efabd184 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:29.830968 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f013a0-9c9a-431b-b920-b833efabd184 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:29.832741 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eea765-3368-4f19-bde9-2f05ca63bd66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:29.834695 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eea765-3368-4f19-bde9-2f05ca63bd66 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:29.835139 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eea765-3368-4f19-bde9-2f05ca63bd66 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:29.835571 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eea765-3368-4f19-bde9-2f05ca63bd66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:29.839034 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f013a0-9c9a-431b-b920-b833efabd184 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:29.840647 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f013a0-9c9a-431b-b920-b833efabd184 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:29.848333 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eea765-3368-4f19-bde9-2f05ca63bd66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:29.850555 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eea765-3368-4f19-bde9-2f05ca63bd66 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:29.856415 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-37f013a0-9c9a-431b-b920-b833efabd184 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:00:29.856415 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:29.856415 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:29.856415 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:29.856415 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:29.856415 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:29.856415 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:29.856415 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:29.856415 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:29.856415 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:29.856415 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:29.856415 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:29.856415 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:00:29.856415 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:00:29.856415 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:00:29.857479 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:00:29.857479 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:29.857479 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:29.857479 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:29.857479 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:29.857479 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:29.857479 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:29.857479 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:29.857479 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:29.857479 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:29.857479 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:29.857479 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:29.857479 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:29.857479 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:29.857479 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:29.857479 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:29.857479 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:29.858585 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:00:29.858585 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:00:29.858585 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:00:29.858585 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:00:29.858585 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:00:29.858585 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:00:29.858585 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:00:29.858585 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:29.860479 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 308/599] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 10 03:00:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:29.861506 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f013a0-9c9a-431b-b920-b833efabd184 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:29.873405 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-e5eea765-3368-4f19-bde9-2f05ca63bd66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:29.873405 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:29.873405 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:29.873405 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:29.873405 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:29.873405 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:29.873405 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:29.873405 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:29.873405 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:29.873405 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:29.873405 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:29.873405 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:29.873405 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:00:29.873405 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:00:29.873405 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:00:29.874513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:00:29.874513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:29.874513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:29.874513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:29.874513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:29.874513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:29.874513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:29.874513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:29.874513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:29.874513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:29.874513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:29.874513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:29.874513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:29.874513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:29.874513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:29.874513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:29.874513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:29.875626 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:00:29.875626 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:00:29.875626 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:29.875626 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:29.877659 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 292/600] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:00:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:29.878682 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eea765-3368-4f19-bde9-2f05ca63bd66 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:29.978543 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eea765-3368-4f19-bde9-2f05ca63bd66 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:29.982858 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f013a0-9c9a-431b-b920-b833efabd184 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:30.025155 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a58f6b6-3207-4270-8924-5f9a116d97ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:30.027808 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58f6b6-3207-4270-8924-5f9a116d97ee None admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:30.027808 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58f6b6-3207-4270-8924-5f9a116d97ee None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:30.027808 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58f6b6-3207-4270-8924-5f9a116d97ee None admin] PATH_INFO: `/v3/projects/513e6592cd83457b8ff461b0e5e1fd40/users/3509cdb58f6a4d05a7ed79e46791ac19/roles/9a5640186d0940658e691be68ccf9205` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:30.029473 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc55536-a2cc-4456-9098-764ace94c4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:30.030166 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc55536-a2cc-4456-9098-764ace94c4a1 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:30.030445 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc55536-a2cc-4456-9098-764ace94c4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:30.030729 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc55536-a2cc-4456-9098-764ace94c4a1 None admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:30.031645 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc55536-a2cc-4456-9098-764ace94c4a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:30.031912 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc55536-a2cc-4456-9098-764ace94c4a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:30.033834 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc55536-a2cc-4456-9098-764ace94c4a1 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:30.045702 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a58f6b6-3207-4270-8924-5f9a116d97ee None admin] RBAC: Authorizing `identity:create_grant(project_id=513e6592cd83457b8ff461b0e5e1fd40, user_id=3509cdb58f6a4d05a7ed79e46791ac19, role_id=9a5640186d0940658e691be68ccf9205)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:30.047100 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 293/601] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 10 03:00:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:30.047298 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a58f6b6-3207-4270-8924-5f9a116d97ee None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:30.047945 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc55536-a2cc-4456-9098-764ace94c4a1 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:30.132653 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 309/602] 10.222.0.65 () {58 vars in 1439 bytes} [Tue May 10 03:00:29 2022] PUT /identity/v3/projects/513e6592cd83457b8ff461b0e5e1fd40/users/3509cdb58f6a4d05a7ed79e46791ac19/roles/9a5640186d0940658e691be68ccf9205 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:00:30.133989 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a58f6b6-3207-4270-8924-5f9a116d97ee None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:30.175854 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc55536-a2cc-4456-9098-764ace94c4a1 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:30.237881 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57599cd-26df-47a4-912e-84e6d4492355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:30.238549 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57599cd-26df-47a4-912e-84e6d4492355 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:30.238841 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57599cd-26df-47a4-912e-84e6d4492355 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:30.239121 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57599cd-26df-47a4-912e-84e6d4492355 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:30.240092 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57599cd-26df-47a4-912e-84e6d4492355 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:30.240498 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57599cd-26df-47a4-912e-84e6d4492355 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:30.242999 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57599cd-26df-47a4-912e-84e6d4492355 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:30.259803 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 294/603] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:30.262104 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d78a186-a1e0-4064-851a-119352337725 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:30.262400 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d78a186-a1e0-4064-851a-119352337725 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:30.262682 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d78a186-a1e0-4064-851a-119352337725 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:30.264946 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 295/604] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:00:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:30.265736 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d78a186-a1e0-4064-851a-119352337725 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:30.285515 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a58f6b6-3207-4270-8924-5f9a116d97ee None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:30.321947 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d846d-f06e-4820-bc09-5f575d93b8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:30.322844 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d846d-f06e-4820-bc09-5f575d93b8e9 None admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:30.323126 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d846d-f06e-4820-bc09-5f575d93b8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:30.323400 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d846d-f06e-4820-bc09-5f575d93b8e9 None admin] PATH_INFO: `/v3/projects/513e6592cd83457b8ff461b0e5e1fd40/users/c79f0a3a3223444c82589da07305469f/roles/9a5640186d0940658e691be68ccf9205` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:30.343379 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4d846d-f06e-4820-bc09-5f575d93b8e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=513e6592cd83457b8ff461b0e5e1fd40, user_id=c79f0a3a3223444c82589da07305469f, role_id=9a5640186d0940658e691be68ccf9205)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:30.344978 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4d846d-f06e-4820-bc09-5f575d93b8e9 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:30.396710 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d78a186-a1e0-4064-851a-119352337725 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:30.436054 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56db2c69-179c-4705-a4a4-13ed8f239e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:30.436054 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db2c69-179c-4705-a4a4-13ed8f239e52 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:30.436054 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db2c69-179c-4705-a4a4-13ed8f239e52 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:30.436054 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db2c69-179c-4705-a4a4-13ed8f239e52 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:30.436741 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 310/605] 10.222.0.65 () {58 vars in 1439 bytes} [Tue May 10 03:00:30 2022] PUT /identity/v3/projects/513e6592cd83457b8ff461b0e5e1fd40/users/c79f0a3a3223444c82589da07305469f/roles/9a5640186d0940658e691be68ccf9205 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:00:30.438740 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53927693-4add-4553-95cb-bf1f2044c695 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:30.439255 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53927693-4add-4553-95cb-bf1f2044c695 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:30.439735 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53927693-4add-4553-95cb-bf1f2044c695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:30.444837 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56db2c69-179c-4705-a4a4-13ed8f239e52 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:30.446553 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56db2c69-179c-4705-a4a4-13ed8f239e52 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:30.464643 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-56db2c69-179c-4705-a4a4-13ed8f239e52 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:00:30.464643 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:30.464643 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:30.464643 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:30.464643 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:30.464643 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:30.464643 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:30.464643 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:30.464643 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:30.464643 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:30.464643 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:30.464643 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:30.464643 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:00:30.464643 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:00:30.464643 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:00:30.465494 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:00:30.465494 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:30.465494 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:30.465494 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:30.465494 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:30.465494 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:30.465494 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:30.465494 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:30.465494 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:30.465494 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:30.465494 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:30.465494 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:30.465494 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:30.465494 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:30.465494 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:30.465494 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:30.465494 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:30.467116 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:00:30.467116 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:00:30.467116 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:00:30.467116 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:00:30.467116 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:00:30.467116 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:00:30.467116 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:00:30.467116 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:30.467116 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 296/606] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 10 03:00:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:30.471175 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56db2c69-179c-4705-a4a4-13ed8f239e52 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:30.489470 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-53927693-4add-4553-95cb-bf1f2044c695 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:30.491287 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-53927693-4add-4553-95cb-bf1f2044c695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:30.589850 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56db2c69-179c-4705-a4a4-13ed8f239e52 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:30.628793 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfba208-bea9-42c9-8ff8-a8be2bf6da63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:30.630235 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfba208-bea9-42c9-8ff8-a8be2bf6da63 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:30.631001 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfba208-bea9-42c9-8ff8-a8be2bf6da63 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:30.631949 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfba208-bea9-42c9-8ff8-a8be2bf6da63 None admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:30.633155 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfba208-bea9-42c9-8ff8-a8be2bf6da63 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:30.633685 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfba208-bea9-42c9-8ff8-a8be2bf6da63 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:30.635631 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfba208-bea9-42c9-8ff8-a8be2bf6da63 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:30.649160 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 297/607] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 10 03:00:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:30.656105 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfba208-bea9-42c9-8ff8-a8be2bf6da63 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:30.679178 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 311/608] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:00:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:30.708845 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53927693-4add-4553-95cb-bf1f2044c695 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:30.792635 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfba208-bea9-42c9-8ff8-a8be2bf6da63 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:30.834185 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce02131-a27b-467c-b4c9-a265ce849d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:30.835087 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce02131-a27b-467c-b4c9-a265ce849d8e None admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:30.835373 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce02131-a27b-467c-b4c9-a265ce849d8e None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:30.835647 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce02131-a27b-467c-b4c9-a265ce849d8e None admin] PATH_INFO: `/v3/projects/513e6592cd83457b8ff461b0e5e1fd40/users/ccfba74826234915bc989fede9bde3e8/roles/9a5640186d0940658e691be68ccf9205` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:30.854512 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce02131-a27b-467c-b4c9-a265ce849d8e None admin] RBAC: Authorizing `identity:create_grant(project_id=513e6592cd83457b8ff461b0e5e1fd40, user_id=ccfba74826234915bc989fede9bde3e8, role_id=9a5640186d0940658e691be68ccf9205)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:30.856043 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53927693-4add-4553-95cb-bf1f2044c695 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:30.856228 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce02131-a27b-467c-b4c9-a265ce849d8e None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:30.903574 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a3748a-55c8-4bb2-81bc-f7f84de9a1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:30.904478 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3748a-55c8-4bb2-81bc-f7f84de9a1aa None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:30.904759 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3748a-55c8-4bb2-81bc-f7f84de9a1aa None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:30.905031 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3748a-55c8-4bb2-81bc-f7f84de9a1aa None admin] PATH_INFO: `/v3/roles/service` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:30.916610 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a3748a-55c8-4bb2-81bc-f7f84de9a1aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:30.925076 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-c1a3748a-55c8-4bb2-81bc-f7f84de9a1aa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 03:00:30.925076 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:30.925076 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:30.925076 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:30.925076 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:30.925076 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:30.925076 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:30.925076 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:30.925076 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:30.925076 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:30.925076 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:30.925076 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:30.925076 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:30.925076 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:30.925076 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:30.925076 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:30.926007 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:30.926007 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:30.926007 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:30.926007 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:30.926007 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:30.926007 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:30.926007 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:30.926007 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:30.926007 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:30.926007 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:30.926007 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:30.926007 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:30.926007 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:30.926007 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:30.926007 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:30.926007 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:30.926829 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:30.926829 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:30.926829 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:30.926829 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:30.926829 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:30.926829 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:30.926829 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:30.926829 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:30.926829 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:30.926829 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:30.926829 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 03:00:30.926829 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:30.926829 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 312/609] 10.222.0.65 () {56 vars in 1102 bytes} [Tue May 10 03:00:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:00:30.934195 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a3748a-55c8-4bb2-81bc-f7f84de9a1aa None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:30.963229 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 298/610] 10.222.0.65 () {58 vars in 1439 bytes} [Tue May 10 03:00:30 2022] PUT /identity/v3/projects/513e6592cd83457b8ff461b0e5e1fd40/users/ccfba74826234915bc989fede9bde3e8/roles/9a5640186d0940658e691be68ccf9205 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:00:31.061531 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a3748a-55c8-4bb2-81bc-f7f84de9a1aa None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:31.098768 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8be6729-9b62-475a-8696-50aa2f71a899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:31.099452 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be6729-9b62-475a-8696-50aa2f71a899 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:31.100624 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be6729-9b62-475a-8696-50aa2f71a899 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:31.100945 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be6729-9b62-475a-8696-50aa2f71a899 None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:31.101812 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8be6729-9b62-475a-8696-50aa2f71a899 None admin] RBAC: Adding query filter params (name=service) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:31.102119 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8be6729-9b62-475a-8696-50aa2f71a899 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:31.103498 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8be6729-9b62-475a-8696-50aa2f71a899 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:31.113220 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 313/611] 10.222.0.65 () {56 vars in 1103 bytes} [Tue May 10 03:00:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:31.118824 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce02131-a27b-467c-b4c9-a265ce849d8e None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:31.276276 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce02131-a27b-467c-b4c9-a265ce849d8e None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:31.315643 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3ac84c-4867-4a96-af7f-e8732e1961ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:31.316478 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ac84c-4867-4a96-af7f-e8732e1961ae None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:31.316768 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ac84c-4867-4a96-af7f-e8732e1961ae None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:31.317049 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ac84c-4867-4a96-af7f-e8732e1961ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:31.330349 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3ac84c-4867-4a96-af7f-e8732e1961ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:31.331819 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3ac84c-4867-4a96-af7f-e8732e1961ae None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:31.352807 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-4f3ac84c-4867-4a96-af7f-e8732e1961ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:31.352807 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:31.352807 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:31.352807 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:31.352807 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:31.352807 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:31.352807 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:31.352807 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:31.352807 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:31.352807 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:31.352807 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:31.352807 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:31.352807 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:00:31.352807 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:00:31.352807 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:00:31.354866 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:00:31.354866 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:31.354866 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:31.354866 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:31.354866 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:31.354866 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:31.354866 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:31.354866 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:31.354866 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:31.354866 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:31.354866 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:31.354866 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:31.354866 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:31.354866 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:31.354866 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:31.354866 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:31.354866 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:31.356499 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:00:31.356499 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:00:31.356499 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:31.356499 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:31.356499 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 299/612] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:00:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:31.362977 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8be6729-9b62-475a-8696-50aa2f71a899 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:31.402116 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d1c7b-9735-41b8-ba41-e5d1c495ad71 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:31.402855 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d1c7b-9735-41b8-ba41-e5d1c495ad71 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:31.403319 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d1c7b-9735-41b8-ba41-e5d1c495ad71 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:31.405313 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 300/613] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:00:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:00:31.411144 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f4c31-195b-4d6e-baf4-5b22e9e6612d None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:31.411659 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f4c31-195b-4d6e-baf4-5b22e9e6612d None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:31.412226 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f4c31-195b-4d6e-baf4-5b22e9e6612d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:31.430100 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-447f4c31-195b-4d6e-baf4-5b22e9e6612d None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:31.431690 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-447f4c31-195b-4d6e-baf4-5b22e9e6612d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:31.532852 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 301/614] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:00:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 03:00:31.538262 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8be6729-9b62-475a-8696-50aa2f71a899 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:31.574566 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447f4c31-195b-4d6e-baf4-5b22e9e6612d None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:31.591078 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7008810-d4b2-4672-b1e8-49868dc01cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:31.591753 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7008810-d4b2-4672-b1e8-49868dc01cb1 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:31.592047 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7008810-d4b2-4672-b1e8-49868dc01cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:31.592383 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7008810-d4b2-4672-b1e8-49868dc01cb1 None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:31.593321 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7008810-d4b2-4672-b1e8-49868dc01cb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:31.593776 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7008810-d4b2-4672-b1e8-49868dc01cb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:31.595256 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7008810-d4b2-4672-b1e8-49868dc01cb1 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:31.623959 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 314/615] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:31.627811 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7008810-d4b2-4672-b1e8-49868dc01cb1 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:31.754570 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7008810-d4b2-4672-b1e8-49868dc01cb1 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:31.779626 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447f4c31-195b-4d6e-baf4-5b22e9e6612d None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:31.789165 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9557296f-e6a3-458b-aa37-8c06e3daccd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:31.790007 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557296f-e6a3-458b-aa37-8c06e3daccd5 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:31.790295 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557296f-e6a3-458b-aa37-8c06e3daccd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:31.790565 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557296f-e6a3-458b-aa37-8c06e3daccd5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:31.797812 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9557296f-e6a3-458b-aa37-8c06e3daccd5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:31.799299 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9557296f-e6a3-458b-aa37-8c06e3daccd5 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:31.814502 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-9557296f-e6a3-458b-aa37-8c06e3daccd5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 03:00:31.814502 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:31.814502 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:31.814502 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:31.814502 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:31.814502 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:31.814502 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:31.814502 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:31.814502 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:31.814502 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:31.814502 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:31.814502 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:31.814502 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:00:31.814502 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:00:31.814502 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:00:31.814502 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:00:31.816098 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:31.816098 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:31.816098 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:00:31.816098 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:00:31.816098 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:00:31.816098 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:00:31.816098 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:31.816098 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:31.816098 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:31.816098 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:31.816098 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:31.816098 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:31.816098 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:31.816098 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:31.816098 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:31.816098 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:31.816098 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:31.816098 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:31.819057 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:31.819057 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:31.819057 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:00:31.819057 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:00:31.819057 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:00:31.819057 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:00:31.819057 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:00:31.819057 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:00:31.819057 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 03:00:31.819057 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:31.819057 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 315/616] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 10 03:00:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:31.824173 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9557296f-e6a3-458b-aa37-8c06e3daccd5 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:31.825015 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c03fc9-1329-4136-b1e6-b5d009fba8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:31.825981 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c03fc9-1329-4136-b1e6-b5d009fba8d0 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:31.826576 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c03fc9-1329-4136-b1e6-b5d009fba8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:31.826984 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c03fc9-1329-4136-b1e6-b5d009fba8d0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:31.839050 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c03fc9-1329-4136-b1e6-b5d009fba8d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:31.847957 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-b4c03fc9-1329-4136-b1e6-b5d009fba8d0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 03:00:31.847957 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:31.847957 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:31.847957 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:31.847957 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:31.847957 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:31.847957 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:31.847957 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:31.847957 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:31.847957 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:31.847957 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:31.847957 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:31.847957 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:31.847957 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:31.847957 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:31.847957 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:31.849111 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:31.849111 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:31.849111 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:31.849111 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:31.849111 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:31.849111 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:31.849111 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:31.849111 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:31.849111 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:31.849111 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:31.849111 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:31.849111 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:31.849111 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:31.849111 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:31.849111 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:31.849111 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:31.850167 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:31.850167 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:31.850167 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:31.850167 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:31.850167 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:31.850167 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:31.850167 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:31.850167 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:31.850167 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:31.850167 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:31.850167 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 03:00:31.850167 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:31.852389 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 302/617] 10.222.0.65 () {56 vars in 1102 bytes} [Tue May 10 03:00:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:31.857999 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c03fc9-1329-4136-b1e6-b5d009fba8d0 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:31.998507 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c03fc9-1329-4136-b1e6-b5d009fba8d0 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:32.018366 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9557296f-e6a3-458b-aa37-8c06e3daccd5 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:32.042099 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b996d2-1937-42dc-b3e1-833345b5daa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:32.046747 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b996d2-1937-42dc-b3e1-833345b5daa1 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:32.046747 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b996d2-1937-42dc-b3e1-833345b5daa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:32.046747 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b996d2-1937-42dc-b3e1-833345b5daa1 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:32.046747 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b996d2-1937-42dc-b3e1-833345b5daa1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:32.046747 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b996d2-1937-42dc-b3e1-833345b5daa1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:32.046747 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b996d2-1937-42dc-b3e1-833345b5daa1 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:32.055294 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 303/618] 10.222.0.65 () {56 vars in 1103 bytes} [Tue May 10 03:00:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:32.060729 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b996d2-1937-42dc-b3e1-833345b5daa1 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:32.069360 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff43d03-cb62-4dc8-88ae-95e21605988c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:32.070052 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff43d03-cb62-4dc8-88ae-95e21605988c None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:32.070330 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff43d03-cb62-4dc8-88ae-95e21605988c None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:32.070600 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff43d03-cb62-4dc8-88ae-95e21605988c None admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:32.072656 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff43d03-cb62-4dc8-88ae-95e21605988c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:32.072992 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff43d03-cb62-4dc8-88ae-95e21605988c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:32.075496 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff43d03-cb62-4dc8-88ae-95e21605988c None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:32.113450 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 316/619] 10.222.0.65 () {56 vars in 1135 bytes} [Tue May 10 03:00:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:32.117651 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff43d03-cb62-4dc8-88ae-95e21605988c None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:32.267770 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff43d03-cb62-4dc8-88ae-95e21605988c None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:32.286166 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b996d2-1937-42dc-b3e1-833345b5daa1 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:32.318313 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b4cf04-3b1e-4087-94be-3c6c8d0d4681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:32.319143 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b4cf04-3b1e-4087-94be-3c6c8d0d4681 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:32.319422 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b4cf04-3b1e-4087-94be-3c6c8d0d4681 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:32.319697 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b4cf04-3b1e-4087-94be-3c6c8d0d4681 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:32.349223 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b4cf04-3b1e-4087-94be-3c6c8d0d4681 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:32.352866 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b4cf04-3b1e-4087-94be-3c6c8d0d4681 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:32.361512 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f9fef9-b185-4a9a-b629-2ff2f907aa43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:32.362311 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f9fef9-b185-4a9a-b629-2ff2f907aa43 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:32.362595 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f9fef9-b185-4a9a-b629-2ff2f907aa43 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:32.362876 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f9fef9-b185-4a9a-b629-2ff2f907aa43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:32.383806 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f9fef9-b185-4a9a-b629-2ff2f907aa43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:32.385429 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f9fef9-b185-4a9a-b629-2ff2f907aa43 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:32.387028 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-b7b4cf04-3b1e-4087-94be-3c6c8d0d4681 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:32.387028 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:32.387028 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:32.387028 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:32.387028 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:32.387028 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:32.387028 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:32.387028 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:32.387028 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:32.387028 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:32.387028 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:32.387028 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:32.387028 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:00:32.387028 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:00:32.387028 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:00:32.389103 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:00:32.389103 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:32.389103 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:32.389103 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:32.389103 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:32.389103 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:32.389103 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:32.389103 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:32.389103 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:32.389103 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:32.389103 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:32.389103 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:32.389103 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:32.389103 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:32.389103 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:32.389103 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:32.389103 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:32.391174 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:00:32.391174 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:00:32.391174 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:32.391174 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:32.391695 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 317/620] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:00:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:00:32.397072 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b4cf04-3b1e-4087-94be-3c6c8d0d4681 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:32.418495 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-64f9fef9-b185-4a9a-b629-2ff2f907aa43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:32.418495 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:32.418495 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:32.418495 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:32.418495 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:32.418495 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:32.418495 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:32.418495 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:32.418495 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:32.418495 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:32.418495 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:32.418495 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:32.418495 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:00:32.418495 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:00:32.418495 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:00:32.420601 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:00:32.420601 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:32.420601 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:32.420601 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:32.420601 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:32.420601 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:32.420601 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:32.420601 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:32.420601 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:32.420601 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:32.420601 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:32.420601 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:32.420601 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:32.420601 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:32.420601 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:32.420601 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:32.420601 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:32.422680 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:00:32.422680 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:00:32.422680 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:32.422680 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:32.428365 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 304/621] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:00:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:00:32.431560 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f9fef9-b185-4a9a-b629-2ff2f907aa43 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:32.582188 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b4cf04-3b1e-4087-94be-3c6c8d0d4681 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:32.620842 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa7bb2-d0ee-40f6-beb7-41a92fdad31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:32.621724 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa7bb2-d0ee-40f6-beb7-41a92fdad31c None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:32.622017 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa7bb2-d0ee-40f6-beb7-41a92fdad31c None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:32.622297 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa7bb2-d0ee-40f6-beb7-41a92fdad31c None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:32.623028 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fa7bb2-d0ee-40f6-beb7-41a92fdad31c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:32.623337 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fa7bb2-d0ee-40f6-beb7-41a92fdad31c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:32.625194 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fa7bb2-d0ee-40f6-beb7-41a92fdad31c None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:32.638672 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 318/622] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:00:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:32.643860 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa7bb2-d0ee-40f6-beb7-41a92fdad31c None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:32.655831 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f9fef9-b185-4a9a-b629-2ff2f907aa43 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:32.708744 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240094ed-282d-46f9-b4f8-218950e08fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:32.709987 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240094ed-282d-46f9-b4f8-218950e08fcc None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:32.710270 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240094ed-282d-46f9-b4f8-218950e08fcc None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:32.710543 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240094ed-282d-46f9-b4f8-218950e08fcc None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:32.711272 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240094ed-282d-46f9-b4f8-218950e08fcc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:32.711581 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240094ed-282d-46f9-b4f8-218950e08fcc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:32.712997 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240094ed-282d-46f9-b4f8-218950e08fcc None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:32.726555 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 305/623] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:00:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:32.728026 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f80304-0ea1-476a-b850-efff0b5d9bcb None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:32.728313 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f80304-0ea1-476a-b850-efff0b5d9bcb None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:32.728596 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f80304-0ea1-476a-b850-efff0b5d9bcb None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:32.730096 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 306/624] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:00:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:32.731207 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f80304-0ea1-476a-b850-efff0b5d9bcb None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:32.759772 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa7bb2-d0ee-40f6-beb7-41a92fdad31c None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:32.794643 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94518de7-a784-4268-ab8c-c4c73c55890a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:32.795434 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94518de7-a784-4268-ab8c-c4c73c55890a None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:32.795711 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94518de7-a784-4268-ab8c-c4c73c55890a None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:32.795983 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94518de7-a784-4268-ab8c-c4c73c55890a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:32.802802 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94518de7-a784-4268-ab8c-c4c73c55890a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:32.804247 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94518de7-a784-4268-ab8c-c4c73c55890a None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:32.817685 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-94518de7-a784-4268-ab8c-c4c73c55890a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:00:32.817685 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:32.817685 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:32.817685 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:32.817685 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:32.817685 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:32.817685 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:32.817685 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:32.817685 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:32.817685 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:32.817685 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:32.817685 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:32.817685 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:00:32.817685 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:00:32.817685 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:00:32.819735 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:00:32.819735 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:32.819735 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:32.819735 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:32.819735 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:32.819735 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:32.819735 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:32.819735 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:32.819735 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:32.819735 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:32.819735 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:32.819735 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:32.819735 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:32.819735 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:32.819735 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:32.819735 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:32.819735 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:32.821877 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:00:32.821877 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:00:32.821877 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:00:32.821877 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:00:32.821877 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:00:32.821877 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:00:32.821877 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:00:32.821877 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:32.821877 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 319/625] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 10 03:00:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:00:32.821877 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5158bd-e98f-4caf-bd0e-99edb6b93a40 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:32.821877 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5158bd-e98f-4caf-bd0e-99edb6b93a40 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:32.823381 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5158bd-e98f-4caf-bd0e-99edb6b93a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:32.832697 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f80304-0ea1-476a-b850-efff0b5d9bcb None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:32.837319 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-df5158bd-e98f-4caf-bd0e-99edb6b93a40 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:32.838486 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-df5158bd-e98f-4caf-bd0e-99edb6b93a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:32.869779 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa241e-1369-4a5c-a8fa-a7e3e688331f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:32.870578 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa241e-1369-4a5c-a8fa-a7e3e688331f None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:32.870926 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa241e-1369-4a5c-a8fa-a7e3e688331f None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:32.871145 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa241e-1369-4a5c-a8fa-a7e3e688331f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:32.878538 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aa241e-1369-4a5c-a8fa-a7e3e688331f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:32.879988 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aa241e-1369-4a5c-a8fa-a7e3e688331f None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:32.894868 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-06aa241e-1369-4a5c-a8fa-a7e3e688331f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 03:00:32.894868 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:32.894868 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:32.894868 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:32.894868 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:32.894868 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:32.894868 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:32.894868 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:32.894868 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:32.894868 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:32.894868 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:32.894868 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:32.894868 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:00:32.894868 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:00:32.894868 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:00:32.894868 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:00:32.897773 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:32.897773 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:32.897773 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:00:32.897773 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:00:32.897773 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:00:32.897773 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:00:32.897773 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:32.897773 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:32.897773 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:32.897773 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:32.897773 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:32.897773 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:32.897773 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:32.897773 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:32.897773 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:32.897773 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:32.897773 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:32.897773 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:32.899976 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:32.899976 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:32.899976 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:00:32.899976 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:00:32.899976 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:00:32.899976 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:00:32.899976 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:00:32.899976 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:00:32.899976 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 03:00:32.899976 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:32.899976 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 307/626] 10.222.0.65 () {56 vars in 1093 bytes} [Tue May 10 03:00:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:32.899976 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa241e-1369-4a5c-a8fa-a7e3e688331f None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:32.912144 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 320/627] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:00:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:32.913526 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5158bd-e98f-4caf-bd0e-99edb6b93a40 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:33.019200 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa241e-1369-4a5c-a8fa-a7e3e688331f None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:33.032090 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5158bd-e98f-4caf-bd0e-99edb6b93a40 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:33.055580 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3afa218-33ab-410f-adff-a286317f847c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:33.056295 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3afa218-33ab-410f-adff-a286317f847c None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:33.056582 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3afa218-33ab-410f-adff-a286317f847c None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:33.056861 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3afa218-33ab-410f-adff-a286317f847c None admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:33.057679 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3afa218-33ab-410f-adff-a286317f847c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:33.057992 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3afa218-33ab-410f-adff-a286317f847c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:33.059509 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3afa218-33ab-410f-adff-a286317f847c None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:33.073906 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 308/628] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 10 03:00:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:33.074903 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3afa218-33ab-410f-adff-a286317f847c None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:33.075816 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06905bf9-7890-4eee-be43-d1f6bf1a72d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:33.076528 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06905bf9-7890-4eee-be43-d1f6bf1a72d9 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:33.076898 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06905bf9-7890-4eee-be43-d1f6bf1a72d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:33.077176 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06905bf9-7890-4eee-be43-d1f6bf1a72d9 None admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:33.078074 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06905bf9-7890-4eee-be43-d1f6bf1a72d9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:33.078383 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06905bf9-7890-4eee-be43-d1f6bf1a72d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:33.079883 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06905bf9-7890-4eee-be43-d1f6bf1a72d9 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:33.100589 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 321/629] 10.222.0.65 () {56 vars in 1133 bytes} [Tue May 10 03:00:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:33.101433 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06905bf9-7890-4eee-be43-d1f6bf1a72d9 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:33.178296 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3afa218-33ab-410f-adff-a286317f847c None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:33.200124 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06905bf9-7890-4eee-be43-d1f6bf1a72d9 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:33.214160 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e15f9-6e1d-4c69-9c5a-2b8b94f22d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:33.215342 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e15f9-6e1d-4c69-9c5a-2b8b94f22d7b None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:33.215899 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e15f9-6e1d-4c69-9c5a-2b8b94f22d7b None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:33.216219 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e15f9-6e1d-4c69-9c5a-2b8b94f22d7b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:33.230071 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553e15f9-6e1d-4c69-9c5a-2b8b94f22d7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:33.234321 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c7576e-9005-4df8-bfac-1d648361c033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:33.235201 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7576e-9005-4df8-bfac-1d648361c033 None admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:33.235526 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7576e-9005-4df8-bfac-1d648361c033 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:33.235803 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7576e-9005-4df8-bfac-1d648361c033 None admin] PATH_INFO: `/v3/projects/513e6592cd83457b8ff461b0e5e1fd40/users/f1cb8ad43a234233ad602f451f0f8ebf/roles/9a5640186d0940658e691be68ccf9205` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:33.238351 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-553e15f9-6e1d-4c69-9c5a-2b8b94f22d7b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 03:00:33.238351 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:33.238351 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:33.238351 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:33.238351 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:33.238351 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:33.238351 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:33.238351 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:33.238351 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:33.238351 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:33.238351 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:33.238351 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:33.238351 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:33.238351 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:33.238351 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:33.238351 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:33.240523 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:33.240523 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:33.240523 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:33.240523 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:33.240523 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:33.240523 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:33.240523 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:33.240523 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:33.240523 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:33.240523 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:33.240523 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:33.240523 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:33.240523 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:33.240523 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:33.240523 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:33.240523 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:33.242495 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:33.242495 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:33.242495 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:33.242495 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:33.242495 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:33.242495 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:33.242495 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:33.242495 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:33.242495 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:33.242495 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:33.242495 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 03:00:33.242495 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:33.242495 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 309/630] 10.222.0.65 () {56 vars in 1102 bytes} [Tue May 10 03:00:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:33.242495 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e15f9-6e1d-4c69-9c5a-2b8b94f22d7b None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:33.256437 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c7576e-9005-4df8-bfac-1d648361c033 None admin] RBAC: Authorizing `identity:create_grant(project_id=513e6592cd83457b8ff461b0e5e1fd40, user_id=f1cb8ad43a234233ad602f451f0f8ebf, role_id=9a5640186d0940658e691be68ccf9205)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:33.257994 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c7576e-9005-4df8-bfac-1d648361c033 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:33.329359 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 322/631] 10.222.0.65 () {58 vars in 1439 bytes} [Tue May 10 03:00:33 2022] PUT /identity/v3/projects/513e6592cd83457b8ff461b0e5e1fd40/users/f1cb8ad43a234233ad602f451f0f8ebf/roles/9a5640186d0940658e691be68ccf9205 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:00:33.330191 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c7576e-9005-4df8-bfac-1d648361c033 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:33.352516 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e15f9-6e1d-4c69-9c5a-2b8b94f22d7b None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:33.405436 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccfe3f3-bc8e-44c8-8964-603b96a92119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:33.406187 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfe3f3-bc8e-44c8-8964-603b96a92119 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:33.406482 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfe3f3-bc8e-44c8-8964-603b96a92119 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:33.406762 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfe3f3-bc8e-44c8-8964-603b96a92119 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:33.453426 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c7576e-9005-4df8-bfac-1d648361c033 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:33.489937 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216b9547-4b24-414b-9593-63824e6d458e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:33.491522 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b9547-4b24-414b-9593-63824e6d458e None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:33.492046 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b9547-4b24-414b-9593-63824e6d458e None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:33.492533 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b9547-4b24-414b-9593-63824e6d458e None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:33.493575 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216b9547-4b24-414b-9593-63824e6d458e None admin] RBAC: Adding query filter params (name=service) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:33.494087 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216b9547-4b24-414b-9593-63824e6d458e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:33.495676 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216b9547-4b24-414b-9593-63824e6d458e None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:33.499843 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccfe3f3-bc8e-44c8-8964-603b96a92119 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:33.501374 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccfe3f3-bc8e-44c8-8964-603b96a92119 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:33.505664 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 323/632] 10.222.0.65 () {56 vars in 1103 bytes} [Tue May 10 03:00:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:33.507884 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388deba-8034-433c-bc53-351b779b1650 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:33.508401 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388deba-8034-433c-bc53-351b779b1650 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:33.508878 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388deba-8034-433c-bc53-351b779b1650 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:33.514722 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 324/633] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:00:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:33.516026 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5388deba-8034-433c-bc53-351b779b1650 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:33.628816 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5388deba-8034-433c-bc53-351b779b1650 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:33.646211 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 310/634] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 10 03:00:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 03:00:33.647920 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f8185-8704-48c7-8ebc-1eba25a632de None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:33.648230 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f8185-8704-48c7-8ebc-1eba25a632de None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:33.648506 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f8185-8704-48c7-8ebc-1eba25a632de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:33.666017 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af905db8-4b34-41a5-94cf-6379418839ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:33.667185 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af905db8-4b34-41a5-94cf-6379418839ec None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:33.667724 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af905db8-4b34-41a5-94cf-6379418839ec None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:33.668251 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af905db8-4b34-41a5-94cf-6379418839ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:33.668357 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-8d6f8185-8704-48c7-8ebc-1eba25a632de None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:33.669518 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-8d6f8185-8704-48c7-8ebc-1eba25a632de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:33.679997 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af905db8-4b34-41a5-94cf-6379418839ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:33.681771 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af905db8-4b34-41a5-94cf-6379418839ec None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:33.704528 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-af905db8-4b34-41a5-94cf-6379418839ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:33.704528 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:33.704528 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:33.704528 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:33.704528 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:33.704528 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:33.704528 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:33.704528 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:33.704528 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:33.704528 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:33.704528 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:33.704528 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:33.704528 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:00:33.704528 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:00:33.704528 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:00:33.705432 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:00:33.705432 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:33.705432 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:33.705432 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:33.705432 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:33.705432 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:33.705432 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:33.705432 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:33.705432 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:33.705432 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:33.705432 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:33.705432 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:33.705432 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:33.705432 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:33.705432 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:33.705432 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:33.705432 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:33.706294 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:00:33.706294 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:00:33.706294 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:33.706294 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:33.709554 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 325/635] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:00:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:33.710549 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af905db8-4b34-41a5-94cf-6379418839ec None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:33.749632 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 311/636] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:00:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:33.750882 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f8185-8704-48c7-8ebc-1eba25a632de None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:33.819936 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af905db8-4b34-41a5-94cf-6379418839ec None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:33.854580 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cbbd6d-88b0-4a6d-bbb7-f33dab45e787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:33.855373 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cbbd6d-88b0-4a6d-bbb7-f33dab45e787 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:33.855659 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cbbd6d-88b0-4a6d-bbb7-f33dab45e787 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:33.855936 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cbbd6d-88b0-4a6d-bbb7-f33dab45e787 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:33.858876 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f8185-8704-48c7-8ebc-1eba25a632de None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:33.866791 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cbbd6d-88b0-4a6d-bbb7-f33dab45e787 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:33.868280 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cbbd6d-88b0-4a6d-bbb7-f33dab45e787 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:33.885076 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-44cbbd6d-88b0-4a6d-bbb7-f33dab45e787 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:33.885076 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:33.885076 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:33.885076 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:33.885076 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:33.885076 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:33.885076 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:33.885076 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:33.885076 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:33.885076 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:33.885076 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:33.885076 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:33.885076 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:00:33.885076 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:00:33.885076 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:00:33.886199 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:00:33.886199 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:33.886199 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:33.886199 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:33.886199 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:33.886199 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:33.886199 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:33.886199 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:33.886199 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:33.886199 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:33.886199 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:33.886199 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:33.886199 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:33.886199 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:33.886199 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:33.886199 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:33.886199 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:33.887307 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:00:33.887307 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:00:33.887307 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:33.887307 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:33.890680 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 326/637] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:00:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:33.891953 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b5db0-1ff6-4ece-baf5-fa74588aa7aa None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:33.892267 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b5db0-1ff6-4ece-baf5-fa74588aa7aa None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:33.892548 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b5db0-1ff6-4ece-baf5-fa74588aa7aa None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:33.893809 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 327/638] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:00:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:33.894497 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b5db0-1ff6-4ece-baf5-fa74588aa7aa None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:33.897721 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6bba60-6ef1-4cd9-8099-a77b43986163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:33.898619 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6bba60-6ef1-4cd9-8099-a77b43986163 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:33.899091 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6bba60-6ef1-4cd9-8099-a77b43986163 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:33.899371 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6bba60-6ef1-4cd9-8099-a77b43986163 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:33.900130 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6bba60-6ef1-4cd9-8099-a77b43986163 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:33.900440 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6bba60-6ef1-4cd9-8099-a77b43986163 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:33.901806 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6bba60-6ef1-4cd9-8099-a77b43986163 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:33.914359 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 312/639] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:00:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:33.915183 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6bba60-6ef1-4cd9-8099-a77b43986163 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:33.999596 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b5db0-1ff6-4ece-baf5-fa74588aa7aa None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:34.016836 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6bba60-6ef1-4cd9-8099-a77b43986163 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:34.034375 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69685fc1-2b4c-4a15-abde-1d006bad3cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:34.035175 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69685fc1-2b4c-4a15-abde-1d006bad3cac None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:34.035455 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69685fc1-2b4c-4a15-abde-1d006bad3cac None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:34.035729 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69685fc1-2b4c-4a15-abde-1d006bad3cac None admin] PATH_INFO: `/v3/roles/service` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:34.046719 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69685fc1-2b4c-4a15-abde-1d006bad3cac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:34.051202 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8950705-d720-4b74-9e20-db9881b4769b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:34.051869 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8950705-d720-4b74-9e20-db9881b4769b None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:34.052186 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8950705-d720-4b74-9e20-db9881b4769b None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:34.052467 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8950705-d720-4b74-9e20-db9881b4769b None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:34.053255 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8950705-d720-4b74-9e20-db9881b4769b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:34.053563 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8950705-d720-4b74-9e20-db9881b4769b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:34.054605 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-69685fc1-2b4c-4a15-abde-1d006bad3cac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 03:00:34.054605 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:34.054605 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:34.054605 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:34.054605 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:34.054605 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:34.054605 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:34.054605 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:34.054605 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:34.054605 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:34.054605 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:34.054605 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:34.054605 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:34.054605 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:34.054605 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:34.054605 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:34.055488 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:34.055488 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:34.055488 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:34.055488 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:34.055488 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:34.055488 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:34.055488 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:34.055488 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:34.055488 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:34.055488 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:34.055488 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:34.055488 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:34.055488 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:34.055488 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:34.055488 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:34.055488 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:34.056340 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:34.056340 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:34.056340 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:34.056340 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:34.056340 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:34.056340 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:34.056340 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:34.056340 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:34.056340 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:34.056340 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:34.056340 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 03:00:34.056340 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:34.056977 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8950705-d720-4b74-9e20-db9881b4769b None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:34.057059 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 328/640] 10.222.0.65 () {56 vars in 1102 bytes} [Tue May 10 03:00:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:34.057608 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f297785-e88e-4592-8a2d-fe0c254e0395 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:34.057608 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f297785-e88e-4592-8a2d-fe0c254e0395 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:34.057844 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f297785-e88e-4592-8a2d-fe0c254e0395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:34.076066 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 313/641] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:00:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:34.076066 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8950705-d720-4b74-9e20-db9881b4769b None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:34.076956 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-3f297785-e88e-4592-8a2d-fe0c254e0395 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:34.078173 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-3f297785-e88e-4592-8a2d-fe0c254e0395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:34.141555 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 329/642] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:00:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:34.142745 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f297785-e88e-4592-8a2d-fe0c254e0395 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:34.187506 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8950705-d720-4b74-9e20-db9881b4769b None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:34.221101 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c809fd78-370d-4b6e-a6a1-ecf2307c0a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:34.221904 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809fd78-370d-4b6e-a6a1-ecf2307c0a01 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:34.222185 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809fd78-370d-4b6e-a6a1-ecf2307c0a01 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:34.222460 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809fd78-370d-4b6e-a6a1-ecf2307c0a01 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:34.230768 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c809fd78-370d-4b6e-a6a1-ecf2307c0a01 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:34.232234 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c809fd78-370d-4b6e-a6a1-ecf2307c0a01 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:34.245223 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f297785-e88e-4592-8a2d-fe0c254e0395 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:34.246681 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-c809fd78-370d-4b6e-a6a1-ecf2307c0a01 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 10 03:00:34.246681 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:34.246681 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:34.246681 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:34.246681 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:34.246681 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:34.246681 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:34.246681 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:34.246681 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:34.246681 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:34.246681 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:34.246681 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:34.246681 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:00:34.246681 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:00:34.246681 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:00:34.246681 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:00:34.247719 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:34.247719 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:34.247719 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:00:34.247719 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:00:34.247719 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:00:34.247719 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:00:34.247719 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:34.247719 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:34.247719 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:34.247719 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:34.247719 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:34.247719 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:34.247719 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:34.247719 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:34.247719 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:34.247719 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:34.247719 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:34.247719 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:34.248986 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:34.248986 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:34.248986 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:00:34.248986 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:00:34.248986 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:00:34.248986 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:00:34.248986 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:00:34.248986 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:00:34.248986 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 10 03:00:34.248986 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:34.248986 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 314/643] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 10 03:00:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:34.248986 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c809fd78-370d-4b6e-a6a1-ecf2307c0a01 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:34.282520 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c234990-8093-46b7-a2c6-5bd0e36c3db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:34.283113 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c234990-8093-46b7-a2c6-5bd0e36c3db9 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:34.283398 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c234990-8093-46b7-a2c6-5bd0e36c3db9 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:34.283671 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c234990-8093-46b7-a2c6-5bd0e36c3db9 None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:34.284443 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c234990-8093-46b7-a2c6-5bd0e36c3db9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:34.284745 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c234990-8093-46b7-a2c6-5bd0e36c3db9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:34.286088 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c234990-8093-46b7-a2c6-5bd0e36c3db9 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:34.294759 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 330/644] 10.222.0.65 () {56 vars in 1103 bytes} [Tue May 10 03:00:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:34.295350 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c234990-8093-46b7-a2c6-5bd0e36c3db9 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:34.354865 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c809fd78-370d-4b6e-a6a1-ecf2307c0a01 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:34.387589 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c234990-8093-46b7-a2c6-5bd0e36c3db9 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:34.389042 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf7247-8d2b-4fc3-8f4c-d9552e0afdf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:34.389829 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf7247-8d2b-4fc3-8f4c-d9552e0afdf0 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:34.390133 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf7247-8d2b-4fc3-8f4c-d9552e0afdf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:34.390385 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf7247-8d2b-4fc3-8f4c-d9552e0afdf0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:34.397467 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cf7247-8d2b-4fc3-8f4c-d9552e0afdf0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:34.398933 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cf7247-8d2b-4fc3-8f4c-d9552e0afdf0 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:34.413227 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-e8cf7247-8d2b-4fc3-8f4c-d9552e0afdf0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:00:34.413227 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:34.413227 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:34.413227 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:34.413227 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:34.413227 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:34.413227 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:34.413227 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:34.413227 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:34.413227 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:34.413227 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:34.413227 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:34.413227 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:00:34.413227 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:00:34.413227 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:00:34.414109 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:00:34.414109 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:34.414109 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:34.414109 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:34.414109 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:34.414109 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:34.414109 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:34.414109 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:34.414109 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:34.414109 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:34.414109 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:34.414109 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:34.414109 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:34.414109 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:34.414109 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:34.414109 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:34.414109 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:34.420317 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:00:34.420317 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:00:34.420317 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:00:34.420317 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:00:34.420317 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:00:34.420317 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:00:34.420317 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:00:34.420317 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:34.420317 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 315/645] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 10 03:00:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:34.420317 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf7247-8d2b-4fc3-8f4c-d9552e0afdf0 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:34.423576 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3eca84-2821-4633-b8c6-d99f4630d6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:34.424479 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3eca84-2821-4633-b8c6-d99f4630d6dc None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:34.424832 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3eca84-2821-4633-b8c6-d99f4630d6dc None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:34.425112 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3eca84-2821-4633-b8c6-d99f4630d6dc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:34.435276 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3eca84-2821-4633-b8c6-d99f4630d6dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:34.442858 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-8b3eca84-2821-4633-b8c6-d99f4630d6dc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 03:00:34.442858 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:34.442858 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:34.442858 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:34.442858 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:34.442858 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:34.442858 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:34.442858 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:34.442858 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:34.442858 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:34.442858 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:34.442858 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:34.442858 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:34.442858 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:34.442858 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:34.442858 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:34.445058 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:34.445058 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:34.445058 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:34.445058 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:34.445058 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:34.445058 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:34.445058 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:34.445058 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:34.445058 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:34.445058 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:34.445058 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:34.445058 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:34.445058 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:34.445058 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:34.445058 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:34.445058 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:34.446451 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:34.446451 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:34.446451 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:34.446451 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:34.446451 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:34.446451 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:34.446451 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:34.446451 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:34.446451 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:34.446451 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:34.446451 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 03:00:34.446451 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:34.446451 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 331/646] 10.222.0.65 () {56 vars in 1102 bytes} [Tue May 10 03:00:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:34.446451 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3eca84-2821-4633-b8c6-d99f4630d6dc None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:34.531308 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf7247-8d2b-4fc3-8f4c-d9552e0afdf0 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:34.549804 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3eca84-2821-4633-b8c6-d99f4630d6dc None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:34.564085 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0df3980-46f5-417c-8375-9b8ec6cd2e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:34.564880 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df3980-46f5-417c-8375-9b8ec6cd2e4b None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:34.565278 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df3980-46f5-417c-8375-9b8ec6cd2e4b None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:34.565656 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df3980-46f5-417c-8375-9b8ec6cd2e4b None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:34.566622 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0df3980-46f5-417c-8375-9b8ec6cd2e4b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:34.567025 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0df3980-46f5-417c-8375-9b8ec6cd2e4b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:34.569159 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0df3980-46f5-417c-8375-9b8ec6cd2e4b None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:34.583384 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f94d1-da55-47ea-a30a-2536c8681467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:34.584770 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f94d1-da55-47ea-a30a-2536c8681467 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:34.585062 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f94d1-da55-47ea-a30a-2536c8681467 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:34.585385 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f94d1-da55-47ea-a30a-2536c8681467 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:34.587178 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 316/647] 10.222.0.65 () {56 vars in 1137 bytes} [Tue May 10 03:00:34 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:34.592287 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0df3980-46f5-417c-8375-9b8ec6cd2e4b None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:34.596618 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7f94d1-da55-47ea-a30a-2536c8681467 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:34.598038 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7f94d1-da55-47ea-a30a-2536c8681467 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:34.614984 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-da7f94d1-da55-47ea-a30a-2536c8681467 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:34.614984 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:34.614984 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:34.614984 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:34.614984 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:34.614984 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:34.614984 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:34.614984 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:34.614984 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:34.614984 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:34.614984 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:34.614984 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:34.614984 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:00:34.614984 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:00:34.614984 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:00:34.616162 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:00:34.616162 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:34.616162 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:34.616162 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:34.616162 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:34.616162 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:34.616162 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:34.616162 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:34.616162 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:34.616162 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:34.616162 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:34.616162 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:34.616162 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:34.616162 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:34.616162 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:34.616162 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:34.616162 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:34.617297 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:00:34.617297 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:00:34.617297 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:34.617297 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:34.617297 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 332/648] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:00:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:34.618122 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f94d1-da55-47ea-a30a-2536c8681467 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:34.695221 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0df3980-46f5-417c-8375-9b8ec6cd2e4b None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:34.716826 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f94d1-da55-47ea-a30a-2536c8681467 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:34.728602 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956fd9cc-dc80-4db3-a0e2-3774f0cf5ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:34.729363 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fd9cc-dc80-4db3-a0e2-3774f0cf5ddf None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:34.729755 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fd9cc-dc80-4db3-a0e2-3774f0cf5ddf None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:34.730109 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fd9cc-dc80-4db3-a0e2-3774f0cf5ddf None admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:34.730953 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956fd9cc-dc80-4db3-a0e2-3774f0cf5ddf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:34.731322 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956fd9cc-dc80-4db3-a0e2-3774f0cf5ddf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:34.732840 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956fd9cc-dc80-4db3-a0e2-3774f0cf5ddf None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:34.749368 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 317/649] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 10 03:00:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:34.749368 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956fd9cc-dc80-4db3-a0e2-3774f0cf5ddf None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:34.754788 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0996779b-2aac-471d-ab7f-1ee6bb1a7327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:34.755534 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996779b-2aac-471d-ab7f-1ee6bb1a7327 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:34.756448 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996779b-2aac-471d-ab7f-1ee6bb1a7327 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:34.756801 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996779b-2aac-471d-ab7f-1ee6bb1a7327 None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:34.757628 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0996779b-2aac-471d-ab7f-1ee6bb1a7327 None admin] RBAC: Adding query filter params (name=service) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:34.758012 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0996779b-2aac-471d-ab7f-1ee6bb1a7327 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:34.759444 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0996779b-2aac-471d-ab7f-1ee6bb1a7327 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:34.772280 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 333/650] 10.222.0.65 () {56 vars in 1103 bytes} [Tue May 10 03:00:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:34.772280 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0996779b-2aac-471d-ab7f-1ee6bb1a7327 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:34.849981 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956fd9cc-dc80-4db3-a0e2-3774f0cf5ddf None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:34.863156 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0996779b-2aac-471d-ab7f-1ee6bb1a7327 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:34.883979 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef318e95-87c1-422c-bf87-e905232595ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:34.884652 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef318e95-87c1-422c-bf87-e905232595ac None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:34.884932 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef318e95-87c1-422c-bf87-e905232595ac None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:34.885206 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef318e95-87c1-422c-bf87-e905232595ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:34.898656 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaedc7e-8b10-41c5-9f07-f6dfc140503e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:34.899318 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaedc7e-8b10-41c5-9f07-f6dfc140503e None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:34.899607 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaedc7e-8b10-41c5-9f07-f6dfc140503e None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:34.899887 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaedc7e-8b10-41c5-9f07-f6dfc140503e None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:34.900644 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaedc7e-8b10-41c5-9f07-f6dfc140503e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:34.900962 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaedc7e-8b10-41c5-9f07-f6dfc140503e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:34.902307 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaedc7e-8b10-41c5-9f07-f6dfc140503e None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:34.914659 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 334/651] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:00:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:34.915527 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaedc7e-8b10-41c5-9f07-f6dfc140503e None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:34.956867 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef318e95-87c1-422c-bf87-e905232595ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:34.958334 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef318e95-87c1-422c-bf87-e905232595ac None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:35.012208 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaedc7e-8b10-41c5-9f07-f6dfc140503e None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:35.045311 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bcad2a-f8fe-4162-b7df-c460ef4060f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:35.045971 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bcad2a-f8fe-4162-b7df-c460ef4060f5 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:35.046256 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bcad2a-f8fe-4162-b7df-c460ef4060f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:35.046617 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bcad2a-f8fe-4162-b7df-c460ef4060f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:35.047365 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bcad2a-f8fe-4162-b7df-c460ef4060f5 None admin] RBAC: Adding query filter params (role.id=9a5640186d0940658e691be68ccf9205, scope.project.id=513e6592cd83457b8ff461b0e5e1fd40, user.id=9b7ccdccba0b4f9e86817946f22dbe28) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:35.047680 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bcad2a-f8fe-4162-b7df-c460ef4060f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:35.049251 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bcad2a-f8fe-4162-b7df-c460ef4060f5 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:35.064235 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 335/652] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 10 03:00:34 2022] GET /identity/v3/role_assignments?user.id=9b7ccdccba0b4f9e86817946f22dbe28&scope.project.id=513e6592cd83457b8ff461b0e5e1fd40&role.id=9a5640186d0940658e691be68ccf9205 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:35.064235 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bcad2a-f8fe-4162-b7df-c460ef4060f5 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:35.071469 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 318/653] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 10 03:00:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 03:00:35.072348 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef318e95-87c1-422c-bf87-e905232595ac None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:35.168820 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bcad2a-f8fe-4162-b7df-c460ef4060f5 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:35.178838 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef318e95-87c1-422c-bf87-e905232595ac None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:35.204232 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acc351f-9d21-4d43-9d0e-6172731f8ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:35.205196 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc351f-9d21-4d43-9d0e-6172731f8ee5 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:35.205626 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc351f-9d21-4d43-9d0e-6172731f8ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:35.205993 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc351f-9d21-4d43-9d0e-6172731f8ee5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:35.215456 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1511de-807d-4e7f-994d-5c78697af04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:35.216330 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1511de-807d-4e7f-994d-5c78697af04a None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:35.216614 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1511de-807d-4e7f-994d-5c78697af04a None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:35.216886 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1511de-807d-4e7f-994d-5c78697af04a None admin] PATH_INFO: `/v3/users/glance` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:35.218969 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acc351f-9d21-4d43-9d0e-6172731f8ee5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:35.220705 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acc351f-9d21-4d43-9d0e-6172731f8ee5 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:35.225344 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1511de-807d-4e7f-994d-5c78697af04a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:35.226805 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1511de-807d-4e7f-994d-5c78697af04a None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:35.240165 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-3acc351f-9d21-4d43-9d0e-6172731f8ee5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:35.240165 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:35.240165 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:35.240165 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:35.240165 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:35.240165 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:35.240165 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:35.240165 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:35.240165 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:35.240165 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:35.240165 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:35.240165 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:35.240165 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:00:35.240165 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:00:35.240165 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:00:35.241619 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:00:35.241619 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:35.241619 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:35.241619 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:35.241619 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:35.241619 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:35.241619 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:35.241619 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:35.241619 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:35.241619 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:35.241619 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:35.241619 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:35.241619 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:35.241619 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:35.241619 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:35.241619 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:35.241619 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:35.242530 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:00:35.242530 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:00:35.242530 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:35.242530 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:35.243195 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-5f1511de-807d-4e7f-994d-5c78697af04a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 10 03:00:35.243195 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:35.243195 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:35.243195 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:35.243195 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:35.243195 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:35.243195 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:35.243195 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:35.243195 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:35.243195 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:35.243195 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:35.243195 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:35.243195 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:00:35.243195 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:00:35.243195 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:00:35.243195 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:00:35.244086 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:35.244086 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:35.244086 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:00:35.244086 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:00:35.244086 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:00:35.244086 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:00:35.244086 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:35.244086 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:35.244086 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:35.244086 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:35.244086 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:35.244086 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:35.244086 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:35.244086 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:35.244086 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:35.244086 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:35.244086 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:35.244086 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:35.245011 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:35.245011 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:35.245011 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:00:35.245011 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:00:35.245011 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:00:35.245011 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:00:35.245011 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:00:35.245011 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:00:35.245011 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 10 03:00:35.245011 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:35.252442 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 319/654] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 10 03:00:35 2022] GET /identity/v3/users/glance => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:35.252442 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1511de-807d-4e7f-994d-5c78697af04a None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:35.253285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 336/655] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:00:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:35.254496 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acc351f-9d21-4d43-9d0e-6172731f8ee5 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:35.366115 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1511de-807d-4e7f-994d-5c78697af04a None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:35.402517 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a1b065-a9ea-428f-b89d-eec20f4fcb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:35.403708 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1b065-a9ea-428f-b89d-eec20f4fcb18 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:35.404228 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1b065-a9ea-428f-b89d-eec20f4fcb18 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:35.404706 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1b065-a9ea-428f-b89d-eec20f4fcb18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:35.416074 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a1b065-a9ea-428f-b89d-eec20f4fcb18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:35.417808 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a1b065-a9ea-428f-b89d-eec20f4fcb18 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:35.436946 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-58a1b065-a9ea-428f-b89d-eec20f4fcb18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:35.436946 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:35.436946 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:35.436946 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:35.436946 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:35.436946 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:35.436946 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:35.436946 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:35.436946 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:35.436946 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:35.436946 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:35.436946 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:35.436946 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:00:35.436946 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:00:35.436946 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:00:35.437885 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:00:35.437885 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:35.437885 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:35.437885 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:35.437885 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:35.437885 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:35.437885 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:35.437885 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:35.437885 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:35.437885 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:35.437885 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:35.437885 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:35.437885 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:35.437885 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:35.437885 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:35.437885 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:35.437885 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:35.438775 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:00:35.438775 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:00:35.438775 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:35.438775 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:35.441305 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 320/656] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:00:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:35.442455 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a1b065-a9ea-428f-b89d-eec20f4fcb18 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:35.491983 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acc351f-9d21-4d43-9d0e-6172731f8ee5 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:35.526601 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d56df7-1702-474a-ab17-970e60bc572d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:35.527283 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d56df7-1702-474a-ab17-970e60bc572d None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:35.527561 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d56df7-1702-474a-ab17-970e60bc572d None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:35.527832 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d56df7-1702-474a-ab17-970e60bc572d None admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:35.528719 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d56df7-1702-474a-ab17-970e60bc572d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:35.529025 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d56df7-1702-474a-ab17-970e60bc572d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:35.530443 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d56df7-1702-474a-ab17-970e60bc572d None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:35.548948 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 337/657] 10.222.0.65 () {56 vars in 1137 bytes} [Tue May 10 03:00:35 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:35.549891 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d56df7-1702-474a-ab17-970e60bc572d None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:35.561272 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a1b065-a9ea-428f-b89d-eec20f4fcb18 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:35.609122 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f7164-87b1-4dc0-a68a-8bc02e159a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:35.610623 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f7164-87b1-4dc0-a68a-8bc02e159a80 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:35.611374 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f7164-87b1-4dc0-a68a-8bc02e159a80 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:35.611874 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f7164-87b1-4dc0-a68a-8bc02e159a80 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:35.613295 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87f7164-87b1-4dc0-a68a-8bc02e159a80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:35.614052 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87f7164-87b1-4dc0-a68a-8bc02e159a80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:35.615712 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87f7164-87b1-4dc0-a68a-8bc02e159a80 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:35.635609 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 321/658] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:00:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:35.635609 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f7164-87b1-4dc0-a68a-8bc02e159a80 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:35.657814 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d56df7-1702-474a-ab17-970e60bc572d None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:35.699007 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd82db-a515-4553-9bf2-e4658883bb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:35.700375 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd82db-a515-4553-9bf2-e4658883bb9a None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:35.700665 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd82db-a515-4553-9bf2-e4658883bb9a None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:35.700942 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd82db-a515-4553-9bf2-e4658883bb9a None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:35.701671 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd82db-a515-4553-9bf2-e4658883bb9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:35.701980 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd82db-a515-4553-9bf2-e4658883bb9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:35.703344 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd82db-a515-4553-9bf2-e4658883bb9a None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:35.715088 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 338/659] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:00:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:35.716477 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c906d0-48d5-4d05-b176-c96d7cfcfa5c None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:35.716772 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c906d0-48d5-4d05-b176-c96d7cfcfa5c None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:35.717052 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c906d0-48d5-4d05-b176-c96d7cfcfa5c None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:35.718392 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 339/660] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:00:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:35.720790 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c906d0-48d5-4d05-b176-c96d7cfcfa5c None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:35.734884 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f7164-87b1-4dc0-a68a-8bc02e159a80 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:35.767855 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad7feab-6498-412e-83f1-d74cbdc27d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:35.768659 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7feab-6498-412e-83f1-d74cbdc27d61 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:35.769037 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7feab-6498-412e-83f1-d74cbdc27d61 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:35.769419 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7feab-6498-412e-83f1-d74cbdc27d61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:35.820418 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c906d0-48d5-4d05-b176-c96d7cfcfa5c None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:35.834364 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad7feab-6498-412e-83f1-d74cbdc27d61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:35.835829 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad7feab-6498-412e-83f1-d74cbdc27d61 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:35.852826 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809437b1-1cbc-4daa-be90-5dc098b8aba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:35.853614 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809437b1-1cbc-4daa-be90-5dc098b8aba0 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:35.853901 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809437b1-1cbc-4daa-be90-5dc098b8aba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:35.854176 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809437b1-1cbc-4daa-be90-5dc098b8aba0 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:35.861109 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809437b1-1cbc-4daa-be90-5dc098b8aba0 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:35.862523 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809437b1-1cbc-4daa-be90-5dc098b8aba0 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:35.877274 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-809437b1-1cbc-4daa-be90-5dc098b8aba0 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 10 03:00:35.877274 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:35.877274 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:35.877274 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:35.877274 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:35.877274 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:35.877274 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:35.877274 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:35.877274 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:35.877274 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:35.877274 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:35.877274 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:35.877274 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:00:35.877274 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:00:35.877274 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:00:35.877274 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:00:35.878219 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:35.878219 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:35.878219 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:00:35.878219 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:00:35.878219 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:00:35.878219 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:00:35.878219 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:35.878219 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:35.878219 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:35.878219 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:35.878219 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:35.878219 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:35.878219 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:35.878219 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:35.878219 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:35.878219 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:35.878219 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:35.878219 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:35.879129 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:35.879129 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:35.879129 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:00:35.879129 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:00:35.879129 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:00:35.879129 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:00:35.879129 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:00:35.879129 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:00:35.879129 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 10 03:00:35.879129 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:35.883030 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 340/661] 10.222.0.65 () {56 vars in 1102 bytes} [Tue May 10 03:00:35 2022] GET /identity/v3/users/neutron => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:35.883861 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809437b1-1cbc-4daa-be90-5dc098b8aba0 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:35.940137 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 322/662] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 10 03:00:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 03:00:35.940137 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d4824-7574-4e46-85f8-59af0e9955dc None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:35.940137 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d4824-7574-4e46-85f8-59af0e9955dc None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:35.940137 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d4824-7574-4e46-85f8-59af0e9955dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:35.956323 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-875d4824-7574-4e46-85f8-59af0e9955dc None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:35.957462 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-875d4824-7574-4e46-85f8-59af0e9955dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:35.984218 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809437b1-1cbc-4daa-be90-5dc098b8aba0 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:36.018368 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c5743c-1ffa-4c8a-97b9-2d09fdc6baac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:36.019165 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c5743c-1ffa-4c8a-97b9-2d09fdc6baac None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:36.019449 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c5743c-1ffa-4c8a-97b9-2d09fdc6baac None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:36.019772 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c5743c-1ffa-4c8a-97b9-2d09fdc6baac None admin] PATH_INFO: `/v3/projects/service` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:36.028199 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 323/663] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:00:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:36.028199 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d4824-7574-4e46-85f8-59af0e9955dc None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:36.036915 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c5743c-1ffa-4c8a-97b9-2d09fdc6baac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:36.038457 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c5743c-1ffa-4c8a-97b9-2d09fdc6baac None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:36.052875 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-c1c5743c-1ffa-4c8a-97b9-2d09fdc6baac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:00:36.052875 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:36.052875 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:36.052875 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:36.052875 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:36.052875 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:36.052875 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:36.052875 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:36.052875 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:36.052875 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:36.052875 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:36.052875 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:36.052875 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:00:36.052875 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:00:36.052875 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:00:36.053773 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:00:36.053773 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:36.053773 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:36.053773 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:36.053773 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:36.053773 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:36.053773 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:36.053773 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:36.053773 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:36.053773 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:36.053773 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:36.053773 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:36.053773 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:36.053773 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:36.053773 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:36.053773 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:36.053773 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:36.054661 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:00:36.054661 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:00:36.054661 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:00:36.054661 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:00:36.054661 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:00:36.054661 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:00:36.054661 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:00:36.054661 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:36.054661 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 341/664] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 10 03:00:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:36.055736 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c5743c-1ffa-4c8a-97b9-2d09fdc6baac None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:36.116920 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d4824-7574-4e46-85f8-59af0e9955dc None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:36.149449 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04616ff-9d91-4073-bd15-165f0ea972cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:36.150124 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04616ff-9d91-4073-bd15-165f0ea972cb None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:36.150405 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04616ff-9d91-4073-bd15-165f0ea972cb None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:36.150681 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04616ff-9d91-4073-bd15-165f0ea972cb None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:36.151511 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04616ff-9d91-4073-bd15-165f0ea972cb None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:36.151816 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04616ff-9d91-4073-bd15-165f0ea972cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:36.153275 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04616ff-9d91-4073-bd15-165f0ea972cb None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:36.153842 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c5743c-1ffa-4c8a-97b9-2d09fdc6baac None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:36.174290 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 324/665] 10.222.0.65 () {56 vars in 1139 bytes} [Tue May 10 03:00:36 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:36.174290 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04616ff-9d91-4073-bd15-165f0ea972cb None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:36.190954 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5efd857-653b-4631-a541-7730470da54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:36.191738 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5efd857-653b-4631-a541-7730470da54c None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:36.192044 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5efd857-653b-4631-a541-7730470da54c None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:36.192327 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5efd857-653b-4631-a541-7730470da54c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:36.202831 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5efd857-653b-4631-a541-7730470da54c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:36.204293 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5efd857-653b-4631-a541-7730470da54c None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:36.223910 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-c5efd857-653b-4631-a541-7730470da54c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:36.223910 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:36.223910 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:36.223910 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:36.223910 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:36.223910 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:36.223910 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:36.223910 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:36.223910 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:36.223910 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:36.223910 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:36.223910 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:36.223910 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:00:36.223910 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:00:36.223910 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:00:36.224944 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:00:36.224944 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:36.224944 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:36.224944 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:36.224944 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:36.224944 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:36.224944 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:36.224944 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:36.224944 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:36.224944 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:36.224944 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:36.224944 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:36.224944 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:36.224944 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:36.224944 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:36.224944 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:36.224944 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:36.226010 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:00:36.226010 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:00:36.226010 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:36.226010 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:36.229496 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 342/666] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:00:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:36.230194 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5efd857-653b-4631-a541-7730470da54c None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:36.272542 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04616ff-9d91-4073-bd15-165f0ea972cb None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:36.305867 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a439dfce-0b89-4b23-a34a-c2db95531e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:36.306679 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a439dfce-0b89-4b23-a34a-c2db95531e75 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:36.306964 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a439dfce-0b89-4b23-a34a-c2db95531e75 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:36.307242 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a439dfce-0b89-4b23-a34a-c2db95531e75 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:36.319377 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a439dfce-0b89-4b23-a34a-c2db95531e75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:36.327495 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-a439dfce-0b89-4b23-a34a-c2db95531e75 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 03:00:36.327495 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:36.327495 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:36.327495 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:36.327495 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:36.327495 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:36.327495 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:36.327495 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:36.327495 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:36.327495 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:36.327495 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:36.327495 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:36.327495 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:36.327495 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:36.327495 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:36.327495 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:36.328513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:36.328513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:36.328513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:36.328513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:36.328513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:36.328513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:36.328513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:36.328513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:36.328513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:36.328513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:36.328513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:36.328513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:36.328513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:36.328513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:36.328513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:36.328513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:36.329391 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:36.329391 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:36.329391 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:36.329391 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:36.329391 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:36.329391 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:36.329391 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:36.329391 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:36.329391 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:36.329391 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:36.329391 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 03:00:36.329391 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:36.330042 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5efd857-653b-4631-a541-7730470da54c None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:36.333556 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 325/667] 10.222.0.65 () {56 vars in 1102 bytes} [Tue May 10 03:00:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:36.334186 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a439dfce-0b89-4b23-a34a-c2db95531e75 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:36.362802 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76235d3-1b65-4c9e-8d7c-ff1459214881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:36.363464 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76235d3-1b65-4c9e-8d7c-ff1459214881 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:36.363759 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76235d3-1b65-4c9e-8d7c-ff1459214881 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:36.364037 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76235d3-1b65-4c9e-8d7c-ff1459214881 None admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:36.364820 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76235d3-1b65-4c9e-8d7c-ff1459214881 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:36.365633 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76235d3-1b65-4c9e-8d7c-ff1459214881 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:36.367041 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76235d3-1b65-4c9e-8d7c-ff1459214881 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:36.384099 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 343/668] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 10 03:00:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:36.384099 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76235d3-1b65-4c9e-8d7c-ff1459214881 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:36.432352 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a439dfce-0b89-4b23-a34a-c2db95531e75 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:36.466036 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a21b9-307c-4de3-a653-e5bbde06c195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:36.466697 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a21b9-307c-4de3-a653-e5bbde06c195 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:36.466984 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a21b9-307c-4de3-a653-e5bbde06c195 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:36.467259 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a21b9-307c-4de3-a653-e5bbde06c195 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:36.479965 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76235d3-1b65-4c9e-8d7c-ff1459214881 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:36.513200 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e9e0f-23f2-477a-925c-f5952ef72e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:36.513857 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e9e0f-23f2-477a-925c-f5952ef72e8d None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:36.514134 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e9e0f-23f2-477a-925c-f5952ef72e8d None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:36.514406 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e9e0f-23f2-477a-925c-f5952ef72e8d None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:36.515133 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1e9e0f-23f2-477a-925c-f5952ef72e8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:36.515433 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1e9e0f-23f2-477a-925c-f5952ef72e8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:36.516807 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1e9e0f-23f2-477a-925c-f5952ef72e8d None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:36.527706 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 344/669] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:00:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:36.528531 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e9e0f-23f2-477a-925c-f5952ef72e8d None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:36.535175 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075a21b9-307c-4de3-a653-e5bbde06c195 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:36.536856 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075a21b9-307c-4de3-a653-e5bbde06c195 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:36.627032 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e9e0f-23f2-477a-925c-f5952ef72e8d None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:36.633420 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 326/670] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 10 03:00:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 03:00:36.634254 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a21b9-307c-4de3-a653-e5bbde06c195 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:36.664317 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474336c4-338c-481a-b222-1a324bff83fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:36.664983 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474336c4-338c-481a-b222-1a324bff83fb None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:36.665265 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474336c4-338c-481a-b222-1a324bff83fb None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:36.665542 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474336c4-338c-481a-b222-1a324bff83fb None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:36.666287 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474336c4-338c-481a-b222-1a324bff83fb None admin] RBAC: Adding query filter params (name=service) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:36.666600 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474336c4-338c-481a-b222-1a324bff83fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:36.667950 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474336c4-338c-481a-b222-1a324bff83fb None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:36.680493 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 345/671] 10.222.0.65 () {56 vars in 1103 bytes} [Tue May 10 03:00:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:36.681522 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474336c4-338c-481a-b222-1a324bff83fb None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:36.734202 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a21b9-307c-4de3-a653-e5bbde06c195 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:36.767440 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0499316-5db3-438a-b073-2b3ccee08b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:36.768131 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0499316-5db3-438a-b073-2b3ccee08b7b None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:36.768416 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0499316-5db3-438a-b073-2b3ccee08b7b None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:36.768691 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0499316-5db3-438a-b073-2b3ccee08b7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:36.769513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0499316-5db3-438a-b073-2b3ccee08b7b None admin] RBAC: Adding query filter params (role.id=9a5640186d0940658e691be68ccf9205, scope.project.id=513e6592cd83457b8ff461b0e5e1fd40, user.id=3509cdb58f6a4d05a7ed79e46791ac19) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:36.769830 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0499316-5db3-438a-b073-2b3ccee08b7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:36.771245 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0499316-5db3-438a-b073-2b3ccee08b7b None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:36.788047 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 327/672] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 10 03:00:36 2022] GET /identity/v3/role_assignments?user.id=3509cdb58f6a4d05a7ed79e46791ac19&scope.project.id=513e6592cd83457b8ff461b0e5e1fd40&role.id=9a5640186d0940658e691be68ccf9205 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:36.788047 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0499316-5db3-438a-b073-2b3ccee08b7b None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:36.795480 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474336c4-338c-481a-b222-1a324bff83fb None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:36.841166 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6630a9a8-53ad-464f-be11-677981bb2020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:36.842659 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6630a9a8-53ad-464f-be11-677981bb2020 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:36.843206 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6630a9a8-53ad-464f-be11-677981bb2020 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:36.843683 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6630a9a8-53ad-464f-be11-677981bb2020 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:36.854928 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6630a9a8-53ad-464f-be11-677981bb2020 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:36.856704 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6630a9a8-53ad-464f-be11-677981bb2020 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:36.876857 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-6630a9a8-53ad-464f-be11-677981bb2020 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:00:36.876857 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:36.876857 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:36.876857 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:36.876857 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:36.876857 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:36.876857 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:36.876857 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:36.876857 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:36.876857 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:36.876857 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:36.876857 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:36.876857 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:00:36.876857 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:00:36.876857 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:00:36.877819 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:00:36.877819 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:36.877819 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:36.877819 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:36.877819 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:36.877819 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:36.877819 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:36.877819 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:36.877819 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:36.877819 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:36.877819 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:36.877819 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:36.877819 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:36.877819 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:36.877819 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:36.877819 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:36.877819 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:36.878721 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:00:36.878721 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:00:36.878721 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:00:36.878721 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:00:36.878721 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:00:36.878721 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:00:36.878721 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:00:36.878721 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:36.879548 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 346/673] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 10 03:00:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:36.880727 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6630a9a8-53ad-464f-be11-677981bb2020 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:36.885935 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0499316-5db3-438a-b073-2b3ccee08b7b None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:36.932032 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0052cb3a-0e70-4870-82de-de5eafbaacfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:36.932032 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0052cb3a-0e70-4870-82de-de5eafbaacfb None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:36.932032 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0052cb3a-0e70-4870-82de-de5eafbaacfb None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:36.932032 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0052cb3a-0e70-4870-82de-de5eafbaacfb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:36.942304 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0052cb3a-0e70-4870-82de-de5eafbaacfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:36.944207 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0052cb3a-0e70-4870-82de-de5eafbaacfb None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:36.963044 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-0052cb3a-0e70-4870-82de-de5eafbaacfb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:36.963044 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:36.963044 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:36.963044 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:36.963044 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:36.963044 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:36.963044 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:36.963044 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:36.963044 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:36.963044 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:36.963044 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:36.963044 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:36.963044 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:00:36.963044 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:00:36.963044 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:00:36.963989 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:00:36.963989 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:36.963989 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:36.963989 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:36.963989 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:36.963989 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:36.963989 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:36.963989 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:36.963989 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:36.963989 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:36.963989 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:36.963989 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:36.963989 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:36.963989 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:36.963989 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:36.963989 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:36.963989 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:36.964874 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:00:36.964874 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:00:36.964874 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:36.964874 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:36.967157 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 328/674] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:00:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:36.968361 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0052cb3a-0e70-4870-82de-de5eafbaacfb None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:37.004434 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6630a9a8-53ad-464f-be11-677981bb2020 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:37.043167 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab5be1-aabd-4516-9967-f9ed44973613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:37.043952 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab5be1-aabd-4516-9967-f9ed44973613 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:37.043952 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab5be1-aabd-4516-9967-f9ed44973613 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:37.043952 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab5be1-aabd-4516-9967-f9ed44973613 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:37.057131 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bab5be1-aabd-4516-9967-f9ed44973613 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:37.058622 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bab5be1-aabd-4516-9967-f9ed44973613 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:37.079362 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-9bab5be1-aabd-4516-9967-f9ed44973613 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:37.079362 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:37.079362 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:37.079362 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:37.079362 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:37.079362 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:37.079362 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:37.079362 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:37.079362 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:37.079362 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:37.079362 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:37.079362 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:37.079362 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:00:37.079362 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:00:37.079362 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:00:37.080334 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:00:37.080334 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:37.080334 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:37.080334 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:37.080334 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:37.080334 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:37.080334 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:37.080334 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:37.080334 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:37.080334 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:37.080334 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:37.080334 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:37.080334 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:37.080334 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:37.080334 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:37.080334 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:37.080334 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:37.081264 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:00:37.081264 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:00:37.081264 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:37.081264 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:37.081264 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 347/675] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:00:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:37.081988 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab5be1-aabd-4516-9967-f9ed44973613 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:37.088485 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0052cb3a-0e70-4870-82de-de5eafbaacfb None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:37.123984 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef523d01-77c9-4c74-9c7c-3e22025613cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:37.124704 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef523d01-77c9-4c74-9c7c-3e22025613cc None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:37.124992 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef523d01-77c9-4c74-9c7c-3e22025613cc None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:37.125273 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef523d01-77c9-4c74-9c7c-3e22025613cc None admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:37.126068 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef523d01-77c9-4c74-9c7c-3e22025613cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:37.126381 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef523d01-77c9-4c74-9c7c-3e22025613cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:37.127818 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef523d01-77c9-4c74-9c7c-3e22025613cc None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:37.140040 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 329/676] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 10 03:00:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:37.140965 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef523d01-77c9-4c74-9c7c-3e22025613cc None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:37.190498 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab5be1-aabd-4516-9967-f9ed44973613 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:37.225021 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e521f-df08-4b2f-a09c-4145b264b002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:37.225681 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e521f-df08-4b2f-a09c-4145b264b002 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:37.225964 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e521f-df08-4b2f-a09c-4145b264b002 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:37.226237 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e521f-df08-4b2f-a09c-4145b264b002 None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:37.226972 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114e521f-df08-4b2f-a09c-4145b264b002 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:37.227280 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114e521f-df08-4b2f-a09c-4145b264b002 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:37.228685 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114e521f-df08-4b2f-a09c-4145b264b002 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:37.241486 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 348/677] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:37.242398 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e521f-df08-4b2f-a09c-4145b264b002 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:37.242866 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef523d01-77c9-4c74-9c7c-3e22025613cc None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:37.280875 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7464307-0a56-4165-bb5a-688439ffb0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:37.281612 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7464307-0a56-4165-bb5a-688439ffb0a1 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:37.281900 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7464307-0a56-4165-bb5a-688439ffb0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:37.282173 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7464307-0a56-4165-bb5a-688439ffb0a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:37.283156 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7464307-0a56-4165-bb5a-688439ffb0a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:37.283457 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7464307-0a56-4165-bb5a-688439ffb0a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:37.284862 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7464307-0a56-4165-bb5a-688439ffb0a1 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:37.297804 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 330/678] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:37.298649 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7464307-0a56-4165-bb5a-688439ffb0a1 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:37.344852 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e521f-df08-4b2f-a09c-4145b264b002 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:37.379492 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed4ea65-0ceb-4153-8c26-7fbd0b9e7432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:37.380179 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4ea65-0ceb-4153-8c26-7fbd0b9e7432 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:37.380461 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4ea65-0ceb-4153-8c26-7fbd0b9e7432 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:37.380770 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4ea65-0ceb-4153-8c26-7fbd0b9e7432 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:37.381613 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed4ea65-0ceb-4153-8c26-7fbd0b9e7432 None admin] RBAC: Adding query filter params (role.id=9a5640186d0940658e691be68ccf9205, scope.project.id=513e6592cd83457b8ff461b0e5e1fd40, user.id=c79f0a3a3223444c82589da07305469f) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:37.381923 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed4ea65-0ceb-4153-8c26-7fbd0b9e7432 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:37.383345 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed4ea65-0ceb-4153-8c26-7fbd0b9e7432 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:37.396839 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 349/679] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 10 03:00:37 2022] GET /identity/v3/role_assignments?user.id=c79f0a3a3223444c82589da07305469f&scope.project.id=513e6592cd83457b8ff461b0e5e1fd40&role.id=9a5640186d0940658e691be68ccf9205 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:37.397852 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed4ea65-0ceb-4153-8c26-7fbd0b9e7432 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:37.398294 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7464307-0a56-4165-bb5a-688439ffb0a1 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:37.433956 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87400971-a4ea-4f8b-b7ab-eabb61d51a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:37.434777 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87400971-a4ea-4f8b-b7ab-eabb61d51a05 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:37.435056 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87400971-a4ea-4f8b-b7ab-eabb61d51a05 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:37.435328 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87400971-a4ea-4f8b-b7ab-eabb61d51a05 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:37.443751 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87400971-a4ea-4f8b-b7ab-eabb61d51a05 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:37.445199 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87400971-a4ea-4f8b-b7ab-eabb61d51a05 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:37.460539 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-87400971-a4ea-4f8b-b7ab-eabb61d51a05 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:00:37.460539 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:37.460539 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:37.460539 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:37.460539 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:37.460539 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:37.460539 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:37.460539 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:37.460539 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:37.460539 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:37.460539 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:37.460539 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:37.460539 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:00:37.460539 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:00:37.460539 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:00:37.461690 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:00:37.461690 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:37.461690 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:37.461690 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:37.461690 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:37.461690 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:37.461690 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:37.461690 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:37.461690 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:37.461690 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:37.461690 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:37.461690 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:37.461690 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:37.461690 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:37.461690 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:37.461690 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:37.461690 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:37.462748 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:00:37.462748 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:00:37.462748 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:00:37.462748 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:00:37.462748 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:00:37.462748 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:00:37.462748 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:00:37.462748 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:37.462748 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 331/680] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 10 03:00:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:37.463817 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f007f-436d-40ef-8ad0-ba4450eab82b None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:37.463817 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f007f-436d-40ef-8ad0-ba4450eab82b None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:37.463817 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f007f-436d-40ef-8ad0-ba4450eab82b None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:37.469209 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 332/681] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:00:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:37.469209 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4f007f-436d-40ef-8ad0-ba4450eab82b None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:37.532136 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed4ea65-0ceb-4153-8c26-7fbd0b9e7432 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:37.573487 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d8f60-e235-4ca6-91b3-fba3360ded6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:37.574555 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d8f60-e235-4ca6-91b3-fba3360ded6c None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:37.575019 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d8f60-e235-4ca6-91b3-fba3360ded6c None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:37.575439 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d8f60-e235-4ca6-91b3-fba3360ded6c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:37.580782 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4f007f-436d-40ef-8ad0-ba4450eab82b None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:37.584998 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030d8f60-e235-4ca6-91b3-fba3360ded6c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:37.586662 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030d8f60-e235-4ca6-91b3-fba3360ded6c None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:37.601873 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-030d8f60-e235-4ca6-91b3-fba3360ded6c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 03:00:37.601873 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:37.601873 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:37.601873 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:37.601873 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:37.601873 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:37.601873 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:37.601873 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:37.601873 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:37.601873 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:37.601873 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:37.601873 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:37.601873 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:00:37.601873 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:00:37.601873 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:00:37.601873 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:00:37.603075 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:37.603075 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:37.603075 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:00:37.603075 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:00:37.603075 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:00:37.603075 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:00:37.603075 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:37.603075 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:37.603075 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:37.603075 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:37.603075 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:37.603075 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:37.603075 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:37.603075 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:37.603075 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:37.603075 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:37.603075 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:37.603075 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:37.604280 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:37.604280 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:37.604280 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:00:37.604280 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:00:37.604280 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:00:37.604280 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:00:37.604280 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:00:37.604280 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:00:37.604280 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 03:00:37.604280 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:37.606436 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 350/682] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 10 03:00:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:37.607916 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ba74a-2004-4726-81f3-dfb98598481b None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:37.608373 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ba74a-2004-4726-81f3-dfb98598481b None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:37.608815 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ba74a-2004-4726-81f3-dfb98598481b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:37.620370 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac958f-988b-450b-8b18-fd29bdab4aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:37.621047 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac958f-988b-450b-8b18-fd29bdab4aff None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:37.621810 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac958f-988b-450b-8b18-fd29bdab4aff None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:37.622109 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac958f-988b-450b-8b18-fd29bdab4aff None admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:37.622917 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ac958f-988b-450b-8b18-fd29bdab4aff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:37.623404 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ac958f-988b-450b-8b18-fd29bdab4aff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:37.625060 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ac958f-988b-450b-8b18-fd29bdab4aff None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:37.627614 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-a06ba74a-2004-4726-81f3-dfb98598481b None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:37.628879 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-a06ba74a-2004-4726-81f3-dfb98598481b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:37.639232 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 333/683] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 10 03:00:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:37.640216 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac958f-988b-450b-8b18-fd29bdab4aff None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:37.723710 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 351/684] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:00:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:37.724849 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ba74a-2004-4726-81f3-dfb98598481b None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:37.775279 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac958f-988b-450b-8b18-fd29bdab4aff None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:37.818967 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb0d594-7ff5-4cfa-add6-aad8191513b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:37.820197 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0d594-7ff5-4cfa-add6-aad8191513b1 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:37.820625 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0d594-7ff5-4cfa-add6-aad8191513b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:37.821037 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0d594-7ff5-4cfa-add6-aad8191513b1 None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:37.822009 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb0d594-7ff5-4cfa-add6-aad8191513b1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:37.822894 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb0d594-7ff5-4cfa-add6-aad8191513b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:37.824932 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb0d594-7ff5-4cfa-add6-aad8191513b1 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:37.834467 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ba74a-2004-4726-81f3-dfb98598481b None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:37.847294 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 334/685] 10.222.0.65 () {56 vars in 1135 bytes} [Tue May 10 03:00:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:37.848529 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb0d594-7ff5-4cfa-add6-aad8191513b1 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:37.870283 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743a4fa-0ea1-4f44-8dff-0a01b0f2d94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:37.871031 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743a4fa-0ea1-4f44-8dff-0a01b0f2d94c None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:37.871280 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743a4fa-0ea1-4f44-8dff-0a01b0f2d94c None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:37.871558 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743a4fa-0ea1-4f44-8dff-0a01b0f2d94c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:37.872501 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2743a4fa-0ea1-4f44-8dff-0a01b0f2d94c None admin] RBAC: Adding query filter params (role.id=9a5640186d0940658e691be68ccf9205, scope.project.id=513e6592cd83457b8ff461b0e5e1fd40, user.id=ccfba74826234915bc989fede9bde3e8) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:37.872905 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2743a4fa-0ea1-4f44-8dff-0a01b0f2d94c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:37.874804 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2743a4fa-0ea1-4f44-8dff-0a01b0f2d94c None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:37.881406 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 352/686] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 10 03:00:37 2022] GET /identity/v3/role_assignments?user.id=ccfba74826234915bc989fede9bde3e8&scope.project.id=513e6592cd83457b8ff461b0e5e1fd40&role.id=9a5640186d0940658e691be68ccf9205 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:37.882168 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743a4fa-0ea1-4f44-8dff-0a01b0f2d94c None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:37.968762 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb0d594-7ff5-4cfa-add6-aad8191513b1 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:38.002414 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743a4fa-0ea1-4f44-8dff-0a01b0f2d94c None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:38.004329 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73730453-2b34-4789-b0cd-5ae21b959203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:38.006669 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73730453-2b34-4789-b0cd-5ae21b959203 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:38.006669 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73730453-2b34-4789-b0cd-5ae21b959203 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:38.006898 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73730453-2b34-4789-b0cd-5ae21b959203 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:38.024234 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73730453-2b34-4789-b0cd-5ae21b959203 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:38.032490 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-73730453-2b34-4789-b0cd-5ae21b959203 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:00:38.032490 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:38.032490 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:38.032490 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:38.032490 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:38.032490 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:38.032490 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:38.032490 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:38.032490 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:38.032490 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:38.032490 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:38.032490 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:38.032490 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:38.032490 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:38.032490 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:38.032490 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:38.034294 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:38.034294 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:38.034294 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:38.034294 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:38.034294 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:38.034294 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:38.034294 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:38.034294 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:38.034294 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:38.034294 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:38.034294 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:38.034294 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:38.034294 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:38.034294 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:38.034294 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:38.034294 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:38.035917 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:38.035917 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:38.035917 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:38.035917 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:38.035917 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:38.035917 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:38.035917 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:38.035917 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:38.035917 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:38.035917 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:38.035917 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:00:38.035917 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:38.035917 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 335/687] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 10 03:00:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:38.039997 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73730453-2b34-4789-b0cd-5ae21b959203 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:38.059734 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709027ea-38d9-4b22-b570-9fd1cba3922a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:38.062095 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709027ea-38d9-4b22-b570-9fd1cba3922a None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:38.062384 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709027ea-38d9-4b22-b570-9fd1cba3922a None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:38.062661 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709027ea-38d9-4b22-b570-9fd1cba3922a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:38.174275 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73730453-2b34-4789-b0cd-5ae21b959203 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:38.213715 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed9addd-7d82-4e84-b9cd-93d79448d0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:38.215227 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9addd-7d82-4e84-b9cd-93d79448d0a5 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:38.215732 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9addd-7d82-4e84-b9cd-93d79448d0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:38.217003 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9addd-7d82-4e84-b9cd-93d79448d0a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:38.217319 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709027ea-38d9-4b22-b570-9fd1cba3922a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:38.218257 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed9addd-7d82-4e84-b9cd-93d79448d0a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:38.218789 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709027ea-38d9-4b22-b570-9fd1cba3922a None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:38.218896 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed9addd-7d82-4e84-b9cd-93d79448d0a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:38.221259 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed9addd-7d82-4e84-b9cd-93d79448d0a5 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:38.230841 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 336/688] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 10 03:00:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:38.236315 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed9addd-7d82-4e84-b9cd-93d79448d0a5 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:38.343168 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 353/689] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 10 03:00:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 03:00:38.348850 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709027ea-38d9-4b22-b570-9fd1cba3922a None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:38.361342 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed9addd-7d82-4e84-b9cd-93d79448d0a5 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:38.397352 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e57caa-9d85-40bb-a19d-bb93285cf836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:38.398273 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e57caa-9d85-40bb-a19d-bb93285cf836 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:38.398616 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e57caa-9d85-40bb-a19d-bb93285cf836 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:38.398957 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e57caa-9d85-40bb-a19d-bb93285cf836 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:38.411672 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e57caa-9d85-40bb-a19d-bb93285cf836 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:38.413873 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e57caa-9d85-40bb-a19d-bb93285cf836 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:38.434342 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-f3e57caa-9d85-40bb-a19d-bb93285cf836 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:38.434342 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:38.434342 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:38.434342 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:38.434342 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:38.434342 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:38.434342 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:38.434342 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:38.434342 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:38.434342 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:38.434342 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:38.434342 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:38.434342 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:00:38.434342 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:00:38.434342 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:00:38.435667 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:00:38.435667 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:38.435667 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:38.435667 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:38.435667 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:38.435667 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:38.435667 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:38.435667 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:38.435667 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:38.435667 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:38.435667 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:38.435667 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:38.435667 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:38.435667 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:38.435667 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:38.435667 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:38.435667 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:38.436773 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:00:38.436773 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:00:38.436773 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:38.436773 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:38.437008 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 337/690] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:00:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:38.442285 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e57caa-9d85-40bb-a19d-bb93285cf836 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:38.519982 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709027ea-38d9-4b22-b570-9fd1cba3922a None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:38.558723 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e57caa-9d85-40bb-a19d-bb93285cf836 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:38.589633 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed04dbd-079b-455b-bd5f-e0ecd48d9e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:38.590432 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed04dbd-079b-455b-bd5f-e0ecd48d9e7c None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:38.590711 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed04dbd-079b-455b-bd5f-e0ecd48d9e7c None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:38.590997 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed04dbd-079b-455b-bd5f-e0ecd48d9e7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:38.596323 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c50016f-7ea2-4792-8d97-0c6671fea5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:38.597433 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50016f-7ea2-4792-8d97-0c6671fea5a3 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:38.597939 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50016f-7ea2-4792-8d97-0c6671fea5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:38.598541 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50016f-7ea2-4792-8d97-0c6671fea5a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:38.600171 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c50016f-7ea2-4792-8d97-0c6671fea5a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:38.600749 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c50016f-7ea2-4792-8d97-0c6671fea5a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:38.602352 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c50016f-7ea2-4792-8d97-0c6671fea5a3 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:38.614414 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed04dbd-079b-455b-bd5f-e0ecd48d9e7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:38.615634 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 338/691] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:00:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:38.620050 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed04dbd-079b-455b-bd5f-e0ecd48d9e7c None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:38.621198 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c50016f-7ea2-4792-8d97-0c6671fea5a3 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:38.645756 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-fed04dbd-079b-455b-bd5f-e0ecd48d9e7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:38.645756 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:38.645756 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:38.645756 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:38.645756 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:38.645756 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:38.645756 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:38.645756 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:38.645756 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:38.645756 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:38.645756 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:38.645756 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:38.645756 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:00:38.645756 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:00:38.645756 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:00:38.647285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:00:38.647285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:38.647285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:38.647285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:38.647285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:38.647285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:38.647285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:38.647285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:38.647285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:38.647285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:38.647285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:38.647285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:38.647285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:38.647285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:38.647285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:38.647285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:38.647285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:38.648256 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:00:38.648256 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:00:38.648256 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:38.648256 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:38.648256 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 354/692] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:00:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:38.656944 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed04dbd-079b-455b-bd5f-e0ecd48d9e7c None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:38.729419 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c50016f-7ea2-4792-8d97-0c6671fea5a3 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:38.764337 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4aef3-c001-4e3a-a14d-4f49a5502488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:38.765282 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4aef3-c001-4e3a-a14d-4f49a5502488 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:38.765644 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4aef3-c001-4e3a-a14d-4f49a5502488 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:38.765995 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4aef3-c001-4e3a-a14d-4f49a5502488 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:38.774938 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b4aef3-c001-4e3a-a14d-4f49a5502488 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:38.776626 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b4aef3-c001-4e3a-a14d-4f49a5502488 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:38.798888 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-14b4aef3-c001-4e3a-a14d-4f49a5502488 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 03:00:38.798888 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:38.798888 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:38.798888 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:38.798888 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:38.798888 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:38.798888 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:38.798888 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:38.798888 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:38.798888 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:38.798888 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:38.798888 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:38.798888 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:00:38.798888 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:00:38.798888 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:00:38.798888 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:00:38.799894 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:38.799894 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:38.799894 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:00:38.799894 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:00:38.799894 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:00:38.799894 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:00:38.799894 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:38.799894 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:38.799894 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:38.799894 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:38.799894 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:38.799894 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:38.799894 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:38.799894 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:38.799894 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:38.799894 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:38.799894 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:38.799894 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:38.800892 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:38.800892 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:38.800892 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:00:38.800892 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:00:38.800892 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:00:38.800892 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:00:38.800892 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:00:38.800892 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:00:38.800892 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 03:00:38.800892 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:38.805586 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 339/693] 10.222.0.65 () {56 vars in 1093 bytes} [Tue May 10 03:00:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:38.813464 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4aef3-c001-4e3a-a14d-4f49a5502488 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:38.834786 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed04dbd-079b-455b-bd5f-e0ecd48d9e7c None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:38.929660 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a6269-34ec-4e40-8934-e31426105a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:38.930236 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4aef3-c001-4e3a-a14d-4f49a5502488 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:38.930359 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a6269-34ec-4e40-8934-e31426105a17 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:38.930601 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a6269-34ec-4e40-8934-e31426105a17 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:38.930877 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a6269-34ec-4e40-8934-e31426105a17 None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:38.931613 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79a6269-34ec-4e40-8934-e31426105a17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:38.931920 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79a6269-34ec-4e40-8934-e31426105a17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:38.933312 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79a6269-34ec-4e40-8934-e31426105a17 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:38.969914 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c5cf25-dc43-4338-bba5-16bda2165e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:38.970298 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 355/694] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:00:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:38.971096 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c5cf25-dc43-4338-bba5-16bda2165e0e None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:38.971590 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c5cf25-dc43-4338-bba5-16bda2165e0e None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:38.972045 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c5cf25-dc43-4338-bba5-16bda2165e0e None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:38.973034 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c5cf25-dc43-4338-bba5-16bda2165e0e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:38.973507 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c5cf25-dc43-4338-bba5-16bda2165e0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:38.975457 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c5cf25-dc43-4338-bba5-16bda2165e0e None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:38.994724 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a6269-34ec-4e40-8934-e31426105a17 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:38.997251 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 340/695] 10.222.0.65 () {56 vars in 1133 bytes} [Tue May 10 03:00:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:39.005140 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c5cf25-dc43-4338-bba5-16bda2165e0e None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:39.162277 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a6269-34ec-4e40-8934-e31426105a17 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:39.176864 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c5cf25-dc43-4338-bba5-16bda2165e0e None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:39.224078 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c422bd2b-5d72-448e-8416-dd9f78eafc4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:39.224767 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c422bd2b-5d72-448e-8416-dd9f78eafc4b None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:39.225055 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c422bd2b-5d72-448e-8416-dd9f78eafc4b None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:39.225349 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c422bd2b-5d72-448e-8416-dd9f78eafc4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:39.241255 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab6f0ea-7d45-48d2-a527-c7e59209d5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:39.242100 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6f0ea-7d45-48d2-a527-c7e59209d5a3 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:39.242349 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6f0ea-7d45-48d2-a527-c7e59209d5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:39.242614 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6f0ea-7d45-48d2-a527-c7e59209d5a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:39.261274 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab6f0ea-7d45-48d2-a527-c7e59209d5a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:39.262651 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab6f0ea-7d45-48d2-a527-c7e59209d5a3 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:39.287829 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-5ab6f0ea-7d45-48d2-a527-c7e59209d5a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:00:39.287829 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:39.287829 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:39.287829 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:39.287829 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:39.287829 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:39.287829 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:39.287829 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:39.287829 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:39.287829 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:39.287829 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:39.287829 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:39.287829 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:00:39.287829 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:00:39.287829 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:00:39.288820 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:00:39.288820 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:39.288820 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:39.288820 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:39.288820 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:39.288820 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:39.288820 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:39.288820 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:39.288820 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:39.288820 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:39.288820 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:39.288820 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:39.288820 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:39.288820 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:39.288820 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:39.288820 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:39.288820 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:39.289699 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:00:39.289699 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:00:39.289699 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:00:39.289699 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:00:39.289699 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:00:39.289699 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:00:39.289699 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:00:39.289699 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:39.290680 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 356/696] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 10 03:00:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:39.298144 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab6f0ea-7d45-48d2-a527-c7e59209d5a3 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:39.323097 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c422bd2b-5d72-448e-8416-dd9f78eafc4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:39.324609 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c422bd2b-5d72-448e-8416-dd9f78eafc4b None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:39.447404 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab6f0ea-7d45-48d2-a527-c7e59209d5a3 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:39.454725 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 341/697] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 10 03:00:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 03:00:39.465507 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ca407-ec5a-4912-8767-50a3b2d6ebb4 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:39.465507 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ca407-ec5a-4912-8767-50a3b2d6ebb4 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:39.465507 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ca407-ec5a-4912-8767-50a3b2d6ebb4 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:39.465507 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 342/698] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:00:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:39.465507 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b51df-17de-45d2-9f10-1c5dd687fd99 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:39.465507 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b51df-17de-45d2-9f10-1c5dd687fd99 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:39.466015 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b51df-17de-45d2-9f10-1c5dd687fd99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:39.481115 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-b31b51df-17de-45d2-9f10-1c5dd687fd99 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:39.481452 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ce84e-af7a-4cd9-ab56-09fa95c5026e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:39.482119 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ce84e-af7a-4cd9-ab56-09fa95c5026e None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:39.482401 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ce84e-af7a-4cd9-ab56-09fa95c5026e None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:39.482678 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ce84e-af7a-4cd9-ab56-09fa95c5026e None admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:39.482809 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-b31b51df-17de-45d2-9f10-1c5dd687fd99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:39.483480 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835ce84e-af7a-4cd9-ab56-09fa95c5026e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:39.483787 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835ce84e-af7a-4cd9-ab56-09fa95c5026e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:39.485255 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835ce84e-af7a-4cd9-ab56-09fa95c5026e None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:39.497687 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 357/699] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 10 03:00:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:39.498502 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ce84e-af7a-4cd9-ab56-09fa95c5026e None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:39.568742 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 343/700] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:00:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:39.569565 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31b51df-17de-45d2-9f10-1c5dd687fd99 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:39.622617 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ce84e-af7a-4cd9-ab56-09fa95c5026e None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:39.657720 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd9383b-31fe-4827-a76e-868d6d3d8484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:39.658522 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9383b-31fe-4827-a76e-868d6d3d8484 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:39.658803 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9383b-31fe-4827-a76e-868d6d3d8484 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:39.659077 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9383b-31fe-4827-a76e-868d6d3d8484 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:39.672357 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd9383b-31fe-4827-a76e-868d6d3d8484 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:39.674155 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd9383b-31fe-4827-a76e-868d6d3d8484 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:39.697164 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-8cd9383b-31fe-4827-a76e-868d6d3d8484 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:39.697164 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:39.697164 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:39.697164 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:39.697164 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:39.697164 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:39.697164 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:39.697164 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:39.697164 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:39.697164 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:39.697164 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:39.697164 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:39.697164 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:00:39.697164 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:00:39.697164 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:00:39.698567 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:00:39.698567 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:39.698567 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:39.698567 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:39.698567 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:39.698567 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:39.698567 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:39.698567 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:39.698567 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:39.698567 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:39.698567 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:39.698567 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:39.698567 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:39.698567 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:39.698567 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:39.698567 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:39.698567 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:39.700255 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:00:39.700255 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:00:39.700255 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:39.700255 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:39.700255 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 358/701] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:00:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:39.700255 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd9383b-31fe-4827-a76e-868d6d3d8484 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:39.703621 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31b51df-17de-45d2-9f10-1c5dd687fd99 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:39.748709 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21490075-26a8-41b8-af21-ee7845f84650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:39.749627 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21490075-26a8-41b8-af21-ee7845f84650 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:39.750064 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21490075-26a8-41b8-af21-ee7845f84650 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:39.750515 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21490075-26a8-41b8-af21-ee7845f84650 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:39.751505 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21490075-26a8-41b8-af21-ee7845f84650 None admin] RBAC: Adding query filter params (role.id=9a5640186d0940658e691be68ccf9205, scope.project.id=513e6592cd83457b8ff461b0e5e1fd40, user.id=f1cb8ad43a234233ad602f451f0f8ebf) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:39.751961 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21490075-26a8-41b8-af21-ee7845f84650 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:39.753562 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21490075-26a8-41b8-af21-ee7845f84650 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:39.760613 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 344/702] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 10 03:00:39 2022] GET /identity/v3/role_assignments?user.id=f1cb8ad43a234233ad602f451f0f8ebf&scope.project.id=513e6592cd83457b8ff461b0e5e1fd40&role.id=9a5640186d0940658e691be68ccf9205 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:39.761754 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21490075-26a8-41b8-af21-ee7845f84650 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:39.821418 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd9383b-31fe-4827-a76e-868d6d3d8484 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:39.857190 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865366d6-f765-4139-abbb-8a3133ba055b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:39.858006 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865366d6-f765-4139-abbb-8a3133ba055b None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:39.858289 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865366d6-f765-4139-abbb-8a3133ba055b None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:39.858559 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865366d6-f765-4139-abbb-8a3133ba055b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:39.859219 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865366d6-f765-4139-abbb-8a3133ba055b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:39.860700 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865366d6-f765-4139-abbb-8a3133ba055b None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:39.873632 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21490075-26a8-41b8-af21-ee7845f84650 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:39.875558 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-865366d6-f765-4139-abbb-8a3133ba055b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 03:00:39.875558 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:39.875558 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 03:00:39.875558 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 03:00:39.875558 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 03:00:39.875558 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 03:00:39.875558 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 03:00:39.875558 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:00:39.875558 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 03:00:39.875558 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:39.875558 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 03:00:39.875558 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:39.875558 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:39.875558 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:39.875558 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:39.875558 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:39.876542 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:39.876542 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:39.876542 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:39.876542 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:39.876542 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:39.876542 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:39.876542 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:39.876542 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 03:00:39.876542 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 03:00:39.876542 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 03:00:39.876542 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 03:00:39.876542 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:39.876542 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:39.876542 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:39.876542 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:39.876542 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:39.877378 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:39.877378 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:39.877378 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:39.877378 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:39.877378 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:39.877378 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:39.877378 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:39.877378 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:39.877378 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:39.877378 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:39.877378 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:39.877378 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 03:00:39.877378 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:00:39.877378 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 03:00:39.877378 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:39.881231 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 359/703] 10.222.0.65 () {56 vars in 1129 bytes} [Tue May 10 03:00:39 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:39.883817 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865366d6-f765-4139-abbb-8a3133ba055b None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:39.915922 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223c805-92c8-4516-9664-4a8df995edb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:39.916960 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223c805-92c8-4516-9664-4a8df995edb6 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:39.917456 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223c805-92c8-4516-9664-4a8df995edb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:39.917911 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223c805-92c8-4516-9664-4a8df995edb6 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:39.918843 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8223c805-92c8-4516-9664-4a8df995edb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:39.919344 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8223c805-92c8-4516-9664-4a8df995edb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:39.920976 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8223c805-92c8-4516-9664-4a8df995edb6 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:39.934021 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 345/704] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:00:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:39.939838 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223c805-92c8-4516-9664-4a8df995edb6 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:39.993437 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865366d6-f765-4139-abbb-8a3133ba055b None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:40.030666 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f680321-b20f-462c-a06d-ffdc7e2d84a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:40.031443 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f680321-b20f-462c-a06d-ffdc7e2d84a8 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:40.031801 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f680321-b20f-462c-a06d-ffdc7e2d84a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:40.031910 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f680321-b20f-462c-a06d-ffdc7e2d84a8 None admin] PATH_INFO: `/v3/services` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:40.036031 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f680321-b20f-462c-a06d-ffdc7e2d84a8 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:40.036031 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f680321-b20f-462c-a06d-ffdc7e2d84a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:40.036031 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f680321-b20f-462c-a06d-ffdc7e2d84a8 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:40.046359 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 360/705] 10.222.0.65 () {56 vars in 1124 bytes} [Tue May 10 03:00:39 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:40.053543 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f680321-b20f-462c-a06d-ffdc7e2d84a8 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:40.069779 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223c805-92c8-4516-9664-4a8df995edb6 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:40.112394 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d950a7-b697-40de-aced-45a861a24d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:40.113118 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d950a7-b697-40de-aced-45a861a24d49 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:40.113401 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d950a7-b697-40de-aced-45a861a24d49 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:40.113677 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d950a7-b697-40de-aced-45a861a24d49 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:40.121098 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d950a7-b697-40de-aced-45a861a24d49 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:40.122547 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d950a7-b697-40de-aced-45a861a24d49 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:40.137944 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-18d950a7-b697-40de-aced-45a861a24d49 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:00:40.137944 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:40.137944 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:40.137944 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:40.137944 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:40.137944 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:40.137944 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:40.137944 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:40.137944 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:40.137944 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:40.137944 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:40.137944 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:40.137944 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:00:40.137944 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:00:40.137944 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:00:40.138852 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:00:40.138852 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:40.138852 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:40.138852 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:40.138852 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:40.138852 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:40.138852 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:40.138852 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:40.138852 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:40.138852 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:40.138852 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:40.138852 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:40.138852 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:40.138852 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:40.138852 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:40.138852 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:40.138852 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:40.139728 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:00:40.139728 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:00:40.139728 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:00:40.139728 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:00:40.139728 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:00:40.139728 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:00:40.139728 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:00:40.139728 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:40.139728 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 346/706] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 10 03:00:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:40.140715 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9968951e-3ab7-421f-919e-9e99033262cc None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:40.140813 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9968951e-3ab7-421f-919e-9e99033262cc None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:40.141097 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9968951e-3ab7-421f-919e-9e99033262cc None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:40.142350 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 347/707] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:00:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:40.144592 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9968951e-3ab7-421f-919e-9e99033262cc None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:40.179016 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f680321-b20f-462c-a06d-ffdc7e2d84a8 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:40.214853 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e918c073-0ec3-4f46-aa35-ab98aa259fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:40.215363 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e918c073-0ec3-4f46-aa35-ab98aa259fee None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:40.215643 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e918c073-0ec3-4f46-aa35-ab98aa259fee None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:40.215913 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e918c073-0ec3-4f46-aa35-ab98aa259fee None admin] PATH_INFO: `/v3/services` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:40.216694 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e918c073-0ec3-4f46-aa35-ab98aa259fee None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:40.217437 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e918c073-0ec3-4f46-aa35-ab98aa259fee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:40.219012 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e918c073-0ec3-4f46-aa35-ab98aa259fee None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:40.224609 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 361/708] 10.222.0.65 () {56 vars in 1124 bytes} [Tue May 10 03:00:40 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:40.225865 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad94f8f-a647-4d85-8dba-f713b91e2600 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:40.226151 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad94f8f-a647-4d85-8dba-f713b91e2600 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:40.226425 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad94f8f-a647-4d85-8dba-f713b91e2600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:40.243839 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-5ad94f8f-a647-4d85-8dba-f713b91e2600 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:40.245055 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-5ad94f8f-a647-4d85-8dba-f713b91e2600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:40.269922 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9968951e-3ab7-421f-919e-9e99033262cc None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:40.315068 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 362/709] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:00:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:40.349737 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe7563-d00a-49b8-8c5a-486fa1a2a056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:40.350428 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe7563-d00a-49b8-8c5a-486fa1a2a056 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:40.350713 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe7563-d00a-49b8-8c5a-486fa1a2a056 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:40.350988 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe7563-d00a-49b8-8c5a-486fa1a2a056 None admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:40.351794 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afe7563-d00a-49b8-8c5a-486fa1a2a056 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:40.352193 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afe7563-d00a-49b8-8c5a-486fa1a2a056 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:40.353688 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afe7563-d00a-49b8-8c5a-486fa1a2a056 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:40.358080 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad94f8f-a647-4d85-8dba-f713b91e2600 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:40.369167 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 348/710] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 10 03:00:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:40.374798 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe7563-d00a-49b8-8c5a-486fa1a2a056 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:40.533810 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe7563-d00a-49b8-8c5a-486fa1a2a056 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:40.534475 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad94f8f-a647-4d85-8dba-f713b91e2600 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:40.592958 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f38553a-5231-4d26-b75a-821266cff00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:40.593750 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38553a-5231-4d26-b75a-821266cff00d None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:40.594551 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7501f228-f97d-4193-a591-0e6eb22e9798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:40.595242 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7501f228-f97d-4193-a591-0e6eb22e9798 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:40.595520 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7501f228-f97d-4193-a591-0e6eb22e9798 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:40.595788 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7501f228-f97d-4193-a591-0e6eb22e9798 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:40.596650 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7501f228-f97d-4193-a591-0e6eb22e9798 None admin] RBAC: Adding query filter params (role.id=43105000610f402ca2486e7648018cca, scope.project.id=513e6592cd83457b8ff461b0e5e1fd40, user.id=9b7ccdccba0b4f9e86817946f22dbe28) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:40.596956 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7501f228-f97d-4193-a591-0e6eb22e9798 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:40.598536 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38553a-5231-4d26-b75a-821266cff00d None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:40.598812 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38553a-5231-4d26-b75a-821266cff00d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:40.600041 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7501f228-f97d-4193-a591-0e6eb22e9798 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:40.611972 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 349/711] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 10 03:00:40 2022] GET /identity/v3/role_assignments?user.id=9b7ccdccba0b4f9e86817946f22dbe28&scope.project.id=513e6592cd83457b8ff461b0e5e1fd40&role.id=43105000610f402ca2486e7648018cca => generated 259 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:40.616043 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f38553a-5231-4d26-b75a-821266cff00d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:40.617554 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f38553a-5231-4d26-b75a-821266cff00d None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:40.636348 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-7f38553a-5231-4d26-b75a-821266cff00d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:40.636348 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:40.636348 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:40.636348 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:40.636348 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:40.636348 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:40.636348 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:40.636348 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:40.636348 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:40.636348 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:40.636348 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:40.636348 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:40.636348 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:00:40.636348 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:00:40.636348 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:00:40.637340 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:00:40.637340 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:40.637340 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:40.637340 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:40.637340 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:40.637340 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:40.637340 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:40.637340 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:40.637340 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:40.637340 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:40.637340 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:40.637340 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:40.637340 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:40.637340 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:40.637340 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:40.637340 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:40.637340 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:40.638230 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:00:40.638230 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:00:40.638230 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:40.638230 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:40.638230 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 363/712] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:00:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:00:40.645186 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7501f228-f97d-4193-a591-0e6eb22e9798 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:40.775308 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7501f228-f97d-4193-a591-0e6eb22e9798 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:40.812611 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca89f62-d8b7-4c3d-aab9-a0e96e657e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:40.813385 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca89f62-d8b7-4c3d-aab9-a0e96e657e6f None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:40.813668 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca89f62-d8b7-4c3d-aab9-a0e96e657e6f None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:40.813948 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca89f62-d8b7-4c3d-aab9-a0e96e657e6f None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:40.814670 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca89f62-d8b7-4c3d-aab9-a0e96e657e6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:40.814969 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca89f62-d8b7-4c3d-aab9-a0e96e657e6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:40.816357 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca89f62-d8b7-4c3d-aab9-a0e96e657e6f None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:40.828540 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 350/713] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:00:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:40.837087 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f38553a-5231-4d26-b75a-821266cff00d None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:40.958230 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f38553a-5231-4d26-b75a-821266cff00d None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:41.008841 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffaf90a-9564-4ee1-bead-980c6d1c00c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:41.009528 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffaf90a-9564-4ee1-bead-980c6d1c00c6 None admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:41.009812 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffaf90a-9564-4ee1-bead-980c6d1c00c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:41.010087 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffaf90a-9564-4ee1-bead-980c6d1c00c6 None admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:41.010801 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffaf90a-9564-4ee1-bead-980c6d1c00c6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:41.012247 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffaf90a-9564-4ee1-bead-980c6d1c00c6 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:41.063068 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5b3d9-292d-45d9-8f88-d421c0773dce None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:41.063068 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5b3d9-292d-45d9-8f88-d421c0773dce None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:41.063068 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5b3d9-292d-45d9-8f88-d421c0773dce None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:41.063968 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 351/714] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:00:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:00:41.069027 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d5884-fdc2-4c1d-8d65-793648482ddd None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:41.069557 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d5884-fdc2-4c1d-8d65-793648482ddd None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:41.070043 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d5884-fdc2-4c1d-8d65-793648482ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:41.088284 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-343d5884-fdc2-4c1d-8d65-793648482ddd None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:41.089824 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-343d5884-fdc2-4c1d-8d65-793648482ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:41.108495 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 364/715] 10.222.0.65 () {60 vars in 1132 bytes} [Tue May 10 03:00:40 2022] POST /identity/v3/users => generated 254 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:00:41.182443 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 352/716] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:00:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:41.217550 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffaf90a-9564-4ee1-bead-980c6d1c00c6 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:41.358000 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffaf90a-9564-4ee1-bead-980c6d1c00c6 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:41.412869 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6130fbbb-ae0e-49a7-9b9d-b270ab27f107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:41.413677 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6130fbbb-ae0e-49a7-9b9d-b270ab27f107 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:41.413958 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6130fbbb-ae0e-49a7-9b9d-b270ab27f107 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:41.414235 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6130fbbb-ae0e-49a7-9b9d-b270ab27f107 None admin] PATH_INFO: `/v3/services/network` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:41.414899 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6130fbbb-ae0e-49a7-9b9d-b270ab27f107 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:41.416288 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6130fbbb-ae0e-49a7-9b9d-b270ab27f107 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:41.428283 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-6130fbbb-ae0e-49a7-9b9d-b270ab27f107 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 10 03:00:41.428283 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:41.428283 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 03:00:41.428283 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 03:00:41.428283 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 03:00:41.428283 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 03:00:41.428283 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 03:00:41.428283 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:00:41.428283 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 03:00:41.428283 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:41.428283 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 03:00:41.428283 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:41.428283 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:41.428283 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:41.428283 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:41.428283 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:41.428283 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:41.429364 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:41.429364 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:41.429364 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:41.429364 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:41.429364 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:41.429364 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:41.429364 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 03:00:41.429364 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 03:00:41.429364 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 03:00:41.429364 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 03:00:41.429364 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:41.429364 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:41.429364 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:41.429364 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:41.429364 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:41.429364 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:41.430239 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:41.430239 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:41.430239 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:41.430239 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:41.430239 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:41.430239 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:41.430239 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:41.430239 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:41.430239 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:41.430239 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:41.430239 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 03:00:41.430239 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:00:41.430239 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 03:00:41.430239 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:41.430239 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 365/717] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 10 03:00:41 2022] GET /identity/v3/services/network => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:41.437588 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d5884-fdc2-4c1d-8d65-793648482ddd None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:41.553982 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d5884-fdc2-4c1d-8d65-793648482ddd None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:41.589833 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8459a8c6-dcbf-42c9-9787-a3214d2da6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:41.590894 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459a8c6-dcbf-42c9-9787-a3214d2da6cf None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:41.591409 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459a8c6-dcbf-42c9-9787-a3214d2da6cf None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:41.591887 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459a8c6-dcbf-42c9-9787-a3214d2da6cf None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:41.592866 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8459a8c6-dcbf-42c9-9787-a3214d2da6cf None admin] RBAC: Adding query filter params (name=network) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:41.593408 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8459a8c6-dcbf-42c9-9787-a3214d2da6cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:41.595053 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8459a8c6-dcbf-42c9-9787-a3214d2da6cf None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:41.600955 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 353/718] 10.222.0.65 () {56 vars in 1112 bytes} [Tue May 10 03:00:41 2022] GET /identity/v3/services?name=network => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:41.606063 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6130fbbb-ae0e-49a7-9b9d-b270ab27f107 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:41.715402 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6130fbbb-ae0e-49a7-9b9d-b270ab27f107 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:41.753496 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d1740-11e3-4c84-93d5-58f44133440b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:41.754171 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d1740-11e3-4c84-93d5-58f44133440b None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:41.754458 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d1740-11e3-4c84-93d5-58f44133440b None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:41.754732 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d1740-11e3-4c84-93d5-58f44133440b None admin] PATH_INFO: `/v3/services` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:41.755448 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190d1740-11e3-4c84-93d5-58f44133440b None admin] RBAC: Adding query filter params (type=network) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:41.756381 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190d1740-11e3-4c84-93d5-58f44133440b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:41.757748 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190d1740-11e3-4c84-93d5-58f44133440b None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:41.762644 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 366/719] 10.222.0.65 () {56 vars in 1112 bytes} [Tue May 10 03:00:41 2022] GET /identity/v3/services?type=network => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:42.691490 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf9a74-cb10-49f7-8ad2-50a01f011d25 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:42.692571 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf9a74-cb10-49f7-8ad2-50a01f011d25 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:42.693104 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf9a74-cb10-49f7-8ad2-50a01f011d25 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:42.694704 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 354/720] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:00:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:42.700334 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20489cb9-cd5f-4f4b-86ee-3c3897e59086 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:42.701219 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20489cb9-cd5f-4f4b-86ee-3c3897e59086 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:42.701702 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20489cb9-cd5f-4f4b-86ee-3c3897e59086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:42.722874 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-20489cb9-cd5f-4f4b-86ee-3c3897e59086 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:42.725114 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-20489cb9-cd5f-4f4b-86ee-3c3897e59086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:42.806116 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 367/721] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:00:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:42.840661 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdf9a74-cb10-49f7-8ad2-50a01f011d25 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:42.860297 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59944d9a-8f98-4877-a3e5-9f510bb912b4 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:42.860917 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59944d9a-8f98-4877-a3e5-9f510bb912b4 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:42.861397 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59944d9a-8f98-4877-a3e5-9f510bb912b4 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:42.863412 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 368/722] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:00:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:00:42.869409 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33ab23-58b3-4c6b-8817-e937595c11e7 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:42.869990 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33ab23-58b3-4c6b-8817-e937595c11e7 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:42.870470 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33ab23-58b3-4c6b-8817-e937595c11e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:42.887428 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-7e33ab23-58b3-4c6b-8817-e937595c11e7 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:42.889111 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-7e33ab23-58b3-4c6b-8817-e937595c11e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:42.979157 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 369/723] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:00:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 03:00:43.002015 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e33ab23-58b3-4c6b-8817-e937595c11e7 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:43.024518 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdf9a74-cb10-49f7-8ad2-50a01f011d25 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:43.094438 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2532b021-b971-4246-8c75-89dbaa17fb8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:43.095290 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532b021-b971-4246-8c75-89dbaa17fb8a None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:43.095579 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532b021-b971-4246-8c75-89dbaa17fb8a None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:43.095852 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532b021-b971-4246-8c75-89dbaa17fb8a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:43.111783 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2532b021-b971-4246-8c75-89dbaa17fb8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:43.119406 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-2532b021-b971-4246-8c75-89dbaa17fb8a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:00:43.119406 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:43.119406 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:43.119406 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:43.119406 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:43.119406 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:43.119406 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:43.119406 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:43.119406 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:43.119406 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:43.119406 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:43.119406 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:43.119406 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:43.119406 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:43.119406 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:43.119406 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:43.120396 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:43.120396 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:43.120396 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:43.120396 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:43.120396 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:43.120396 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:43.120396 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:43.120396 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:43.120396 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:43.120396 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:43.120396 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:43.120396 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:43.120396 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:43.120396 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:43.120396 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:43.120396 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:43.121247 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:43.121247 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:43.121247 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:43.121247 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:43.121247 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:43.121247 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:43.121247 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:43.121247 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:43.121247 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:43.121247 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:43.121247 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:00:43.121247 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:43.121247 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 355/724] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 10 03:00:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:43.126406 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2532b021-b971-4246-8c75-89dbaa17fb8a None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:43.175873 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e33ab23-58b3-4c6b-8817-e937595c11e7 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:43.225398 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df9e74-c983-4101-8c57-bfa9d021ae0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:43.226087 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df9e74-c983-4101-8c57-bfa9d021ae0d None admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:43.226370 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df9e74-c983-4101-8c57-bfa9d021ae0d None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:43.226643 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df9e74-c983-4101-8c57-bfa9d021ae0d None admin] PATH_INFO: `/v3/services` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:43.227378 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6df9e74-c983-4101-8c57-bfa9d021ae0d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:43.228789 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6df9e74-c983-4101-8c57-bfa9d021ae0d None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:43.240437 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2532b021-b971-4246-8c75-89dbaa17fb8a None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:43.275680 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e43bd5-07d4-4c92-ba70-05eed5362a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:43.276711 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e43bd5-07d4-4c92-ba70-05eed5362a0c None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:43.277205 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e43bd5-07d4-4c92-ba70-05eed5362a0c None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:43.277719 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e43bd5-07d4-4c92-ba70-05eed5362a0c None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:43.278680 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e43bd5-07d4-4c92-ba70-05eed5362a0c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:43.279188 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e43bd5-07d4-4c92-ba70-05eed5362a0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:43.280796 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e43bd5-07d4-4c92-ba70-05eed5362a0c None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:43.290511 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 356/725] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 10 03:00:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:43.295770 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e43bd5-07d4-4c92-ba70-05eed5362a0c None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:43.336496 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 370/726] 10.222.0.65 () {60 vars in 1141 bytes} [Tue May 10 03:00:43 2022] POST /identity/v3/services => generated 251 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:00:43.409366 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e43bd5-07d4-4c92-ba70-05eed5362a0c None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:43.441292 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77edb85-fdd7-4028-83c6-f2015d530150 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:43.441578 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77edb85-fdd7-4028-83c6-f2015d530150 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:43.441875 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77edb85-fdd7-4028-83c6-f2015d530150 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:43.444280 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 371/727] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:00:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:43.463122 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a31806-674e-4f50-930a-35b2b845ec32 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:43.463988 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a31806-674e-4f50-930a-35b2b845ec32 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:43.464619 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a31806-674e-4f50-930a-35b2b845ec32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:43.467110 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae68155-e6eb-4e10-b05c-05f4b27be3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:43.468382 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae68155-e6eb-4e10-b05c-05f4b27be3c9 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:43.468748 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae68155-e6eb-4e10-b05c-05f4b27be3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:43.469033 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae68155-e6eb-4e10-b05c-05f4b27be3c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:43.494104 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae68155-e6eb-4e10-b05c-05f4b27be3c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:43.496720 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae68155-e6eb-4e10-b05c-05f4b27be3c9 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:43.504996 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-78a31806-674e-4f50-930a-35b2b845ec32 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:43.511911 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-78a31806-674e-4f50-930a-35b2b845ec32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:43.531808 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-5ae68155-e6eb-4e10-b05c-05f4b27be3c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:43.531808 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:43.531808 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:43.531808 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:43.531808 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:43.531808 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:43.531808 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:43.531808 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:43.531808 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:43.531808 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:43.531808 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:43.531808 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:43.531808 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:00:43.531808 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:00:43.531808 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:00:43.533099 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:00:43.533099 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:43.533099 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:43.533099 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:43.533099 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:43.533099 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:43.533099 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:43.533099 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:43.533099 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:43.533099 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:43.533099 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:43.533099 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:43.533099 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:43.533099 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:43.533099 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:43.533099 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:43.533099 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:43.533973 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:00:43.533973 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:00:43.533973 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:43.533973 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:43.539435 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 357/728] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:00:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:43.545317 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae68155-e6eb-4e10-b05c-05f4b27be3c9 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:43.624492 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 372/729] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:00:43 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:43.648089 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a31806-674e-4f50-930a-35b2b845ec32 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:43.685891 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae68155-e6eb-4e10-b05c-05f4b27be3c9 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:43.723876 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e01020-2b3b-4454-bded-a4519937c45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:43.724778 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e01020-2b3b-4454-bded-a4519937c45a None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:43.725068 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e01020-2b3b-4454-bded-a4519937c45a None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:43.725400 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e01020-2b3b-4454-bded-a4519937c45a None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:43.726129 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e01020-2b3b-4454-bded-a4519937c45a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:43.726480 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e01020-2b3b-4454-bded-a4519937c45a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:43.727902 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e01020-2b3b-4454-bded-a4519937c45a None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:43.740605 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 358/730] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:00:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:43.746064 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e01020-2b3b-4454-bded-a4519937c45a None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:43.758841 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a31806-674e-4f50-930a-35b2b845ec32 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:43.813629 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b0d22f-570f-45f2-a702-5ddaf0c6a3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:43.814670 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b0d22f-570f-45f2-a702-5ddaf0c6a3ac None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:43.815103 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b0d22f-570f-45f2-a702-5ddaf0c6a3ac None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:43.815522 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b0d22f-570f-45f2-a702-5ddaf0c6a3ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:43.840938 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b0d22f-570f-45f2-a702-5ddaf0c6a3ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:43.848805 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-34b0d22f-570f-45f2-a702-5ddaf0c6a3ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:00:43.848805 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:43.848805 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:43.848805 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:43.848805 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:43.848805 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:43.848805 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:43.848805 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:43.848805 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:43.848805 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:43.848805 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:43.848805 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:43.848805 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:43.848805 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:43.848805 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:43.848805 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:43.849953 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:43.849953 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:43.849953 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:43.849953 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:43.849953 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:43.849953 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:43.849953 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:43.849953 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:43.849953 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:43.849953 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:43.849953 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:43.849953 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:43.849953 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:43.849953 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:43.849953 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:43.849953 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:43.850997 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:43.850997 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:43.850997 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:43.850997 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:43.850997 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:43.850997 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:43.850997 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:43.850997 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:43.850997 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:43.850997 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:43.850997 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:00:43.850997 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:43.858547 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e01020-2b3b-4454-bded-a4519937c45a None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:43.860111 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 373/731] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 10 03:00:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:00:43.867053 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b0d22f-570f-45f2-a702-5ddaf0c6a3ac None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:43.899948 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792bb6de-4914-408a-80bb-3edb64e2c333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:43.901017 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bb6de-4914-408a-80bb-3edb64e2c333 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:43.901376 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bb6de-4914-408a-80bb-3edb64e2c333 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:43.901726 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bb6de-4914-408a-80bb-3edb64e2c333 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:43.910327 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792bb6de-4914-408a-80bb-3edb64e2c333 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:43.912600 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792bb6de-4914-408a-80bb-3edb64e2c333 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:43.929560 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-792bb6de-4914-408a-80bb-3edb64e2c333 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 03:00:43.929560 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:43.929560 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:43.929560 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:43.929560 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:43.929560 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:43.929560 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:43.929560 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:43.929560 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:43.929560 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:43.929560 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:43.929560 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:43.929560 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:00:43.929560 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:00:43.929560 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:00:43.929560 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:00:43.930756 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:43.930756 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:43.930756 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:00:43.930756 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:00:43.930756 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:00:43.930756 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:00:43.930756 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:43.930756 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:43.930756 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:43.930756 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:43.930756 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:43.930756 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:43.930756 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:43.930756 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:43.930756 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:43.930756 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:43.930756 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:43.930756 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:43.931912 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:43.931912 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:43.931912 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:00:43.931912 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:00:43.931912 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:00:43.931912 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:00:43.931912 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:00:43.931912 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:00:43.931912 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 03:00:43.931912 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:43.936028 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 359/732] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 10 03:00:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:43.939369 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792bb6de-4914-408a-80bb-3edb64e2c333 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:44.038883 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b0d22f-570f-45f2-a702-5ddaf0c6a3ac None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:44.084391 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a9bcb-357c-470c-aa4d-d9582aff2271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:44.085454 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a9bcb-357c-470c-aa4d-d9582aff2271 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:44.085940 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a9bcb-357c-470c-aa4d-d9582aff2271 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:44.086439 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a9bcb-357c-470c-aa4d-d9582aff2271 None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:44.087395 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512a9bcb-357c-470c-aa4d-d9582aff2271 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:44.087901 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512a9bcb-357c-470c-aa4d-d9582aff2271 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:44.089492 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512a9bcb-357c-470c-aa4d-d9582aff2271 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:44.104527 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792bb6de-4914-408a-80bb-3edb64e2c333 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:44.108779 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 374/733] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 10 03:00:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:44.114176 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a9bcb-357c-470c-aa4d-d9582aff2271 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:44.153089 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80b65a-72b3-46e2-804c-87b4598b79c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:44.153782 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80b65a-72b3-46e2-804c-87b4598b79c6 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:44.154117 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80b65a-72b3-46e2-804c-87b4598b79c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:44.154396 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80b65a-72b3-46e2-804c-87b4598b79c6 None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:44.155245 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa80b65a-72b3-46e2-804c-87b4598b79c6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:44.155558 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa80b65a-72b3-46e2-804c-87b4598b79c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:44.157082 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa80b65a-72b3-46e2-804c-87b4598b79c6 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:44.180231 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 360/734] 10.222.0.65 () {56 vars in 1135 bytes} [Tue May 10 03:00:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:44.189077 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80b65a-72b3-46e2-804c-87b4598b79c6 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:44.282080 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a9bcb-357c-470c-aa4d-d9582aff2271 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:44.336482 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc5ebf6-a820-4bfd-abb9-038787c90a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:44.337370 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5ebf6-a820-4bfd-abb9-038787c90a73 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:44.337750 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5ebf6-a820-4bfd-abb9-038787c90a73 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:44.338128 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5ebf6-a820-4bfd-abb9-038787c90a73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:44.356773 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc5ebf6-a820-4bfd-abb9-038787c90a73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:44.359446 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc5ebf6-a820-4bfd-abb9-038787c90a73 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:44.364803 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80b65a-72b3-46e2-804c-87b4598b79c6 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:44.392141 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-4cc5ebf6-a820-4bfd-abb9-038787c90a73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:44.392141 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:44.392141 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:44.392141 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:44.392141 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:44.392141 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:44.392141 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:44.392141 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:44.392141 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:44.392141 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:44.392141 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:44.392141 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:44.392141 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:00:44.392141 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:00:44.392141 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:00:44.393159 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:00:44.393159 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:44.393159 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:44.393159 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:44.393159 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:44.393159 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:44.393159 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:44.393159 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:44.393159 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:44.393159 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:44.393159 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:44.393159 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:44.393159 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:44.393159 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:44.393159 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:44.393159 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:44.393159 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:44.394042 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:00:44.394042 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:00:44.394042 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:44.394042 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:44.397051 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 375/735] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:00:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:44.398766 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28e507-8fb4-4e2c-aca3-4430fd5d37fe None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:44.399260 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28e507-8fb4-4e2c-aca3-4430fd5d37fe None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:44.399745 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28e507-8fb4-4e2c-aca3-4430fd5d37fe None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:44.401728 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 376/736] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:00:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:44.402773 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28e507-8fb4-4e2c-aca3-4430fd5d37fe None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:44.418206 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44032211-d6d2-46d3-81d7-60f43db4a17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:44.418894 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44032211-d6d2-46d3-81d7-60f43db4a17a None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:44.419177 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44032211-d6d2-46d3-81d7-60f43db4a17a None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:44.419454 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44032211-d6d2-46d3-81d7-60f43db4a17a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:44.496476 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44032211-d6d2-46d3-81d7-60f43db4a17a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:44.498712 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44032211-d6d2-46d3-81d7-60f43db4a17a None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:44.519536 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28e507-8fb4-4e2c-aca3-4430fd5d37fe None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:44.559840 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dbba66-772f-40a6-9d52-1912a4659189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:44.560534 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dbba66-772f-40a6-9d52-1912a4659189 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:44.560815 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dbba66-772f-40a6-9d52-1912a4659189 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:44.561087 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dbba66-772f-40a6-9d52-1912a4659189 None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:44.561810 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dbba66-772f-40a6-9d52-1912a4659189 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:44.562113 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dbba66-772f-40a6-9d52-1912a4659189 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:44.563467 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dbba66-772f-40a6-9d52-1912a4659189 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:44.575252 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 377/737] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:00:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:44.576759 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c30c41-d7a5-4bc9-a3fd-4b19124f9bd9 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:44.577057 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c30c41-d7a5-4bc9-a3fd-4b19124f9bd9 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:44.577338 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c30c41-d7a5-4bc9-a3fd-4b19124f9bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:44.593649 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-f8c30c41-d7a5-4bc9-a3fd-4b19124f9bd9 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:44.594768 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-f8c30c41-d7a5-4bc9-a3fd-4b19124f9bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:44.620661 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 361/738] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 10 03:00:44 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 03:00:44.622046 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fbb56c-bf3c-4cc9-a23b-e669cae91381 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:44.622345 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fbb56c-bf3c-4cc9-a23b-e669cae91381 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:44.622625 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fbb56c-bf3c-4cc9-a23b-e669cae91381 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:44.627978 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 362/739] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:00:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:44.628782 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fbb56c-bf3c-4cc9-a23b-e669cae91381 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:44.665073 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 378/740] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:00:44 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:44.666281 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c30c41-d7a5-4bc9-a3fd-4b19124f9bd9 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:44.731231 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fbb56c-bf3c-4cc9-a23b-e669cae91381 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:44.765151 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f811a4e-48c4-48ec-ab3a-eb607d4c8168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:44.765944 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f811a4e-48c4-48ec-ab3a-eb607d4c8168 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:44.766229 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f811a4e-48c4-48ec-ab3a-eb607d4c8168 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:44.766505 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f811a4e-48c4-48ec-ab3a-eb607d4c8168 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:44.769508 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c30c41-d7a5-4bc9-a3fd-4b19124f9bd9 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:44.773613 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f811a4e-48c4-48ec-ab3a-eb607d4c8168 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:44.775586 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f811a4e-48c4-48ec-ab3a-eb607d4c8168 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:44.796589 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-0f811a4e-48c4-48ec-ab3a-eb607d4c8168 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 03:00:44.796589 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:44.796589 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:44.796589 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:44.796589 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:44.796589 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:44.796589 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:44.796589 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:44.796589 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:44.796589 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:44.796589 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:44.796589 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:44.796589 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:00:44.796589 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:00:44.796589 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:00:44.796589 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:00:44.797821 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:44.797821 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:44.797821 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:00:44.797821 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:00:44.797821 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:00:44.797821 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:00:44.797821 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:44.797821 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:44.797821 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:44.797821 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:44.797821 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:44.797821 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:44.797821 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:44.797821 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:44.797821 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:44.797821 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:44.797821 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:44.797821 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:44.798777 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:44.798777 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:44.798777 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:00:44.798777 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:00:44.798777 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:00:44.798777 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:00:44.798777 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:00:44.798777 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:00:44.798777 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 03:00:44.798777 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:44.798777 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 363/741] 10.222.0.65 () {56 vars in 1093 bytes} [Tue May 10 03:00:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:44.799381 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0fe81-fbff-4c5e-9ca9-616dbabdfb7e None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:44.799381 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0fe81-fbff-4c5e-9ca9-616dbabdfb7e None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:44.799962 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0fe81-fbff-4c5e-9ca9-616dbabdfb7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:44.813187 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478dda7e-c8da-4740-8892-dcf2f292374d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:44.814133 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478dda7e-c8da-4740-8892-dcf2f292374d None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:44.814579 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478dda7e-c8da-4740-8892-dcf2f292374d None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:44.814859 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478dda7e-c8da-4740-8892-dcf2f292374d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:44.816674 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-e2f0fe81-fbff-4c5e-9ca9-616dbabdfb7e None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:44.817885 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-e2f0fe81-fbff-4c5e-9ca9-616dbabdfb7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:44.826858 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478dda7e-c8da-4740-8892-dcf2f292374d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:44.828327 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478dda7e-c8da-4740-8892-dcf2f292374d None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:44.845610 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-478dda7e-c8da-4740-8892-dcf2f292374d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:44.845610 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:44.845610 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:44.845610 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:44.845610 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:44.845610 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:44.845610 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:44.845610 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:44.845610 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:44.845610 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:44.845610 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:44.845610 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:44.845610 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:00:44.845610 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:00:44.845610 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:00:44.846598 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:00:44.846598 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:44.846598 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:44.846598 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:44.846598 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:44.846598 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:44.846598 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:44.846598 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:44.846598 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:44.846598 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:44.846598 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:44.846598 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:44.846598 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:44.846598 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:44.846598 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:44.846598 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:44.846598 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:44.847549 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:00:44.847549 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:00:44.847549 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:44.847549 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:44.847549 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 379/742] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:00:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:44.848515 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478dda7e-c8da-4740-8892-dcf2f292374d None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:44.900028 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 364/743] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:00:44 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 03:00:44.900028 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f0fe81-fbff-4c5e-9ca9-616dbabdfb7e None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:44.952908 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478dda7e-c8da-4740-8892-dcf2f292374d None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:44.987692 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62d895a-7d48-4bea-86bc-ce372769f1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:44.988513 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d895a-7d48-4bea-86bc-ce372769f1cb None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:44.988802 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d895a-7d48-4bea-86bc-ce372769f1cb None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:44.997069 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d895a-7d48-4bea-86bc-ce372769f1cb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:44.999544 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62d895a-7d48-4bea-86bc-ce372769f1cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:45.004140 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f0fe81-fbff-4c5e-9ca9-616dbabdfb7e None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:45.007367 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-c62d895a-7d48-4bea-86bc-ce372769f1cb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 03:00:45.007367 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:45.007367 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:45.007367 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:45.007367 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:45.007367 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:45.007367 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:45.007367 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:45.007367 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:45.007367 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:45.007367 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:45.007367 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:45.007367 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:45.007367 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:45.007367 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:45.007367 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:45.008567 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:45.008567 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:45.008567 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:45.008567 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:45.008567 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:45.008567 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:45.008567 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:45.008567 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:45.008567 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:45.008567 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:45.008567 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:45.008567 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:45.008567 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:45.008567 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:45.008567 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:45.008567 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:45.014381 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:45.014381 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:45.014381 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:45.014381 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:45.014381 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:45.014381 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:45.014381 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:45.014381 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:45.014381 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:45.014381 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:45.014381 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 03:00:45.014381 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:45.014381 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 380/744] 10.222.0.65 () {56 vars in 1102 bytes} [Tue May 10 03:00:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:45.014381 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62d895a-7d48-4bea-86bc-ce372769f1cb None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:45.041083 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7cf8bc-9b43-41fe-8da2-e0f074c6b6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:45.041893 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7cf8bc-9b43-41fe-8da2-e0f074c6b6fc None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:45.042288 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7cf8bc-9b43-41fe-8da2-e0f074c6b6fc None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:45.042672 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7cf8bc-9b43-41fe-8da2-e0f074c6b6fc None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:45.043611 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7cf8bc-9b43-41fe-8da2-e0f074c6b6fc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:45.044025 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7cf8bc-9b43-41fe-8da2-e0f074c6b6fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:45.045561 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7cf8bc-9b43-41fe-8da2-e0f074c6b6fc None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:45.066990 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 365/745] 10.222.0.65 () {56 vars in 1133 bytes} [Tue May 10 03:00:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:45.066990 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7cf8bc-9b43-41fe-8da2-e0f074c6b6fc None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:45.112386 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62d895a-7d48-4bea-86bc-ce372769f1cb None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:45.150560 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e3324-5e96-401f-8b0d-81c9a53d7dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:45.152191 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e3324-5e96-401f-8b0d-81c9a53d7dca None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:45.152191 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e3324-5e96-401f-8b0d-81c9a53d7dca None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:45.152191 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e3324-5e96-401f-8b0d-81c9a53d7dca None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:45.152924 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73e3324-5e96-401f-8b0d-81c9a53d7dca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:45.153463 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73e3324-5e96-401f-8b0d-81c9a53d7dca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:45.155174 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73e3324-5e96-401f-8b0d-81c9a53d7dca None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:45.168644 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 381/746] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:00:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:45.169442 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e3324-5e96-401f-8b0d-81c9a53d7dca None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:45.180143 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7cf8bc-9b43-41fe-8da2-e0f074c6b6fc None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:45.213336 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b31b5-5753-43a5-8223-074d89a4888f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:45.214236 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b31b5-5753-43a5-8223-074d89a4888f None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:45.214522 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b31b5-5753-43a5-8223-074d89a4888f None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:45.214800 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b31b5-5753-43a5-8223-074d89a4888f None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:45.215521 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b31b5-5753-43a5-8223-074d89a4888f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:45.216942 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b31b5-5753-43a5-8223-074d89a4888f None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:45.265764 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e3324-5e96-401f-8b0d-81c9a53d7dca None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:45.304045 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 366/747] 10.222.0.65 () {60 vars in 1141 bytes} [Tue May 10 03:00:45 2022] POST /identity/v3/services => generated 240 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:00:45.304045 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b31b5-5753-43a5-8223-074d89a4888f None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:45.304699 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66e0ee2-6096-49f5-b74a-fba95e1df679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:45.305450 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e0ee2-6096-49f5-b74a-fba95e1df679 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:45.305730 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e0ee2-6096-49f5-b74a-fba95e1df679 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:45.306000 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e0ee2-6096-49f5-b74a-fba95e1df679 None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:45.307369 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66e0ee2-6096-49f5-b74a-fba95e1df679 None admin] RBAC: Adding query filter params (name=service) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:45.307693 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66e0ee2-6096-49f5-b74a-fba95e1df679 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:45.310217 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66e0ee2-6096-49f5-b74a-fba95e1df679 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:45.322325 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 382/748] 10.222.0.65 () {56 vars in 1103 bytes} [Tue May 10 03:00:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:45.323990 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66e0ee2-6096-49f5-b74a-fba95e1df679 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:45.426610 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b31b5-5753-43a5-8223-074d89a4888f None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:45.466217 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66e0ee2-6096-49f5-b74a-fba95e1df679 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:45.474897 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7c2ad1-5882-4080-9ab5-c609df7b58cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:45.476124 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c2ad1-5882-4080-9ab5-c609df7b58cc None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:45.476635 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c2ad1-5882-4080-9ab5-c609df7b58cc None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:45.477108 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c2ad1-5882-4080-9ab5-c609df7b58cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:45.488885 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7c2ad1-5882-4080-9ab5-c609df7b58cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:45.491240 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7c2ad1-5882-4080-9ab5-c609df7b58cc None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:45.507525 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6cdc80-dd57-4c6b-9c11-35f578fe2c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:45.508357 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6cdc80-dd57-4c6b-9c11-35f578fe2c6a None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:45.508636 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6cdc80-dd57-4c6b-9c11-35f578fe2c6a None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:45.508911 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6cdc80-dd57-4c6b-9c11-35f578fe2c6a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:45.509602 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-4c7c2ad1-5882-4080-9ab5-c609df7b58cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:45.509602 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:45.509602 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:45.509602 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:45.509602 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:45.509602 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:45.509602 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:45.509602 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:45.509602 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:45.509602 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:45.509602 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:45.509602 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:45.509602 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:00:45.509602 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:00:45.509602 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:00:45.510445 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:00:45.510445 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:45.510445 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:45.510445 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:45.510445 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:45.510445 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:45.510445 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:45.510445 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:45.510445 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:45.510445 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:45.510445 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:45.510445 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:45.510445 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:45.510445 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:45.510445 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:45.510445 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:45.510445 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:45.511314 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:00:45.511314 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:00:45.511314 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:45.511314 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:45.511314 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 367/749] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:00:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:45.511594 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7c2ad1-5882-4080-9ab5-c609df7b58cc None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:45.519006 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6cdc80-dd57-4c6b-9c11-35f578fe2c6a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:45.520554 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6cdc80-dd57-4c6b-9c11-35f578fe2c6a None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:45.537693 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-4f6cdc80-dd57-4c6b-9c11-35f578fe2c6a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:00:45.537693 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:45.537693 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:45.537693 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:45.537693 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:45.537693 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:45.537693 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:45.537693 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:45.537693 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:45.537693 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:45.537693 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:45.537693 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:45.537693 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:00:45.537693 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:00:45.537693 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:00:45.538608 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:00:45.538608 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:45.538608 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:45.538608 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:45.538608 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:45.538608 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:45.538608 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:45.538608 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:45.538608 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:45.538608 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:45.538608 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:45.538608 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:45.538608 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:45.538608 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:45.538608 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:45.538608 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:45.538608 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:45.539470 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:00:45.539470 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:00:45.539470 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:00:45.539470 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:00:45.539470 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:00:45.539470 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:00:45.539470 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:00:45.539470 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:45.539470 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 383/750] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 10 03:00:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:45.539945 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6cdc80-dd57-4c6b-9c11-35f578fe2c6a None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:45.636297 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7c2ad1-5882-4080-9ab5-c609df7b58cc None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:45.662332 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6cdc80-dd57-4c6b-9c11-35f578fe2c6a None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:45.671332 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b49425-469c-469b-a888-43f9e90c6191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:45.672361 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b49425-469c-469b-a888-43f9e90c6191 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:45.672800 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b49425-469c-469b-a888-43f9e90c6191 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:45.673211 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b49425-469c-469b-a888-43f9e90c6191 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:45.684224 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b49425-469c-469b-a888-43f9e90c6191 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:45.685837 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b49425-469c-469b-a888-43f9e90c6191 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:45.702104 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bead880a-96ac-444d-9eba-852abf788323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:45.702821 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead880a-96ac-444d-9eba-852abf788323 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:45.703111 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead880a-96ac-444d-9eba-852abf788323 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:45.703389 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead880a-96ac-444d-9eba-852abf788323 None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:45.704148 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bead880a-96ac-444d-9eba-852abf788323 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:45.704460 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bead880a-96ac-444d-9eba-852abf788323 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:45.704678 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-38b49425-469c-469b-a888-43f9e90c6191 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:45.704678 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:45.704678 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:45.704678 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:45.704678 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:45.704678 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:45.704678 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:45.704678 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:45.704678 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:45.704678 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:45.704678 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:45.704678 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:45.704678 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:00:45.704678 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:00:45.704678 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:00:45.705676 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:00:45.705676 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:45.705676 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:45.705676 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:45.705676 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:45.705676 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:45.705676 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:45.705676 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:45.705676 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:45.705676 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:45.705676 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:45.705676 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:45.705676 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:45.705676 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:45.705676 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:45.705676 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:45.705676 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:45.706741 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:00:45.706741 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:00:45.706741 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:45.706741 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:45.706960 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bead880a-96ac-444d-9eba-852abf788323 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:45.709215 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 368/751] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:00:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:45.710134 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b49425-469c-469b-a888-43f9e90c6191 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:45.727641 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 384/752] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:00:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:45.728760 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bead880a-96ac-444d-9eba-852abf788323 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:45.837653 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bead880a-96ac-444d-9eba-852abf788323 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:45.875952 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53867b7-8684-4ff7-8263-24e38bd1ee2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:45.876668 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53867b7-8684-4ff7-8263-24e38bd1ee2c None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:45.876953 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53867b7-8684-4ff7-8263-24e38bd1ee2c None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:45.877232 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53867b7-8684-4ff7-8263-24e38bd1ee2c None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:45.877984 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53867b7-8684-4ff7-8263-24e38bd1ee2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:45.878296 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53867b7-8684-4ff7-8263-24e38bd1ee2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:45.879693 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53867b7-8684-4ff7-8263-24e38bd1ee2c None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:45.893434 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 385/753] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:00:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:45.898958 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53867b7-8684-4ff7-8263-24e38bd1ee2c None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:45.945714 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b49425-469c-469b-a888-43f9e90c6191 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:45.979809 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff5674d-fa7f-4823-b16d-afbb15b17bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:45.980504 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff5674d-fa7f-4823-b16d-afbb15b17bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:45.980786 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff5674d-fa7f-4823-b16d-afbb15b17bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:45.981060 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff5674d-fa7f-4823-b16d-afbb15b17bf5 None admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:45.981848 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff5674d-fa7f-4823-b16d-afbb15b17bf5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:45.982156 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff5674d-fa7f-4823-b16d-afbb15b17bf5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:45.983672 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff5674d-fa7f-4823-b16d-afbb15b17bf5 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:46.000491 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 369/754] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 10 03:00:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:46.000491 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff5674d-fa7f-4823-b16d-afbb15b17bf5 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:46.000740 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53867b7-8684-4ff7-8263-24e38bd1ee2c None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:46.030901 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46b9ac0-8579-4b61-904d-7ca2956d6e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:46.031761 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b9ac0-8579-4b61-904d-7ca2956d6e04 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:46.032076 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b9ac0-8579-4b61-904d-7ca2956d6e04 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:46.032604 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b9ac0-8579-4b61-904d-7ca2956d6e04 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:46.039989 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46b9ac0-8579-4b61-904d-7ca2956d6e04 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:46.041456 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46b9ac0-8579-4b61-904d-7ca2956d6e04 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:46.055446 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-e46b9ac0-8579-4b61-904d-7ca2956d6e04 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:00:46.055446 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:46.055446 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:46.055446 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:46.055446 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:46.055446 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:46.055446 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:46.055446 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:46.055446 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:46.055446 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:46.055446 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:46.055446 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:46.055446 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:00:46.055446 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:00:46.055446 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:00:46.056413 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:00:46.056413 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:46.056413 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:46.056413 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:46.056413 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:46.056413 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:46.056413 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:46.056413 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:46.056413 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:46.056413 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:46.056413 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:46.056413 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:46.056413 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:46.056413 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:46.056413 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:46.056413 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:46.056413 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:46.057291 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:00:46.057291 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:00:46.057291 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:00:46.057291 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:00:46.057291 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:00:46.057291 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:00:46.057291 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:00:46.057291 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:46.057291 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 386/755] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 10 03:00:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:46.058218 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20aaf0-faf7-4cd3-9405-6741918bb016 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:46.058218 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20aaf0-faf7-4cd3-9405-6741918bb016 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:46.058371 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20aaf0-faf7-4cd3-9405-6741918bb016 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:46.063521 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 387/756] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:00:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:46.063521 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c20aaf0-faf7-4cd3-9405-6741918bb016 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:46.106400 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff5674d-fa7f-4823-b16d-afbb15b17bf5 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:46.138218 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149a4aa-1177-4082-bf9b-15d95305b3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:46.139038 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149a4aa-1177-4082-bf9b-15d95305b3e2 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:46.139316 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149a4aa-1177-4082-bf9b-15d95305b3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:46.139589 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149a4aa-1177-4082-bf9b-15d95305b3e2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:46.147426 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4149a4aa-1177-4082-bf9b-15d95305b3e2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:46.148883 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4149a4aa-1177-4082-bf9b-15d95305b3e2 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:46.162965 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c20aaf0-faf7-4cd3-9405-6741918bb016 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:46.163806 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-4149a4aa-1177-4082-bf9b-15d95305b3e2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 03:00:46.163806 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:46.163806 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:46.163806 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:46.163806 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:46.163806 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:46.163806 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:46.163806 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:46.163806 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:46.163806 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:46.163806 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:46.163806 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:46.163806 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:00:46.163806 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:00:46.163806 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:00:46.163806 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:00:46.164871 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:46.164871 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:46.164871 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:00:46.164871 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:00:46.164871 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:00:46.164871 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:00:46.164871 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:46.164871 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:46.164871 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:46.164871 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:46.164871 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:46.164871 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:46.164871 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:46.164871 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:46.164871 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:46.164871 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:46.164871 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:46.164871 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:46.165785 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:46.165785 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:46.165785 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:00:46.165785 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:00:46.165785 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:00:46.165785 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:00:46.165785 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:00:46.165785 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:00:46.165785 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 03:00:46.165785 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:46.165785 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 370/757] 10.222.0.65 () {56 vars in 1117 bytes} [Tue May 10 03:00:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:46.166385 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149a4aa-1177-4082-bf9b-15d95305b3e2 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:46.201479 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd86beb8-7b00-4613-915d-ac3fc5ed3d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:46.202059 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86beb8-7b00-4613-915d-ac3fc5ed3d1d None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:46.202341 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86beb8-7b00-4613-915d-ac3fc5ed3d1d None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:46.202615 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86beb8-7b00-4613-915d-ac3fc5ed3d1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:46.203450 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd86beb8-7b00-4613-915d-ac3fc5ed3d1d None admin] RBAC: Adding query filter params (role.id=43105000610f402ca2486e7648018cca, scope.project.id=513e6592cd83457b8ff461b0e5e1fd40, user.id=f1cb8ad43a234233ad602f451f0f8ebf) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:46.203763 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd86beb8-7b00-4613-915d-ac3fc5ed3d1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:46.205222 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd86beb8-7b00-4613-915d-ac3fc5ed3d1d None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:46.220044 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 388/758] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 10 03:00:46 2022] GET /identity/v3/role_assignments?user.id=f1cb8ad43a234233ad602f451f0f8ebf&scope.project.id=513e6592cd83457b8ff461b0e5e1fd40&role.id=43105000610f402ca2486e7648018cca => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:46.220044 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a4ef9-8cf3-4c3f-b844-058c0358235c None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:46.220044 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a4ef9-8cf3-4c3f-b844-058c0358235c None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:46.220044 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a4ef9-8cf3-4c3f-b844-058c0358235c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:46.237650 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-8f3a4ef9-8cf3-4c3f-b844-058c0358235c None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:46.238878 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-8f3a4ef9-8cf3-4c3f-b844-058c0358235c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:46.283171 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149a4aa-1177-4082-bf9b-15d95305b3e2 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:46.319894 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd050af8-8e6a-48e2-ba88-29f14d20a706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:46.320752 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd050af8-8e6a-48e2-ba88-29f14d20a706 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:46.321135 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd050af8-8e6a-48e2-ba88-29f14d20a706 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:46.321541 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd050af8-8e6a-48e2-ba88-29f14d20a706 None admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:46.322454 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd050af8-8e6a-48e2-ba88-29f14d20a706 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:46.322856 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd050af8-8e6a-48e2-ba88-29f14d20a706 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:46.324710 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd050af8-8e6a-48e2-ba88-29f14d20a706 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:46.325241 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 389/759] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:00:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:00:46.326175 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a4ef9-8cf3-4c3f-b844-058c0358235c None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:46.353015 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 371/760] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 10 03:00:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:46.359505 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd050af8-8e6a-48e2-ba88-29f14d20a706 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:46.474794 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a4ef9-8cf3-4c3f-b844-058c0358235c None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:46.477627 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd050af8-8e6a-48e2-ba88-29f14d20a706 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:46.514657 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f1656-4a4b-4c49-923c-737191e7ed1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:46.515722 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f1656-4a4b-4c49-923c-737191e7ed1f None admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:46.516130 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f1656-4a4b-4c49-923c-737191e7ed1f None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:46.516504 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f1656-4a4b-4c49-923c-737191e7ed1f None admin] PATH_INFO: `/v3/projects/513e6592cd83457b8ff461b0e5e1fd40/users/9b7ccdccba0b4f9e86817946f22dbe28/roles/43105000610f402ca2486e7648018cca` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:46.518616 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0f1656-4a4b-4c49-923c-737191e7ed1f None admin] RBAC: Authorizing `identity:create_grant(project_id=513e6592cd83457b8ff461b0e5e1fd40, user_id=9b7ccdccba0b4f9e86817946f22dbe28, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:46.520475 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0f1656-4a4b-4c49-923c-737191e7ed1f None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:46.523793 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4662ac-ea9c-4e31-9872-a4f6c535f952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:46.525033 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4662ac-ea9c-4e31-9872-a4f6c535f952 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:46.525767 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4662ac-ea9c-4e31-9872-a4f6c535f952 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:46.526180 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4662ac-ea9c-4e31-9872-a4f6c535f952 None admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:46.527557 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4662ac-ea9c-4e31-9872-a4f6c535f952 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:46.528092 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4662ac-ea9c-4e31-9872-a4f6c535f952 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:46.530171 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4662ac-ea9c-4e31-9872-a4f6c535f952 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:46.551686 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 390/761] 10.222.0.65 () {56 vars in 1149 bytes} [Tue May 10 03:00:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:46.551686 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4662ac-ea9c-4e31-9872-a4f6c535f952 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:46.604995 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 372/762] 10.222.0.65 () {58 vars in 1439 bytes} [Tue May 10 03:00:46 2022] PUT /identity/v3/projects/513e6592cd83457b8ff461b0e5e1fd40/users/9b7ccdccba0b4f9e86817946f22dbe28/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:00:46.606360 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f1656-4a4b-4c49-923c-737191e7ed1f None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:46.713399 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4662ac-ea9c-4e31-9872-a4f6c535f952 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:46.777835 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ac99a6-c425-448d-8e85-17528b866085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:46.778672 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac99a6-c425-448d-8e85-17528b866085 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:46.778958 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac99a6-c425-448d-8e85-17528b866085 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:46.779233 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac99a6-c425-448d-8e85-17528b866085 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:46.779904 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ac99a6-c425-448d-8e85-17528b866085 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:46.780927 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f1656-4a4b-4c49-923c-737191e7ed1f None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:46.781395 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ac99a6-c425-448d-8e85-17528b866085 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:46.808581 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-86ac99a6-c425-448d-8e85-17528b866085 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 03:00:46.808581 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:46.808581 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 03:00:46.808581 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 03:00:46.808581 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 03:00:46.808581 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 03:00:46.808581 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 03:00:46.808581 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:00:46.808581 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 03:00:46.808581 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:46.808581 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 03:00:46.808581 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:46.808581 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:46.808581 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:46.808581 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:46.808581 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:46.809581 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:46.809581 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:46.809581 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:46.809581 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:46.809581 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:46.809581 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:46.809581 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:46.809581 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 03:00:46.809581 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 03:00:46.809581 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 03:00:46.809581 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 03:00:46.809581 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:46.809581 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:46.809581 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:46.809581 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:46.809581 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:46.810422 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:46.810422 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:46.810422 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:46.810422 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:46.810422 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:46.810422 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:46.810422 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:46.810422 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:46.810422 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:46.810422 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:46.810422 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:46.810422 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 03:00:46.810422 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:00:46.810422 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 03:00:46.810422 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:46.810422 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 391/763] 10.222.0.65 () {56 vars in 1129 bytes} [Tue May 10 03:00:46 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:46.821014 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ac99a6-c425-448d-8e85-17528b866085 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:46.832377 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665be7f7-9550-483b-a246-e37afd2d0efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:46.833517 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665be7f7-9550-483b-a246-e37afd2d0efb None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:46.834008 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665be7f7-9550-483b-a246-e37afd2d0efb None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:46.835113 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665be7f7-9550-483b-a246-e37afd2d0efb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:46.912269 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665be7f7-9550-483b-a246-e37afd2d0efb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:46.914149 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665be7f7-9550-483b-a246-e37afd2d0efb None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:46.974289 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ac99a6-c425-448d-8e85-17528b866085 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:47.029687 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 373/764] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 10 03:00:46 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 03:00:47.035985 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665be7f7-9550-483b-a246-e37afd2d0efb None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:47.048129 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5586e09-d503-4317-b028-f77639888a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:47.049096 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5586e09-d503-4317-b028-f77639888a1b None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:47.049607 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5586e09-d503-4317-b028-f77639888a1b None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:47.050083 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5586e09-d503-4317-b028-f77639888a1b None admin] PATH_INFO: `/v3/services` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:47.051012 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5586e09-d503-4317-b028-f77639888a1b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:47.051529 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5586e09-d503-4317-b028-f77639888a1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:47.053664 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5586e09-d503-4317-b028-f77639888a1b None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:47.058887 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 392/765] 10.222.0.65 () {56 vars in 1124 bytes} [Tue May 10 03:00:46 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:47.064547 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5586e09-d503-4317-b028-f77639888a1b None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:47.253323 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665be7f7-9550-483b-a246-e37afd2d0efb None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:47.309482 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5586e09-d503-4317-b028-f77639888a1b None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:47.318748 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d79e71-695f-4839-8627-950c65ae6579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:47.319550 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d79e71-695f-4839-8627-950c65ae6579 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:47.319832 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d79e71-695f-4839-8627-950c65ae6579 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:47.320142 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d79e71-695f-4839-8627-950c65ae6579 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:47.337027 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d79e71-695f-4839-8627-950c65ae6579 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:47.338781 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d79e71-695f-4839-8627-950c65ae6579 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:47.365732 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-68d79e71-695f-4839-8627-950c65ae6579 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:47.365732 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:47.365732 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:47.365732 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:47.365732 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:47.365732 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:47.365732 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:47.365732 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:47.365732 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:47.365732 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:47.365732 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:47.365732 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:47.365732 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:00:47.365732 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:00:47.365732 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:00:47.366709 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:00:47.366709 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:47.366709 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:47.366709 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:47.366709 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:47.366709 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:47.366709 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:47.366709 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:47.366709 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:47.366709 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:47.366709 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:47.366709 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:47.366709 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:47.366709 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:47.366709 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:47.366709 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:47.366709 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:47.367612 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:00:47.367612 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:00:47.367612 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:47.367612 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:47.367841 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7faba2-d0fb-47fb-a6a5-a38e81e6fecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:47.367841 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7faba2-d0fb-47fb-a6a5-a38e81e6fecf None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:47.367841 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7faba2-d0fb-47fb-a6a5-a38e81e6fecf None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:47.367841 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7faba2-d0fb-47fb-a6a5-a38e81e6fecf None admin] PATH_INFO: `/v3/services` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:47.368637 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7faba2-d0fb-47fb-a6a5-a38e81e6fecf None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:47.368637 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7faba2-d0fb-47fb-a6a5-a38e81e6fecf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:47.372022 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7faba2-d0fb-47fb-a6a5-a38e81e6fecf None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:47.373633 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 374/766] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:00:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:00:47.375362 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 393/767] 10.222.0.65 () {56 vars in 1124 bytes} [Tue May 10 03:00:47 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:47.384126 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7faba2-d0fb-47fb-a6a5-a38e81e6fecf None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:47.384400 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d79e71-695f-4839-8627-950c65ae6579 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:47.543167 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7faba2-d0fb-47fb-a6a5-a38e81e6fecf None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:47.586694 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be77f5-de4e-4ead-9152-16751fe76d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:47.587778 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be77f5-de4e-4ead-9152-16751fe76d84 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:47.589094 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be77f5-de4e-4ead-9152-16751fe76d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:47.589544 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be77f5-de4e-4ead-9152-16751fe76d84 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:47.590835 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3be77f5-de4e-4ead-9152-16751fe76d84 None admin] RBAC: Adding query filter params (interface=public, service_id=e6b3ff0a298145e8b373224cb26031ff, region_id=RegionOne) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:47.591308 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3be77f5-de4e-4ead-9152-16751fe76d84 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:47.593545 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3be77f5-de4e-4ead-9152-16751fe76d84 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:47.597210 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d79e71-695f-4839-8627-950c65ae6579 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:47.614820 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 394/768] 10.222.0.65 () {56 vars in 1251 bytes} [Tue May 10 03:00:47 2022] GET /identity/v3/endpoints?service_id=e6b3ff0a298145e8b373224cb26031ff&interface=public®ion_id=RegionOne => generated 194 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:47.621845 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be77f5-de4e-4ead-9152-16751fe76d84 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:47.643264 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e2b5b-c196-4237-81c7-c9804eeca613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:47.643943 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e2b5b-c196-4237-81c7-c9804eeca613 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:47.644259 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e2b5b-c196-4237-81c7-c9804eeca613 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:47.645015 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e2b5b-c196-4237-81c7-c9804eeca613 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:47.645749 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57e2b5b-c196-4237-81c7-c9804eeca613 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:47.646731 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57e2b5b-c196-4237-81c7-c9804eeca613 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:47.649469 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57e2b5b-c196-4237-81c7-c9804eeca613 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:47.664091 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 375/769] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:00:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:47.665838 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9930105-450e-4d10-848e-55ee3cbbaeaa None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:47.666391 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9930105-450e-4d10-848e-55ee3cbbaeaa None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:47.666893 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9930105-450e-4d10-848e-55ee3cbbaeaa None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:47.672594 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 376/770] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:00:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:47.674020 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9930105-450e-4d10-848e-55ee3cbbaeaa None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:47.750059 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be77f5-de4e-4ead-9152-16751fe76d84 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:47.784035 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9930105-450e-4d10-848e-55ee3cbbaeaa None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:47.785203 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e44fc-eef6-4bd8-a3f0-3bb2dc6c317f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:47.786041 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e44fc-eef6-4bd8-a3f0-3bb2dc6c317f None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:47.787688 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e44fc-eef6-4bd8-a3f0-3bb2dc6c317f None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:47.787972 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e44fc-eef6-4bd8-a3f0-3bb2dc6c317f None admin] PATH_INFO: `/v3/services` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:47.788736 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9e44fc-eef6-4bd8-a3f0-3bb2dc6c317f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:47.790100 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9e44fc-eef6-4bd8-a3f0-3bb2dc6c317f None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:47.797040 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 395/771] 10.222.0.65 () {56 vars in 1087 bytes} [Tue May 10 03:00:47 2022] GET /identity/v3/services => generated 772 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:47.798858 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3f08d-0658-4a6d-b126-ac7463012d2c None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:47.799151 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3f08d-0658-4a6d-b126-ac7463012d2c None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:47.799718 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3f08d-0658-4a6d-b126-ac7463012d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:47.820406 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb42ed8d-cd42-4283-bc69-5087fb33a65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:47.820617 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-d5c3f08d-0658-4a6d-b126-ac7463012d2c None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:47.821218 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42ed8d-cd42-4283-bc69-5087fb33a65b None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:47.821510 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42ed8d-cd42-4283-bc69-5087fb33a65b None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:47.821776 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-d5c3f08d-0658-4a6d-b126-ac7463012d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:47.821880 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42ed8d-cd42-4283-bc69-5087fb33a65b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:47.829841 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb42ed8d-cd42-4283-bc69-5087fb33a65b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:47.831355 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb42ed8d-cd42-4283-bc69-5087fb33a65b None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:47.846927 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-bb42ed8d-cd42-4283-bc69-5087fb33a65b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:00:47.846927 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:47.846927 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:47.846927 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:47.846927 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:47.846927 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:47.846927 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:47.846927 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:47.846927 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:47.846927 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:47.846927 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:47.846927 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:47.846927 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:00:47.846927 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:00:47.846927 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:00:47.847899 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:00:47.847899 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:47.847899 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:47.847899 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:47.847899 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:47.847899 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:47.847899 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:47.847899 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:47.847899 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:47.847899 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:47.847899 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:47.847899 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:47.847899 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:47.847899 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:47.847899 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:47.847899 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:47.847899 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:47.850388 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:00:47.850388 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:00:47.850388 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:00:47.850388 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:00:47.850388 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:00:47.850388 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:00:47.850388 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:00:47.850388 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:47.850388 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 377/772] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 10 03:00:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:47.854873 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb42ed8d-cd42-4283-bc69-5087fb33a65b None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:47.894342 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 396/773] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:00:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:00:47.933499 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c3f08d-0658-4a6d-b126-ac7463012d2c None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:47.978379 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb42ed8d-cd42-4283-bc69-5087fb33a65b None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:48.023353 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e48265-c76e-41a3-b7d8-c83b6b5cb991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:48.024502 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e48265-c76e-41a3-b7d8-c83b6b5cb991 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:48.024781 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e48265-c76e-41a3-b7d8-c83b6b5cb991 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:48.025059 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e48265-c76e-41a3-b7d8-c83b6b5cb991 None admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:48.027165 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e48265-c76e-41a3-b7d8-c83b6b5cb991 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:48.027483 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e48265-c76e-41a3-b7d8-c83b6b5cb991 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:48.028990 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e48265-c76e-41a3-b7d8-c83b6b5cb991 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:48.049908 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 378/774] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 10 03:00:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:48.055429 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e48265-c76e-41a3-b7d8-c83b6b5cb991 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:48.103998 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c3f08d-0658-4a6d-b126-ac7463012d2c None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:48.158344 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421702ce-abd5-4f1c-ad92-ecf183cf7c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:48.159199 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421702ce-abd5-4f1c-ad92-ecf183cf7c32 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:48.159473 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421702ce-abd5-4f1c-ad92-ecf183cf7c32 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:48.159786 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421702ce-abd5-4f1c-ad92-ecf183cf7c32 None admin] PATH_INFO: `/v3/services/network` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:48.160906 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421702ce-abd5-4f1c-ad92-ecf183cf7c32 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:48.161916 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421702ce-abd5-4f1c-ad92-ecf183cf7c32 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:48.174061 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-421702ce-abd5-4f1c-ad92-ecf183cf7c32 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 10 03:00:48.174061 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:48.174061 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 03:00:48.174061 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 03:00:48.174061 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 03:00:48.174061 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 03:00:48.174061 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 03:00:48.174061 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:00:48.174061 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 03:00:48.174061 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:48.174061 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 03:00:48.174061 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:48.174061 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:48.174061 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:48.174061 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:48.174061 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:48.174061 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:48.175070 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:48.175070 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:48.175070 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:48.175070 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:48.175070 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:48.175070 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:48.175070 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 03:00:48.175070 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 03:00:48.175070 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 03:00:48.175070 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 03:00:48.175070 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:48.175070 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:48.175070 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:48.175070 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:48.175070 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:48.175070 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:48.176357 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:48.176357 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:48.176357 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:48.176357 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:48.176357 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:48.176357 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:48.176357 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:48.176357 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:48.176357 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:48.176357 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:48.176357 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 03:00:48.176357 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:00:48.176357 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 03:00:48.176357 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:48.176357 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 397/775] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 10 03:00:47 2022] GET /identity/v3/services/network => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:00:48.187452 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421702ce-abd5-4f1c-ad92-ecf183cf7c32 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:48.191377 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e48265-c76e-41a3-b7d8-c83b6b5cb991 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:48.252690 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf65a97-ef71-4d4d-840e-4f7656a47803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:48.253799 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf65a97-ef71-4d4d-840e-4f7656a47803 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:48.254295 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf65a97-ef71-4d4d-840e-4f7656a47803 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:48.254757 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf65a97-ef71-4d4d-840e-4f7656a47803 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:48.258146 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf65a97-ef71-4d4d-840e-4f7656a47803 None admin] RBAC: Adding query filter params (role.id=9a5640186d0940658e691be68ccf9205, scope.project.id=513e6592cd83457b8ff461b0e5e1fd40, user.id=6ebfab3ff0b24f4aaabb8c6bb0ad10c6) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:48.258482 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf65a97-ef71-4d4d-840e-4f7656a47803 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:48.259978 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf65a97-ef71-4d4d-840e-4f7656a47803 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:48.278255 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 379/776] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 10 03:00:48 2022] GET /identity/v3/role_assignments?user.id=6ebfab3ff0b24f4aaabb8c6bb0ad10c6&scope.project.id=513e6592cd83457b8ff461b0e5e1fd40&role.id=9a5640186d0940658e691be68ccf9205 => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:48.363916 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421702ce-abd5-4f1c-ad92-ecf183cf7c32 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:48.413949 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e4de4-1d06-4bdb-9696-69f4bd743631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:48.414630 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e4de4-1d06-4bdb-9696-69f4bd743631 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:48.414916 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e4de4-1d06-4bdb-9696-69f4bd743631 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:48.415190 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e4de4-1d06-4bdb-9696-69f4bd743631 None admin] PATH_INFO: `/v3/services` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:48.415920 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748e4de4-1d06-4bdb-9696-69f4bd743631 None admin] RBAC: Adding query filter params (name=network) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:48.420469 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748e4de4-1d06-4bdb-9696-69f4bd743631 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:48.421946 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748e4de4-1d06-4bdb-9696-69f4bd743631 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:48.427983 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 398/777] 10.222.0.65 () {56 vars in 1112 bytes} [Tue May 10 03:00:48 2022] GET /identity/v3/services?name=network => generated 124 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:48.433705 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf65a97-ef71-4d4d-840e-4f7656a47803 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:48.573443 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf65a97-ef71-4d4d-840e-4f7656a47803 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:48.607403 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed40814-4436-45e8-9eda-c58cafa39e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:48.608099 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed40814-4436-45e8-9eda-c58cafa39e01 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:48.608388 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed40814-4436-45e8-9eda-c58cafa39e01 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:48.608665 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed40814-4436-45e8-9eda-c58cafa39e01 None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:48.609378 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed40814-4436-45e8-9eda-c58cafa39e01 None admin] RBAC: Adding query filter params (type=network) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:48.609679 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed40814-4436-45e8-9eda-c58cafa39e01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:48.611051 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed40814-4436-45e8-9eda-c58cafa39e01 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:48.618035 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 380/778] 10.222.0.65 () {56 vars in 1112 bytes} [Tue May 10 03:00:48 2022] GET /identity/v3/services?type=network => generated 350 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:48.623795 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e4de4-1d06-4bdb-9696-69f4bd743631 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:48.751586 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e4de4-1d06-4bdb-9696-69f4bd743631 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:48.790576 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760491a0-7901-4034-b714-d849e1999fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:48.791249 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760491a0-7901-4034-b714-d849e1999fbb None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:48.791533 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760491a0-7901-4034-b714-d849e1999fbb None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:48.791811 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760491a0-7901-4034-b714-d849e1999fbb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:48.792643 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760491a0-7901-4034-b714-d849e1999fbb None admin] RBAC: Adding query filter params (interface=public, service_id=406969612be0496a81082a9a907b1f91, region_id=RegionOne) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:48.792954 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760491a0-7901-4034-b714-d849e1999fbb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:48.794318 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760491a0-7901-4034-b714-d849e1999fbb None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:48.803842 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 399/779] 10.222.0.65 () {56 vars in 1251 bytes} [Tue May 10 03:00:48 2022] GET /identity/v3/endpoints?service_id=406969612be0496a81082a9a907b1f91&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:48.809348 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed40814-4436-45e8-9eda-c58cafa39e01 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:48.897021 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd412c-d220-4e85-9d33-9fd6f9eba26a None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:48.897349 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd412c-d220-4e85-9d33-9fd6f9eba26a None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:48.897582 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd412c-d220-4e85-9d33-9fd6f9eba26a None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:48.899102 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 400/780] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:00:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:00:48.913859 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f799cc2e-a7ba-4d32-8d5e-894dd64b3565 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:48.914145 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f799cc2e-a7ba-4d32-8d5e-894dd64b3565 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:48.914425 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f799cc2e-a7ba-4d32-8d5e-894dd64b3565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:48.935957 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed40814-4436-45e8-9eda-c58cafa39e01 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:48.949121 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-f799cc2e-a7ba-4d32-8d5e-894dd64b3565 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:48.950220 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-f799cc2e-a7ba-4d32-8d5e-894dd64b3565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:48.975892 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cfaeef-680a-4cee-b78b-a934fe7b7e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:48.976597 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cfaeef-680a-4cee-b78b-a934fe7b7e46 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:48.976883 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cfaeef-680a-4cee-b78b-a934fe7b7e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:48.977162 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cfaeef-680a-4cee-b78b-a934fe7b7e46 None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:48.977852 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cfaeef-680a-4cee-b78b-a934fe7b7e46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:48.979281 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cfaeef-680a-4cee-b78b-a934fe7b7e46 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:48.985183 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 381/781] 10.222.0.65 () {56 vars in 1087 bytes} [Tue May 10 03:00:48 2022] GET /identity/v3/services => generated 772 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:49.089971 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 401/782] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:00:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:00:49.129773 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cfaeef-680a-4cee-b78b-a934fe7b7e46 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:49.253321 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cfaeef-680a-4cee-b78b-a934fe7b7e46 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:49.287986 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb2d0fb-5543-456d-82b2-9ef07b71e057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:49.288820 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb2d0fb-5543-456d-82b2-9ef07b71e057 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:49.289104 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb2d0fb-5543-456d-82b2-9ef07b71e057 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:49.289381 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb2d0fb-5543-456d-82b2-9ef07b71e057 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:49.300187 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb2d0fb-5543-456d-82b2-9ef07b71e057 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:49.308014 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-5fb2d0fb-5543-456d-82b2-9ef07b71e057 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:00:49.308014 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:49.308014 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:49.308014 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:49.308014 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:49.308014 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:49.308014 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:49.308014 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:49.308014 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:49.308014 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:49.308014 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:49.308014 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:49.308014 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:49.308014 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:49.308014 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:49.308014 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:49.308940 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:49.308940 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:49.308940 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:49.308940 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:49.308940 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:49.308940 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:49.308940 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:49.308940 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:49.308940 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:49.308940 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:49.308940 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:49.308940 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:49.308940 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:49.308940 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:49.308940 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:49.308940 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:49.310199 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:49.310199 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:49.310199 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:49.310199 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:49.310199 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:49.310199 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:49.310199 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:49.310199 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:49.310199 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:49.310199 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:49.310199 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:00:49.310199 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:49.310199 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 382/783] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 10 03:00:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:00:49.316931 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f799cc2e-a7ba-4d32-8d5e-894dd64b3565 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:49.350243 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a1968-3dee-43c9-bb5c-bbca53107edc None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:49.350883 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a1968-3dee-43c9-bb5c-bbca53107edc None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:49.351362 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a1968-3dee-43c9-bb5c-bbca53107edc None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:49.354274 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 383/784] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:00:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:00:49.359031 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bde3a5-d916-4076-ac0f-6a41c00f857d None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:49.359550 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bde3a5-d916-4076-ac0f-6a41c00f857d None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:49.360112 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bde3a5-d916-4076-ac0f-6a41c00f857d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:49.377405 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-79bde3a5-d916-4076-ac0f-6a41c00f857d None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:49.379437 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-79bde3a5-d916-4076-ac0f-6a41c00f857d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:49.471942 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 384/785] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:00:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 03:00:49.494646 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bde3a5-d916-4076-ac0f-6a41c00f857d None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:49.550870 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f799cc2e-a7ba-4d32-8d5e-894dd64b3565 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:49.603038 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bde3a5-d916-4076-ac0f-6a41c00f857d None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:49.628753 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ccf10-a8ee-464c-84e7-8ce24634102a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:49.629435 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ccf10-a8ee-464c-84e7-8ce24634102a None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:49.629721 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ccf10-a8ee-464c-84e7-8ce24634102a None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:49.629999 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ccf10-a8ee-464c-84e7-8ce24634102a None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:49.631304 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86ccf10-a8ee-464c-84e7-8ce24634102a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:49.631620 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86ccf10-a8ee-464c-84e7-8ce24634102a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:49.634570 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86ccf10-a8ee-464c-84e7-8ce24634102a None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:49.644020 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 402/786] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 10 03:00:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:49.650321 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ccf10-a8ee-464c-84e7-8ce24634102a None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:49.663606 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf43e1c-faca-4598-81f6-a6953dd16385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:49.664734 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf43e1c-faca-4598-81f6-a6953dd16385 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:49.665198 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf43e1c-faca-4598-81f6-a6953dd16385 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:49.665676 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf43e1c-faca-4598-81f6-a6953dd16385 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:49.686933 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf43e1c-faca-4598-81f6-a6953dd16385 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:49.699797 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-fcf43e1c-faca-4598-81f6-a6953dd16385 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:00:49.699797 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:49.699797 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:49.699797 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:49.699797 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:49.699797 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:49.699797 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:49.699797 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:49.699797 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:49.699797 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:49.699797 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:49.699797 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:49.699797 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:49.699797 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:49.699797 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:49.699797 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:49.700760 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:49.700760 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:49.700760 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:49.700760 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:49.700760 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:49.700760 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:49.700760 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:49.700760 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:49.700760 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:49.700760 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:49.700760 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:49.700760 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:49.700760 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:49.700760 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:49.700760 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:49.700760 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:49.701574 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:49.701574 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:49.701574 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:49.701574 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:49.701574 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:49.701574 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:49.701574 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:49.701574 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:49.701574 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:49.701574 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:49.701574 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:00:49.701574 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:49.701574 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 385/787] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 10 03:00:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:00:49.709318 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf43e1c-faca-4598-81f6-a6953dd16385 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:49.797479 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ccf10-a8ee-464c-84e7-8ce24634102a None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:49.829415 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf43e1c-faca-4598-81f6-a6953dd16385 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:49.839849 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc035e-f0f9-4dc2-b23f-9a92bc3cfeab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:49.841429 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc035e-f0f9-4dc2-b23f-9a92bc3cfeab None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:49.841917 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc035e-f0f9-4dc2-b23f-9a92bc3cfeab None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:49.842370 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc035e-f0f9-4dc2-b23f-9a92bc3cfeab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:49.854251 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afc035e-f0f9-4dc2-b23f-9a92bc3cfeab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:49.855943 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afc035e-f0f9-4dc2-b23f-9a92bc3cfeab None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:49.875329 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-3afc035e-f0f9-4dc2-b23f-9a92bc3cfeab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:49.875329 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:49.875329 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:49.875329 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:49.875329 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:49.875329 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:49.875329 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:49.875329 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:49.875329 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:49.875329 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:49.875329 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:49.875329 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:49.875329 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:00:49.875329 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:00:49.875329 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:00:49.876289 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:00:49.876289 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:49.876289 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:49.876289 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:49.876289 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:49.876289 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:49.876289 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:49.876289 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:49.876289 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:49.876289 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:49.876289 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:49.876289 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:49.876289 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:49.876289 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:49.876289 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:49.876289 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:49.876289 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:49.877250 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:00:49.877250 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:00:49.877250 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:49.877250 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:49.880183 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 403/788] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:00:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:49.888554 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc035e-f0f9-4dc2-b23f-9a92bc3cfeab None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:49.909776 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b4c05d-fbe4-4461-a40a-18c3458c9747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:49.910455 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4c05d-fbe4-4461-a40a-18c3458c9747 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:49.910738 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4c05d-fbe4-4461-a40a-18c3458c9747 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:49.911013 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4c05d-fbe4-4461-a40a-18c3458c9747 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:49.911792 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b4c05d-fbe4-4461-a40a-18c3458c9747 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:49.912128 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b4c05d-fbe4-4461-a40a-18c3458c9747 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:49.913505 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b4c05d-fbe4-4461-a40a-18c3458c9747 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:49.936110 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 386/789] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 10 03:00:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:49.953484 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b4c05d-fbe4-4461-a40a-18c3458c9747 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:50.075251 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc035e-f0f9-4dc2-b23f-9a92bc3cfeab None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:50.110352 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b4c05d-fbe4-4461-a40a-18c3458c9747 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:50.139676 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfcd4c3-54ce-48c6-8171-f76113038659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:50.140370 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfcd4c3-54ce-48c6-8171-f76113038659 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:50.140651 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfcd4c3-54ce-48c6-8171-f76113038659 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:50.140924 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfcd4c3-54ce-48c6-8171-f76113038659 None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:50.141659 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfcd4c3-54ce-48c6-8171-f76113038659 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:50.141965 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfcd4c3-54ce-48c6-8171-f76113038659 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:50.143336 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfcd4c3-54ce-48c6-8171-f76113038659 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:50.155864 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e2ee68-527a-4ac7-86f7-24e18e4b35be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:50.156707 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e2ee68-527a-4ac7-86f7-24e18e4b35be None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:50.156991 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e2ee68-527a-4ac7-86f7-24e18e4b35be None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:50.157533 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e2ee68-527a-4ac7-86f7-24e18e4b35be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:50.159861 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 404/790] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:00:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:50.161180 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfcd4c3-54ce-48c6-8171-f76113038659 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:50.184174 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e2ee68-527a-4ac7-86f7-24e18e4b35be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:50.185678 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e2ee68-527a-4ac7-86f7-24e18e4b35be None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:50.215367 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-79e2ee68-527a-4ac7-86f7-24e18e4b35be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:50.215367 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:50.215367 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:50.215367 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:50.215367 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:50.215367 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:50.215367 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:50.215367 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:50.215367 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:50.215367 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:50.215367 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:50.215367 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:50.215367 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:00:50.215367 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:00:50.215367 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:00:50.216324 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:00:50.216324 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:50.216324 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:50.216324 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:50.216324 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:50.216324 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:50.216324 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:50.216324 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:50.216324 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:50.216324 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:50.216324 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:50.216324 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:50.216324 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:50.216324 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:50.216324 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:50.216324 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:50.216324 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:50.217556 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:00:50.217556 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:00:50.217556 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:50.217556 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:50.221508 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 387/791] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:00:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:00:50.238968 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e2ee68-527a-4ac7-86f7-24e18e4b35be None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:50.296400 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfcd4c3-54ce-48c6-8171-f76113038659 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:50.330111 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ee7893-fd7b-4db9-b678-237c76bc3a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:50.330924 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee7893-fd7b-4db9-b678-237c76bc3a4b None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:50.331210 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee7893-fd7b-4db9-b678-237c76bc3a4b None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:50.331486 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee7893-fd7b-4db9-b678-237c76bc3a4b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:50.339492 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ee7893-fd7b-4db9-b678-237c76bc3a4b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:50.341012 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ee7893-fd7b-4db9-b678-237c76bc3a4b None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:50.355709 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-c7ee7893-fd7b-4db9-b678-237c76bc3a4b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 03:00:50.355709 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:50.355709 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:50.355709 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:50.355709 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:50.355709 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:50.355709 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:50.355709 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:50.355709 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:50.355709 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:50.355709 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:50.355709 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:50.355709 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:00:50.355709 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:00:50.355709 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:00:50.355709 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:00:50.357901 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:50.357901 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:50.357901 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:00:50.357901 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:00:50.357901 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:00:50.357901 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:00:50.357901 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:50.357901 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:50.357901 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:50.357901 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:50.357901 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:50.357901 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:50.357901 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:50.357901 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:50.357901 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:50.357901 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:50.357901 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:50.357901 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:50.360171 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:50.360171 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:50.360171 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:00:50.360171 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:00:50.360171 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:00:50.360171 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:00:50.360171 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:00:50.360171 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:00:50.360171 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 03:00:50.360171 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:50.368090 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 405/792] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 10 03:00:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:00:50.368090 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ee7893-fd7b-4db9-b678-237c76bc3a4b None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:50.472627 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e2ee68-527a-4ac7-86f7-24e18e4b35be None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:50.517810 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ee7893-fd7b-4db9-b678-237c76bc3a4b None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:50.530216 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60577b51-0dfc-48ee-82c4-817281c064b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:50.530907 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60577b51-0dfc-48ee-82c4-817281c064b5 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:50.531193 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60577b51-0dfc-48ee-82c4-817281c064b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:50.531479 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60577b51-0dfc-48ee-82c4-817281c064b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:50.532537 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60577b51-0dfc-48ee-82c4-817281c064b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:50.532849 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60577b51-0dfc-48ee-82c4-817281c064b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:50.534290 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60577b51-0dfc-48ee-82c4-817281c064b5 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:50.563029 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 388/793] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:00:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:50.567279 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60577b51-0dfc-48ee-82c4-817281c064b5 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:50.583067 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d08cca-13b1-494c-8ad6-e80bfff74fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:50.584635 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d08cca-13b1-494c-8ad6-e80bfff74fc6 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:50.585098 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d08cca-13b1-494c-8ad6-e80bfff74fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:50.585549 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d08cca-13b1-494c-8ad6-e80bfff74fc6 None admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:50.586568 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d08cca-13b1-494c-8ad6-e80bfff74fc6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:50.587057 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d08cca-13b1-494c-8ad6-e80bfff74fc6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:50.589960 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d08cca-13b1-494c-8ad6-e80bfff74fc6 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:50.621913 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 406/794] 10.222.0.65 () {56 vars in 1135 bytes} [Tue May 10 03:00:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:50.626509 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d08cca-13b1-494c-8ad6-e80bfff74fc6 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:50.737688 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60577b51-0dfc-48ee-82c4-817281c064b5 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:50.766036 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d08cca-13b1-494c-8ad6-e80bfff74fc6 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:50.773499 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42031e7-ecd8-480a-bd5c-8db513b6f135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:50.774643 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42031e7-ecd8-480a-bd5c-8db513b6f135 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:50.775147 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42031e7-ecd8-480a-bd5c-8db513b6f135 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:50.775632 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42031e7-ecd8-480a-bd5c-8db513b6f135 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:50.784069 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42031e7-ecd8-480a-bd5c-8db513b6f135 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:50.785945 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42031e7-ecd8-480a-bd5c-8db513b6f135 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:50.803313 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-c42031e7-ecd8-480a-bd5c-8db513b6f135 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 03:00:50.803313 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:50.803313 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:50.803313 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:50.803313 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:50.803313 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:50.803313 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:50.803313 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:50.803313 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:50.803313 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:50.803313 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:50.803313 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:50.803313 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:00:50.803313 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:00:50.803313 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:00:50.803313 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:00:50.804352 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:50.804352 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:50.804352 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:00:50.804352 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:00:50.804352 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:00:50.804352 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:00:50.804352 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:50.804352 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:50.804352 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:50.804352 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:50.804352 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:50.804352 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:50.804352 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:50.804352 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:50.804352 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:50.804352 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:50.804352 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:50.804352 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:50.805278 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:50.805278 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:50.805278 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:00:50.805278 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:00:50.805278 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:00:50.805278 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:00:50.805278 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:00:50.805278 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:00:50.805278 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 03:00:50.805278 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:50.805810 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b6efe5-9bc4-4f92-bf53-3e179139e5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:50.805810 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6efe5-9bc4-4f92-bf53-3e179139e5cf None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:50.805810 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6efe5-9bc4-4f92-bf53-3e179139e5cf None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:50.805810 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6efe5-9bc4-4f92-bf53-3e179139e5cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:50.812383 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 389/795] 10.222.0.65 () {56 vars in 1093 bytes} [Tue May 10 03:00:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:50.813938 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63da053-d3b7-41f0-9a0e-0c3547e27842 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:50.814429 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63da053-d3b7-41f0-9a0e-0c3547e27842 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:50.814924 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63da053-d3b7-41f0-9a0e-0c3547e27842 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:50.815041 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b6efe5-9bc4-4f92-bf53-3e179139e5cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:50.816469 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b6efe5-9bc4-4f92-bf53-3e179139e5cf None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:50.817426 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 390/796] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:00:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:50.818448 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63da053-d3b7-41f0-9a0e-0c3547e27842 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:50.838831 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-17b6efe5-9bc4-4f92-bf53-3e179139e5cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:50.838831 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:50.838831 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:50.838831 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:50.838831 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:50.838831 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:50.838831 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:50.838831 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:50.838831 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:50.838831 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:50.838831 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:50.838831 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:50.838831 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:00:50.838831 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:00:50.838831 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:00:50.839754 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:00:50.839754 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:50.839754 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:50.839754 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:50.839754 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:50.839754 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:50.839754 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:50.839754 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:50.839754 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:50.839754 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:50.839754 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:50.839754 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:50.839754 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:50.839754 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:50.839754 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:50.839754 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:50.839754 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:50.841375 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:00:50.841375 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:00:50.841375 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:50.841375 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:50.844615 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 407/797] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:00:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:00:50.845886 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa9834-60f4-4254-b6b3-75cf5634ed73 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:50.846171 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa9834-60f4-4254-b6b3-75cf5634ed73 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:50.846449 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa9834-60f4-4254-b6b3-75cf5634ed73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:50.863199 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-defa9834-60f4-4254-b6b3-75cf5634ed73 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:50.864420 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-defa9834-60f4-4254-b6b3-75cf5634ed73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:50.931067 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63da053-d3b7-41f0-9a0e-0c3547e27842 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:50.935927 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 408/798] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:00:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:00:50.936861 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa9834-60f4-4254-b6b3-75cf5634ed73 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:50.969347 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb92af2-48f7-44e8-8ff7-36f270925de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:50.970813 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb92af2-48f7-44e8-8ff7-36f270925de7 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:50.971616 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb92af2-48f7-44e8-8ff7-36f270925de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:50.972147 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb92af2-48f7-44e8-8ff7-36f270925de7 None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:50.973205 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb92af2-48f7-44e8-8ff7-36f270925de7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:50.973754 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb92af2-48f7-44e8-8ff7-36f270925de7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:50.976264 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb92af2-48f7-44e8-8ff7-36f270925de7 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:50.996369 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 391/799] 10.222.0.65 () {56 vars in 1133 bytes} [Tue May 10 03:00:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:50.997682 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb92af2-48f7-44e8-8ff7-36f270925de7 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:51.054325 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa9834-60f4-4254-b6b3-75cf5634ed73 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:51.088268 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d893c2-bb58-4f4b-8111-d49910d42422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:51.088937 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d893c2-bb58-4f4b-8111-d49910d42422 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:51.089304 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d893c2-bb58-4f4b-8111-d49910d42422 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:51.089561 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d893c2-bb58-4f4b-8111-d49910d42422 None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:51.090289 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d893c2-bb58-4f4b-8111-d49910d42422 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:51.090596 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d893c2-bb58-4f4b-8111-d49910d42422 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:51.091950 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d893c2-bb58-4f4b-8111-d49910d42422 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:51.099093 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb92af2-48f7-44e8-8ff7-36f270925de7 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:51.107817 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 409/800] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:00:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:51.107817 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde5340-f1cb-4ce9-889b-5633fea36089 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:51.107817 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde5340-f1cb-4ce9-889b-5633fea36089 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:51.107817 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde5340-f1cb-4ce9-889b-5633fea36089 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:51.107817 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 410/801] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:00:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:51.107817 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde5340-f1cb-4ce9-889b-5633fea36089 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:51.137189 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb9558-d833-4b3d-8ae1-4faf8088bb3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:51.137993 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb9558-d833-4b3d-8ae1-4faf8088bb3b None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:51.138278 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb9558-d833-4b3d-8ae1-4faf8088bb3b None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:51.138555 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb9558-d833-4b3d-8ae1-4faf8088bb3b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:51.139204 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eb9558-d833-4b3d-8ae1-4faf8088bb3b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:51.140608 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eb9558-d833-4b3d-8ae1-4faf8088bb3b None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:51.154702 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-64eb9558-d833-4b3d-8ae1-4faf8088bb3b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 03:00:51.154702 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:51.154702 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 03:00:51.154702 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 03:00:51.154702 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 03:00:51.154702 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 03:00:51.154702 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 03:00:51.154702 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:00:51.154702 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 03:00:51.154702 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:51.154702 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 03:00:51.154702 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:51.154702 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:51.154702 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:51.154702 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:51.154702 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:51.155769 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:51.155769 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:51.155769 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:51.155769 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:51.155769 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:51.155769 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:51.155769 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:51.155769 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 03:00:51.155769 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 03:00:51.155769 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 03:00:51.155769 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 03:00:51.155769 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:51.155769 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:51.155769 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:51.155769 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:51.155769 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:51.157070 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:51.157070 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:51.157070 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:51.157070 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:51.157070 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:51.157070 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:51.157070 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:51.157070 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:51.157070 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:51.157070 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:51.157070 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:51.157070 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 03:00:51.157070 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:00:51.157070 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 03:00:51.157070 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:51.160962 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 392/802] 10.222.0.65 () {56 vars in 1129 bytes} [Tue May 10 03:00:50 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:51.161759 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb9558-d833-4b3d-8ae1-4faf8088bb3b None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:51.216829 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde5340-f1cb-4ce9-889b-5633fea36089 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:51.249510 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5bc56f-5f71-4236-9d62-33ae3d8e965a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:51.250178 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5bc56f-5f71-4236-9d62-33ae3d8e965a None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:51.250463 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5bc56f-5f71-4236-9d62-33ae3d8e965a None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:51.250744 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5bc56f-5f71-4236-9d62-33ae3d8e965a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:51.278412 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb9558-d833-4b3d-8ae1-4faf8088bb3b None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:51.311296 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578bcd0f-814d-4875-af33-86616a3a124f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:51.312168 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578bcd0f-814d-4875-af33-86616a3a124f None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:51.312454 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578bcd0f-814d-4875-af33-86616a3a124f None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:51.312780 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578bcd0f-814d-4875-af33-86616a3a124f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:51.318291 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5bc56f-5f71-4236-9d62-33ae3d8e965a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:51.319746 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5bc56f-5f71-4236-9d62-33ae3d8e965a None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:51.320173 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578bcd0f-814d-4875-af33-86616a3a124f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:51.321609 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578bcd0f-814d-4875-af33-86616a3a124f None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:51.335852 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-578bcd0f-814d-4875-af33-86616a3a124f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:00:51.335852 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:51.335852 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:51.335852 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:51.335852 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:51.335852 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:51.335852 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:51.335852 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:51.335852 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:51.335852 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:51.335852 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:51.335852 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:51.335852 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:00:51.335852 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:00:51.335852 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:00:51.336880 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:00:51.336880 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:51.336880 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:51.336880 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:51.336880 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:51.336880 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:51.336880 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:51.336880 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:51.336880 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:51.336880 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:51.336880 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:51.336880 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:51.336880 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:51.336880 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:51.336880 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:51.336880 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:51.336880 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:51.337755 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:00:51.337755 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:00:51.337755 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:00:51.337755 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:00:51.337755 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:00:51.337755 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:00:51.337755 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:00:51.337755 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:51.337755 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 393/803] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 10 03:00:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:51.338689 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4771fa-7d45-47e0-bf75-ed25e621da86 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:51.338689 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4771fa-7d45-47e0-bf75-ed25e621da86 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:51.338943 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4771fa-7d45-47e0-bf75-ed25e621da86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:51.355078 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-ee4771fa-7d45-47e0-bf75-ed25e621da86 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:51.356290 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-ee4771fa-7d45-47e0-bf75-ed25e621da86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:51.428043 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 394/804] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:00:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:00:51.428043 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4771fa-7d45-47e0-bf75-ed25e621da86 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:51.436297 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 411/805] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 10 03:00:51 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 03:00:51.437160 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5bc56f-5f71-4236-9d62-33ae3d8e965a None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:51.533042 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4771fa-7d45-47e0-bf75-ed25e621da86 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:51.547122 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5bc56f-5f71-4236-9d62-33ae3d8e965a None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:51.566373 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eccd5bd-f30c-40f8-84e1-f4bc9c0ced88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:51.567039 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eccd5bd-f30c-40f8-84e1-f4bc9c0ced88 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:51.567324 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eccd5bd-f30c-40f8-84e1-f4bc9c0ced88 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:51.568271 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eccd5bd-f30c-40f8-84e1-f4bc9c0ced88 None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:51.568893 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eccd5bd-f30c-40f8-84e1-f4bc9c0ced88 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:51.569203 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eccd5bd-f30c-40f8-84e1-f4bc9c0ced88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:51.570588 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eccd5bd-f30c-40f8-84e1-f4bc9c0ced88 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:51.575363 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 395/806] 10.222.0.65 () {56 vars in 1124 bytes} [Tue May 10 03:00:51 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:51.575975 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eccd5bd-f30c-40f8-84e1-f4bc9c0ced88 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:51.585294 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a95b00a-3a9c-41f3-9e3a-64a35e1bc229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:51.585964 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95b00a-3a9c-41f3-9e3a-64a35e1bc229 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:51.586253 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95b00a-3a9c-41f3-9e3a-64a35e1bc229 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:51.586531 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95b00a-3a9c-41f3-9e3a-64a35e1bc229 None admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:51.587323 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a95b00a-3a9c-41f3-9e3a-64a35e1bc229 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:51.587635 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a95b00a-3a9c-41f3-9e3a-64a35e1bc229 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:51.589121 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a95b00a-3a9c-41f3-9e3a-64a35e1bc229 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:51.605081 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 412/807] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 10 03:00:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:51.605081 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a95b00a-3a9c-41f3-9e3a-64a35e1bc229 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:51.678413 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eccd5bd-f30c-40f8-84e1-f4bc9c0ced88 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:51.697434 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a95b00a-3a9c-41f3-9e3a-64a35e1bc229 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:51.709871 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4747f3a3-0760-4c7d-be97-40028bc7d4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:51.710664 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747f3a3-0760-4c7d-be97-40028bc7d4e9 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:51.710944 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747f3a3-0760-4c7d-be97-40028bc7d4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:51.711217 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747f3a3-0760-4c7d-be97-40028bc7d4e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:51.720986 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4747f3a3-0760-4c7d-be97-40028bc7d4e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:51.722427 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4747f3a3-0760-4c7d-be97-40028bc7d4e9 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:51.729106 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d42bf9c-484d-4c8a-9b1d-3fd683441c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:51.729896 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42bf9c-484d-4c8a-9b1d-3fd683441c79 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:51.730178 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42bf9c-484d-4c8a-9b1d-3fd683441c79 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:51.730454 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42bf9c-484d-4c8a-9b1d-3fd683441c79 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:51.740409 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-4747f3a3-0760-4c7d-be97-40028bc7d4e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:51.740409 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:51.740409 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:51.740409 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:51.740409 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:51.740409 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:51.740409 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:51.740409 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:51.740409 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:51.740409 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:51.740409 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:51.740409 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:51.740409 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:00:51.740409 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:00:51.740409 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:00:51.741273 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:00:51.741273 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:51.741273 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:51.741273 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:51.741273 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:51.741273 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:51.741273 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:51.741273 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:51.741273 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:51.741273 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:51.741273 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:51.741273 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:51.741273 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:51.741273 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:51.741273 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:51.741273 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:51.741273 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:51.742261 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:00:51.742261 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:00:51.742261 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:51.742261 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:51.742479 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d42bf9c-484d-4c8a-9b1d-3fd683441c79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:51.742549 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 396/808] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:00:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:51.742549 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4747f3a3-0760-4c7d-be97-40028bc7d4e9 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:51.748538 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-7d42bf9c-484d-4c8a-9b1d-3fd683441c79 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 03:00:51.748538 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:51.748538 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:51.748538 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:51.748538 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:51.748538 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:51.748538 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:51.748538 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:51.748538 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:51.748538 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:51.748538 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:51.748538 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:51.748538 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:51.748538 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:51.748538 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:51.748538 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:51.749599 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:51.749599 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:51.749599 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:51.749599 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:51.749599 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:51.749599 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:51.749599 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:51.749599 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:51.749599 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:51.749599 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:51.749599 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:51.749599 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:51.749599 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:51.749599 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:51.749599 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:51.749599 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:51.750674 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:51.750674 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:51.750674 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:51.750674 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:51.750674 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:51.750674 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:51.750674 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:51.750674 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:51.750674 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:51.750674 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:51.750674 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 03:00:51.750674 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:51.750674 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 413/809] 10.222.0.65 () {56 vars in 1102 bytes} [Tue May 10 03:00:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:51.750674 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d42bf9c-484d-4c8a-9b1d-3fd683441c79 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:51.841362 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4747f3a3-0760-4c7d-be97-40028bc7d4e9 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:51.842968 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d42bf9c-484d-4c8a-9b1d-3fd683441c79 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:51.873973 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381de78f-a86d-41b5-b1c5-0fb57ade6f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:51.874624 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381de78f-a86d-41b5-b1c5-0fb57ade6f3e None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:51.874906 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381de78f-a86d-41b5-b1c5-0fb57ade6f3e None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:51.875181 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381de78f-a86d-41b5-b1c5-0fb57ade6f3e None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:51.875318 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a92ba34-6b66-4f24-a935-8e56236e532c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:51.875879 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381de78f-a86d-41b5-b1c5-0fb57ade6f3e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:51.876205 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a92ba34-6b66-4f24-a935-8e56236e532c None admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:51.876316 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381de78f-a86d-41b5-b1c5-0fb57ade6f3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:51.876492 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a92ba34-6b66-4f24-a935-8e56236e532c None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:51.876767 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a92ba34-6b66-4f24-a935-8e56236e532c None admin] PATH_INFO: `/v3/projects/513e6592cd83457b8ff461b0e5e1fd40/users/f1cb8ad43a234233ad602f451f0f8ebf/roles/43105000610f402ca2486e7648018cca` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:51.877567 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381de78f-a86d-41b5-b1c5-0fb57ade6f3e None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:51.878734 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a92ba34-6b66-4f24-a935-8e56236e532c None admin] RBAC: Authorizing `identity:create_grant(project_id=513e6592cd83457b8ff461b0e5e1fd40, user_id=f1cb8ad43a234233ad602f451f0f8ebf, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:51.880394 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a92ba34-6b66-4f24-a935-8e56236e532c None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:51.882585 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 397/810] 10.222.0.65 () {56 vars in 1124 bytes} [Tue May 10 03:00:51 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:51.883928 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd6b48c-7e48-4b95-8c8c-f5bddb231aae None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:51.884248 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd6b48c-7e48-4b95-8c8c-f5bddb231aae None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:51.884527 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd6b48c-7e48-4b95-8c8c-f5bddb231aae None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:51.885748 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 398/811] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:00:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:51.886441 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd6b48c-7e48-4b95-8c8c-f5bddb231aae None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:51.951783 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 414/812] 10.222.0.65 () {58 vars in 1439 bytes} [Tue May 10 03:00:51 2022] PUT /identity/v3/projects/513e6592cd83457b8ff461b0e5e1fd40/users/f1cb8ad43a234233ad602f451f0f8ebf/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:00:51.952697 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a92ba34-6b66-4f24-a935-8e56236e532c None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:51.987013 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd6b48c-7e48-4b95-8c8c-f5bddb231aae None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:52.025550 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f51a40e-1693-4201-833f-519e37221f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:52.026228 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51a40e-1693-4201-833f-519e37221f0e None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:52.026514 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51a40e-1693-4201-833f-519e37221f0e None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:52.026800 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51a40e-1693-4201-833f-519e37221f0e None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:52.027529 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f51a40e-1693-4201-833f-519e37221f0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:52.027837 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f51a40e-1693-4201-833f-519e37221f0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:52.029442 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f51a40e-1693-4201-833f-519e37221f0e None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:52.047194 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 399/813] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:00:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:52.047194 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f51a40e-1693-4201-833f-519e37221f0e None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:52.068178 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a92ba34-6b66-4f24-a935-8e56236e532c None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:52.103110 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c8bd72-b1ba-41e9-8b14-dbe2aee12689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:52.103814 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8bd72-b1ba-41e9-8b14-dbe2aee12689 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:52.104208 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8bd72-b1ba-41e9-8b14-dbe2aee12689 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:52.104572 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8bd72-b1ba-41e9-8b14-dbe2aee12689 None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:52.105424 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c8bd72-b1ba-41e9-8b14-dbe2aee12689 None admin] RBAC: Adding query filter params (name=service) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:52.105804 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c8bd72-b1ba-41e9-8b14-dbe2aee12689 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:52.107268 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c8bd72-b1ba-41e9-8b14-dbe2aee12689 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:52.120482 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 415/814] 10.222.0.65 () {56 vars in 1103 bytes} [Tue May 10 03:00:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:52.120482 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac1ebe7-ac66-4200-84da-8f53c7e13cbf None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:52.120482 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac1ebe7-ac66-4200-84da-8f53c7e13cbf None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:52.120482 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac1ebe7-ac66-4200-84da-8f53c7e13cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:52.140829 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-aac1ebe7-ac66-4200-84da-8f53c7e13cbf None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:52.142127 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-aac1ebe7-ac66-4200-84da-8f53c7e13cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:52.149815 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f51a40e-1693-4201-833f-519e37221f0e None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:52.184024 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454c28d-1395-4b62-960d-87c95c3c881b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:52.184695 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454c28d-1395-4b62-960d-87c95c3c881b None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:52.184969 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454c28d-1395-4b62-960d-87c95c3c881b None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:52.185247 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454c28d-1395-4b62-960d-87c95c3c881b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:52.185985 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b454c28d-1395-4b62-960d-87c95c3c881b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:52.187365 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b454c28d-1395-4b62-960d-87c95c3c881b None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:52.212879 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 416/815] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:00:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:00:52.213783 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac1ebe7-ac66-4200-84da-8f53c7e13cbf None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:52.249293 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 400/816] 10.222.0.65 () {60 vars in 1144 bytes} [Tue May 10 03:00:52 2022] POST /identity/v3/endpoints => generated 346 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:00:52.249293 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454c28d-1395-4b62-960d-87c95c3c881b None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:52.356032 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac1ebe7-ac66-4200-84da-8f53c7e13cbf None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:52.367500 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454c28d-1395-4b62-960d-87c95c3c881b None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:52.403327 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1283666c-2465-4379-a02e-fcfb7258bfdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:52.403677 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f95e44-413f-4d9a-8f13-84bee9251ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:52.404186 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283666c-2465-4379-a02e-fcfb7258bfdd None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:52.404469 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f95e44-413f-4d9a-8f13-84bee9251ab3 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:52.404596 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283666c-2465-4379-a02e-fcfb7258bfdd None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:52.404750 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283666c-2465-4379-a02e-fcfb7258bfdd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:52.404841 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f95e44-413f-4d9a-8f13-84bee9251ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:52.405001 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f95e44-413f-4d9a-8f13-84bee9251ab3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:52.413519 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1283666c-2465-4379-a02e-fcfb7258bfdd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:52.415007 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1283666c-2465-4379-a02e-fcfb7258bfdd None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:52.417800 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f95e44-413f-4d9a-8f13-84bee9251ab3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:52.419397 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f95e44-413f-4d9a-8f13-84bee9251ab3 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:52.429736 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-1283666c-2465-4379-a02e-fcfb7258bfdd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:00:52.429736 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:52.429736 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:52.429736 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:52.429736 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:52.429736 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:52.429736 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:52.429736 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:52.429736 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:52.429736 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:52.429736 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:52.429736 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:52.429736 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:00:52.429736 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:00:52.429736 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:00:52.430708 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:00:52.430708 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:52.430708 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:52.430708 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:52.430708 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:52.430708 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:52.430708 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:52.430708 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:52.430708 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:52.430708 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:52.430708 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:52.430708 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:52.430708 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:52.430708 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:52.430708 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:52.430708 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:52.430708 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:52.431618 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:00:52.431618 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:00:52.431618 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:00:52.431618 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:00:52.431618 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:00:52.431618 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:00:52.431618 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:00:52.431618 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:52.431618 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 417/817] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 10 03:00:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:52.432117 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1283666c-2465-4379-a02e-fcfb7258bfdd None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:52.438947 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-60f95e44-413f-4d9a-8f13-84bee9251ab3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:52.438947 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:52.438947 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:52.438947 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:52.438947 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:52.438947 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:52.438947 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:52.438947 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:52.438947 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:52.438947 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:52.438947 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:52.438947 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:52.438947 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:00:52.438947 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:00:52.438947 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:00:52.441150 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:00:52.441150 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:52.441150 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:52.441150 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:52.441150 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:52.441150 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:52.441150 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:52.441150 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:52.441150 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:52.441150 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:52.441150 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:52.441150 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:52.441150 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:52.441150 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:52.441150 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:52.441150 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:52.441150 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:52.443820 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:00:52.443820 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:00:52.443820 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:52.443820 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:52.444358 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 401/818] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:00:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:52.448541 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f95e44-413f-4d9a-8f13-84bee9251ab3 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:52.566113 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1283666c-2465-4379-a02e-fcfb7258bfdd None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:52.567130 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f95e44-413f-4d9a-8f13-84bee9251ab3 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:52.600415 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d414494a-892b-4dbc-9a95-58aade32d321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:52.601247 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414494a-892b-4dbc-9a95-58aade32d321 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:52.601529 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414494a-892b-4dbc-9a95-58aade32d321 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:52.601804 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414494a-892b-4dbc-9a95-58aade32d321 None admin] PATH_INFO: `/v3/services/network` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:52.602460 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d414494a-892b-4dbc-9a95-58aade32d321 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:52.603053 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687502d-c2d4-4eba-870c-31d90762113a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:52.603819 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d414494a-892b-4dbc-9a95-58aade32d321 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:52.604288 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687502d-c2d4-4eba-870c-31d90762113a None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:52.604766 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687502d-c2d4-4eba-870c-31d90762113a None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:52.605242 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687502d-c2d4-4eba-870c-31d90762113a None admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:52.606276 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4687502d-c2d4-4eba-870c-31d90762113a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:52.606783 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4687502d-c2d4-4eba-870c-31d90762113a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:52.608446 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4687502d-c2d4-4eba-870c-31d90762113a None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:52.616167 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-d414494a-892b-4dbc-9a95-58aade32d321 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 10 03:00:52.616167 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:52.616167 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 03:00:52.616167 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 03:00:52.616167 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 03:00:52.616167 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 03:00:52.616167 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 03:00:52.616167 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:00:52.616167 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 03:00:52.616167 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:52.616167 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 03:00:52.616167 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:52.616167 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:52.616167 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:52.616167 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:52.616167 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:52.616167 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:52.617185 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:52.617185 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:52.617185 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:52.617185 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:52.617185 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:52.617185 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:52.617185 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 03:00:52.617185 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 03:00:52.617185 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 03:00:52.617185 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 03:00:52.617185 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:52.617185 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:52.617185 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:52.617185 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:52.617185 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:52.617185 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:52.617996 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:52.617996 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:52.617996 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:52.617996 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:52.617996 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:52.617996 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:52.617996 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:52.617996 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:52.617996 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:52.617996 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:52.617996 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 03:00:52.617996 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:00:52.617996 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 03:00:52.617996 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:52.617996 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 418/819] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 10 03:00:52 2022] GET /identity/v3/services/network => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:52.618784 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d414494a-892b-4dbc-9a95-58aade32d321 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:52.626259 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 402/820] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 10 03:00:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:52.629411 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687502d-c2d4-4eba-870c-31d90762113a None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:52.729648 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d414494a-892b-4dbc-9a95-58aade32d321 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:52.730868 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687502d-c2d4-4eba-870c-31d90762113a None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:52.763306 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb104cd7-f8e6-4f5e-b3f5-caaf93145d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:52.763970 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb104cd7-f8e6-4f5e-b3f5-caaf93145d67 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:52.764279 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb104cd7-f8e6-4f5e-b3f5-caaf93145d67 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:52.764552 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb104cd7-f8e6-4f5e-b3f5-caaf93145d67 None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:52.765295 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb104cd7-f8e6-4f5e-b3f5-caaf93145d67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:52.765580 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb104cd7-f8e6-4f5e-b3f5-caaf93145d67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:52.766867 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa7dc3f-b796-40d3-b5e5-17106e616e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:52.766991 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb104cd7-f8e6-4f5e-b3f5-caaf93145d67 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:52.767854 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7dc3f-b796-40d3-b5e5-17106e616e9d None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:52.768365 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7dc3f-b796-40d3-b5e5-17106e616e9d None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:52.768838 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7dc3f-b796-40d3-b5e5-17106e616e9d None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:52.769746 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa7dc3f-b796-40d3-b5e5-17106e616e9d None admin] RBAC: Adding query filter params (name=network) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:52.770248 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa7dc3f-b796-40d3-b5e5-17106e616e9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:52.772418 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa7dc3f-b796-40d3-b5e5-17106e616e9d None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:52.777687 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 403/821] 10.222.0.65 () {56 vars in 1112 bytes} [Tue May 10 03:00:52 2022] GET /identity/v3/services?name=network => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:52.778735 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa7dc3f-b796-40d3-b5e5-17106e616e9d None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:52.784800 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 419/822] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:00:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:52.785682 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb104cd7-f8e6-4f5e-b3f5-caaf93145d67 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:52.878334 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa7dc3f-b796-40d3-b5e5-17106e616e9d None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:52.889860 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb104cd7-f8e6-4f5e-b3f5-caaf93145d67 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:52.914432 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aeafea-df67-434c-bed6-0904493074af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:52.915424 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aeafea-df67-434c-bed6-0904493074af None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:52.915909 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aeafea-df67-434c-bed6-0904493074af None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:52.916439 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aeafea-df67-434c-bed6-0904493074af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:52.917462 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aeafea-df67-434c-bed6-0904493074af None admin] RBAC: Adding query filter params (role.id=43105000610f402ca2486e7648018cca, scope.project.id=513e6592cd83457b8ff461b0e5e1fd40, user.id=9b7ccdccba0b4f9e86817946f22dbe28) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:52.917972 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aeafea-df67-434c-bed6-0904493074af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:52.919591 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aeafea-df67-434c-bed6-0904493074af None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:52.924197 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3562d18f-8e89-4677-8ede-92f6306a949d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:52.924857 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562d18f-8e89-4677-8ede-92f6306a949d None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:52.925138 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562d18f-8e89-4677-8ede-92f6306a949d None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:52.925410 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562d18f-8e89-4677-8ede-92f6306a949d None admin] PATH_INFO: `/v3/services` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:52.926115 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3562d18f-8e89-4677-8ede-92f6306a949d None admin] RBAC: Adding query filter params (type=network) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:52.926416 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3562d18f-8e89-4677-8ede-92f6306a949d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:52.928206 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 404/823] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 10 03:00:52 2022] GET /identity/v3/role_assignments?user.id=9b7ccdccba0b4f9e86817946f22dbe28&scope.project.id=513e6592cd83457b8ff461b0e5e1fd40&role.id=43105000610f402ca2486e7648018cca => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:52.929270 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aeafea-df67-434c-bed6-0904493074af None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:52.936825 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3562d18f-8e89-4677-8ede-92f6306a949d None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:52.942499 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 420/824] 10.222.0.65 () {56 vars in 1112 bytes} [Tue May 10 03:00:52 2022] GET /identity/v3/services?type=network => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:52.948500 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3562d18f-8e89-4677-8ede-92f6306a949d None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:53.036251 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aeafea-df67-434c-bed6-0904493074af None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:53.074496 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c75c7-ea4a-4ebd-a09f-5955796c175d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:53.075714 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c75c7-ea4a-4ebd-a09f-5955796c175d None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:53.076244 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c75c7-ea4a-4ebd-a09f-5955796c175d None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:53.076720 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c75c7-ea4a-4ebd-a09f-5955796c175d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:53.085369 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74c75c7-ea4a-4ebd-a09f-5955796c175d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:53.087194 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74c75c7-ea4a-4ebd-a09f-5955796c175d None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:53.103525 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-d74c75c7-ea4a-4ebd-a09f-5955796c175d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 03:00:53.103525 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:53.103525 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:53.103525 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:53.103525 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:53.103525 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:53.103525 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:53.103525 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:53.103525 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:53.103525 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:53.103525 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:53.103525 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:53.103525 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:00:53.103525 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:00:53.103525 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:00:53.103525 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:00:53.104767 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:53.104767 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:53.104767 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:00:53.104767 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:00:53.104767 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:00:53.104767 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:00:53.104767 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:53.104767 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:53.104767 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:53.104767 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:53.104767 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:53.104767 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:53.104767 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:53.104767 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:53.104767 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:53.104767 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:53.104767 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:53.104767 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:53.105677 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:53.105677 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:53.105677 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:00:53.105677 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:00:53.105677 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:00:53.105677 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:00:53.105677 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:00:53.105677 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:00:53.105677 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 03:00:53.105677 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:53.108024 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 405/825] 10.222.0.65 () {56 vars in 1117 bytes} [Tue May 10 03:00:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:53.114073 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c75c7-ea4a-4ebd-a09f-5955796c175d None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:53.195610 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3562d18f-8e89-4677-8ede-92f6306a949d None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:53.243381 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca534104-d558-4f67-89c7-390a82258d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:53.244455 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca534104-d558-4f67-89c7-390a82258d4d None admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:53.244946 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca534104-d558-4f67-89c7-390a82258d4d None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:53.245444 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca534104-d558-4f67-89c7-390a82258d4d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:53.246849 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca534104-d558-4f67-89c7-390a82258d4d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:53.249211 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca534104-d558-4f67-89c7-390a82258d4d None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:53.273738 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c75c7-ea4a-4ebd-a09f-5955796c175d None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:53.308916 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e2134f-1111-494b-bc08-cf6fb63cc466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:53.309695 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e2134f-1111-494b-bc08-cf6fb63cc466 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:53.309977 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e2134f-1111-494b-bc08-cf6fb63cc466 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:53.310252 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e2134f-1111-494b-bc08-cf6fb63cc466 None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:53.311086 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e2134f-1111-494b-bc08-cf6fb63cc466 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:53.311603 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e2134f-1111-494b-bc08-cf6fb63cc466 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:53.313404 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e2134f-1111-494b-bc08-cf6fb63cc466 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:53.333874 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 406/826] 10.222.0.65 () {56 vars in 1149 bytes} [Tue May 10 03:00:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:53.338858 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e2134f-1111-494b-bc08-cf6fb63cc466 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:53.387137 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 421/827] 10.222.0.65 () {60 vars in 1144 bytes} [Tue May 10 03:00:52 2022] POST /identity/v3/endpoints => generated 327 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:00:53.453681 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e2134f-1111-494b-bc08-cf6fb63cc466 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:53.500307 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145847f-0174-4347-a812-b9567396cba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:53.501161 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145847f-0174-4347-a812-b9567396cba3 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:53.501443 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145847f-0174-4347-a812-b9567396cba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:53.501713 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145847f-0174-4347-a812-b9567396cba3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:53.512874 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c145847f-0174-4347-a812-b9567396cba3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:53.514380 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c145847f-0174-4347-a812-b9567396cba3 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:53.534102 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-c145847f-0174-4347-a812-b9567396cba3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:53.534102 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:53.534102 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:53.534102 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:53.534102 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:53.534102 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:53.534102 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:53.534102 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:53.534102 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:53.534102 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:53.534102 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:53.534102 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:53.534102 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:00:53.534102 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:00:53.534102 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:00:53.535057 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:00:53.535057 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:53.535057 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:53.535057 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:53.535057 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:53.535057 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:53.535057 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:53.535057 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:53.535057 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:53.535057 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:53.535057 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:53.535057 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:53.535057 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:53.535057 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:53.535057 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:53.535057 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:53.535057 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:53.535938 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:00:53.535938 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:00:53.535938 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:53.535938 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:53.535938 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 407/828] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:00:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:00:53.541986 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca534104-d558-4f67-89c7-390a82258d4d None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:53.647534 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca534104-d558-4f67-89c7-390a82258d4d None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:53.691073 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae251c-4ecf-47b1-a431-72b45f325fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:53.692091 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae251c-4ecf-47b1-a431-72b45f325fbd None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:53.692539 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae251c-4ecf-47b1-a431-72b45f325fbd None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:53.693023 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae251c-4ecf-47b1-a431-72b45f325fbd None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:53.694160 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ae251c-4ecf-47b1-a431-72b45f325fbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:53.694626 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ae251c-4ecf-47b1-a431-72b45f325fbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:53.696887 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ae251c-4ecf-47b1-a431-72b45f325fbd None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:53.714406 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 422/829] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:00:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:53.720498 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145847f-0174-4347-a812-b9567396cba3 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:53.828655 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145847f-0174-4347-a812-b9567396cba3 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:53.863173 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8d298c-f0ec-44b6-9b34-3a4bbd3cb660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:53.863974 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d298c-f0ec-44b6-9b34-3a4bbd3cb660 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:53.864281 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d298c-f0ec-44b6-9b34-3a4bbd3cb660 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:53.864636 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d298c-f0ec-44b6-9b34-3a4bbd3cb660 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:53.871547 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8d298c-f0ec-44b6-9b34-3a4bbd3cb660 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:53.873014 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8d298c-f0ec-44b6-9b34-3a4bbd3cb660 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:53.886948 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-1a8d298c-f0ec-44b6-9b34-3a4bbd3cb660 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:00:53.886948 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:53.886948 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:53.886948 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:53.886948 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:53.886948 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:53.886948 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:53.886948 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:53.886948 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:53.886948 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:53.886948 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:53.886948 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:53.886948 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:00:53.886948 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:00:53.886948 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:00:53.889150 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:00:53.889150 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:53.889150 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:53.889150 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:53.889150 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:53.889150 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:53.889150 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:53.889150 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:53.889150 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:53.889150 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:53.889150 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:53.889150 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:53.889150 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:53.889150 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:53.889150 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:53.889150 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:53.889150 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:53.891236 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:00:53.891236 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:00:53.891236 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:00:53.891236 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:00:53.891236 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:00:53.891236 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:00:53.891236 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:00:53.891236 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:53.891236 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 408/830] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 10 03:00:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:53.901509 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae251c-4ecf-47b1-a431-72b45f325fbd None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:54.015954 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae251c-4ecf-47b1-a431-72b45f325fbd None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:54.060183 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b092a974-103e-4873-a383-ea43b5d46a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:54.061112 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092a974-103e-4873-a383-ea43b5d46a76 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:54.061548 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092a974-103e-4873-a383-ea43b5d46a76 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:54.061997 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092a974-103e-4873-a383-ea43b5d46a76 None admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:54.063123 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b092a974-103e-4873-a383-ea43b5d46a76 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:54.063585 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b092a974-103e-4873-a383-ea43b5d46a76 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:54.065230 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b092a974-103e-4873-a383-ea43b5d46a76 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:54.079155 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 423/831] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 10 03:00:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:54.086467 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8d298c-f0ec-44b6-9b34-3a4bbd3cb660 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:54.194273 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8d298c-f0ec-44b6-9b34-3a4bbd3cb660 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:54.233718 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e8ff6-dfcd-453f-955b-aeb9d20eac69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:54.234901 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e8ff6-dfcd-453f-955b-aeb9d20eac69 None admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:54.235350 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e8ff6-dfcd-453f-955b-aeb9d20eac69 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:54.235775 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e8ff6-dfcd-453f-955b-aeb9d20eac69 None admin] PATH_INFO: `/v3/projects/513e6592cd83457b8ff461b0e5e1fd40/users/6ebfab3ff0b24f4aaabb8c6bb0ad10c6/roles/9a5640186d0940658e691be68ccf9205` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:54.251604 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3e8ff6-dfcd-453f-955b-aeb9d20eac69 None admin] RBAC: Authorizing `identity:create_grant(project_id=513e6592cd83457b8ff461b0e5e1fd40, user_id=6ebfab3ff0b24f4aaabb8c6bb0ad10c6, role_id=9a5640186d0940658e691be68ccf9205)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:54.253364 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3e8ff6-dfcd-453f-955b-aeb9d20eac69 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:54.325296 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 409/832] 10.222.0.65 () {58 vars in 1439 bytes} [Tue May 10 03:00:54 2022] PUT /identity/v3/projects/513e6592cd83457b8ff461b0e5e1fd40/users/6ebfab3ff0b24f4aaabb8c6bb0ad10c6/roles/9a5640186d0940658e691be68ccf9205 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:00:54.392280 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae6d63-7c91-47a2-a22e-6c22e840cf49 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:54.392574 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae6d63-7c91-47a2-a22e-6c22e840cf49 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:54.392858 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae6d63-7c91-47a2-a22e-6c22e840cf49 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:54.394598 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 424/833] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:00:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:54.400630 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aadc757-8542-48a6-b930-9e5de1271ca0 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:54.400916 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aadc757-8542-48a6-b930-9e5de1271ca0 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:54.401198 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aadc757-8542-48a6-b930-9e5de1271ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:54.419500 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-3aadc757-8542-48a6-b930-9e5de1271ca0 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:54.421012 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-3aadc757-8542-48a6-b930-9e5de1271ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:54.503407 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 410/834] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:00:54 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:00:54.527701 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ae6d63-7c91-47a2-a22e-6c22e840cf49 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:54.635336 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ae6d63-7c91-47a2-a22e-6c22e840cf49 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:54.668802 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd757a02-c29d-4caf-aca7-2f4b560642ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:54.669597 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd757a02-c29d-4caf-aca7-2f4b560642ce None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:54.669879 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd757a02-c29d-4caf-aca7-2f4b560642ce None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:54.670153 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd757a02-c29d-4caf-aca7-2f4b560642ce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:54.680856 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd757a02-c29d-4caf-aca7-2f4b560642ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:54.688515 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-fd757a02-c29d-4caf-aca7-2f4b560642ce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:00:54.688515 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:54.688515 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:54.688515 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:54.688515 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:54.688515 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:54.688515 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:54.688515 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:54.688515 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:54.688515 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:54.688515 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:54.688515 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:54.688515 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:54.688515 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:54.688515 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:54.688515 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:54.689445 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:54.689445 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:54.689445 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:54.689445 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:54.689445 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:54.689445 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:54.689445 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:54.689445 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:54.689445 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:54.689445 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:54.689445 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:54.689445 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:54.689445 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:54.689445 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:54.689445 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:54.689445 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:54.690270 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:54.690270 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:54.690270 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:54.690270 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:54.690270 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:54.690270 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:54.690270 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:54.690270 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:54.690270 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:54.690270 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:54.690270 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:00:54.690270 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:54.690270 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 425/835] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 10 03:00:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:54.695754 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aadc757-8542-48a6-b930-9e5de1271ca0 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:54.723112 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b756b-b8a5-42bd-9371-af6f0aa5e770 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:54.723440 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b756b-b8a5-42bd-9371-af6f0aa5e770 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:54.723679 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b756b-b8a5-42bd-9371-af6f0aa5e770 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:54.725965 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 426/836] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:00:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:00:54.730791 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcdd6ad-7be0-404e-9eab-949209d81b44 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:54.731080 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcdd6ad-7be0-404e-9eab-949209d81b44 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:54.731420 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcdd6ad-7be0-404e-9eab-949209d81b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:54.754082 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-8dcdd6ad-7be0-404e-9eab-949209d81b44 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:54.755823 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-8dcdd6ad-7be0-404e-9eab-949209d81b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:54.803767 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aadc757-8542-48a6-b930-9e5de1271ca0 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:54.838378 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc4db11-b5f1-4313-8570-bf662b0df136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:54.839423 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4db11-b5f1-4313-8570-bf662b0df136 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:54.839915 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4db11-b5f1-4313-8570-bf662b0df136 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:54.840422 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4db11-b5f1-4313-8570-bf662b0df136 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:54.841433 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc4db11-b5f1-4313-8570-bf662b0df136 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:54.842004 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc4db11-b5f1-4313-8570-bf662b0df136 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:54.843093 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 427/837] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:00:54 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:00:54.844724 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc4db11-b5f1-4313-8570-bf662b0df136 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:54.854342 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 411/838] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 10 03:00:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:54.862141 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcdd6ad-7be0-404e-9eab-949209d81b44 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:54.866320 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc4db11-b5f1-4313-8570-bf662b0df136 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:54.959132 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcdd6ad-7be0-404e-9eab-949209d81b44 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:54.973123 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc4db11-b5f1-4313-8570-bf662b0df136 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:54.997664 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e42d0-9221-4217-93cd-75338d97351a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:54.998729 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e42d0-9221-4217-93cd-75338d97351a None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:54.999162 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e42d0-9221-4217-93cd-75338d97351a None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:54.999581 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e42d0-9221-4217-93cd-75338d97351a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:55.008208 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abccc13-089a-41bd-b3aa-94e5755b7545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:55.009154 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abccc13-089a-41bd-b3aa-94e5755b7545 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:55.009531 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abccc13-089a-41bd-b3aa-94e5755b7545 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:55.009901 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abccc13-089a-41bd-b3aa-94e5755b7545 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:55.010651 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abccc13-089a-41bd-b3aa-94e5755b7545 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:55.010916 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e42d0-9221-4217-93cd-75338d97351a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:55.012409 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abccc13-089a-41bd-b3aa-94e5755b7545 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:55.012702 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e42d0-9221-4217-93cd-75338d97351a None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:55.025204 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-1abccc13-089a-41bd-b3aa-94e5755b7545 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 03:00:55.025204 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:55.025204 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 03:00:55.025204 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 03:00:55.025204 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 03:00:55.025204 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 03:00:55.025204 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 03:00:55.025204 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:00:55.025204 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 03:00:55.025204 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:55.025204 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 03:00:55.025204 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:55.025204 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:55.025204 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:55.025204 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:55.025204 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:55.025204 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:55.026279 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:55.026279 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:55.026279 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:55.026279 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:55.026279 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:55.026279 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:55.026279 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 03:00:55.026279 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 03:00:55.026279 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 03:00:55.026279 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 03:00:55.026279 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:55.026279 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:55.026279 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:55.026279 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:55.026279 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:55.026279 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:55.027310 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:55.027310 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:55.027310 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:55.027310 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:55.027310 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:55.027310 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:55.027310 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:55.027310 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:55.027310 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:55.027310 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:55.027310 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 03:00:55.027310 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:00:55.027310 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 03:00:55.027310 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:55.027310 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 412/839] 10.222.0.65 () {56 vars in 1114 bytes} [Tue May 10 03:00:54 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:00:55.033412 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abccc13-089a-41bd-b3aa-94e5755b7545 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:55.034914 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-fd8e42d0-9221-4217-93cd-75338d97351a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:55.034914 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:55.034914 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:55.034914 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:55.034914 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:55.034914 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:55.034914 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:55.034914 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:55.034914 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:55.034914 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:55.034914 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:55.034914 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:55.034914 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:00:55.034914 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:00:55.034914 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:00:55.035858 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:00:55.035858 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:55.035858 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:55.035858 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:55.035858 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:55.035858 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:55.035858 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:55.035858 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:55.035858 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:55.035858 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:55.035858 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:55.035858 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:55.035858 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:55.035858 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:55.035858 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:55.035858 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:55.035858 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:55.039790 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:00:55.039790 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:00:55.039790 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:55.039790 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:55.039790 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 428/840] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:00:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:55.045006 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e42d0-9221-4217-93cd-75338d97351a None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:55.138562 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abccc13-089a-41bd-b3aa-94e5755b7545 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:55.172662 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77402c66-20c5-42be-aaf1-d786bb8dc5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:55.173694 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77402c66-20c5-42be-aaf1-d786bb8dc5a9 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:55.173822 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e42d0-9221-4217-93cd-75338d97351a None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:55.174238 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77402c66-20c5-42be-aaf1-d786bb8dc5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:55.174649 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77402c66-20c5-42be-aaf1-d786bb8dc5a9 None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:55.175486 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77402c66-20c5-42be-aaf1-d786bb8dc5a9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:55.175928 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77402c66-20c5-42be-aaf1-d786bb8dc5a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:55.177497 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77402c66-20c5-42be-aaf1-d786bb8dc5a9 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:55.183993 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 413/841] 10.222.0.65 () {56 vars in 1114 bytes} [Tue May 10 03:00:55 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:55.190705 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77402c66-20c5-42be-aaf1-d786bb8dc5a9 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:55.225222 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f59cc-8f45-4b95-aefd-dc94bace1c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:55.226434 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f59cc-8f45-4b95-aefd-dc94bace1c1d None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:55.227247 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f59cc-8f45-4b95-aefd-dc94bace1c1d None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:55.228023 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f59cc-8f45-4b95-aefd-dc94bace1c1d None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:55.229141 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3f59cc-8f45-4b95-aefd-dc94bace1c1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:55.229976 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3f59cc-8f45-4b95-aefd-dc94bace1c1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:55.231894 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3f59cc-8f45-4b95-aefd-dc94bace1c1d None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:55.248562 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 429/842] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:00:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:55.257252 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f59cc-8f45-4b95-aefd-dc94bace1c1d None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:55.321237 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77402c66-20c5-42be-aaf1-d786bb8dc5a9 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:55.362918 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee4eb01-aa0d-4a68-8bd6-c1b869fdb2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:55.365859 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4eb01-aa0d-4a68-8bd6-c1b869fdb2d9 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:55.366144 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4eb01-aa0d-4a68-8bd6-c1b869fdb2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:55.366423 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4eb01-aa0d-4a68-8bd6-c1b869fdb2d9 None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:55.367160 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee4eb01-aa0d-4a68-8bd6-c1b869fdb2d9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:55.367470 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee4eb01-aa0d-4a68-8bd6-c1b869fdb2d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:55.368993 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee4eb01-aa0d-4a68-8bd6-c1b869fdb2d9 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:55.371887 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f59cc-8f45-4b95-aefd-dc94bace1c1d None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:55.374252 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 414/843] 10.222.0.65 () {56 vars in 1114 bytes} [Tue May 10 03:00:55 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:55.415922 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce617c-2ddb-4f63-b68f-75c4fa166777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:55.417031 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce617c-2ddb-4f63-b68f-75c4fa166777 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:55.417494 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce617c-2ddb-4f63-b68f-75c4fa166777 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:55.417918 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce617c-2ddb-4f63-b68f-75c4fa166777 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:55.426497 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce617c-2ddb-4f63-b68f-75c4fa166777 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:55.428333 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce617c-2ddb-4f63-b68f-75c4fa166777 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:55.445530 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-4bce617c-2ddb-4f63-b68f-75c4fa166777 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 03:00:55.445530 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:55.445530 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:55.445530 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:55.445530 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:55.445530 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:55.445530 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:55.445530 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:55.445530 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:55.445530 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:55.445530 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:55.445530 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:55.445530 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:00:55.445530 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:00:55.445530 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:00:55.445530 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:00:55.446545 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:55.446545 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:55.446545 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:00:55.446545 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:00:55.446545 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:00:55.446545 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:00:55.446545 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:55.446545 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:55.446545 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:55.446545 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:55.446545 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:55.446545 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:55.446545 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:55.446545 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:55.446545 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:55.446545 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:55.446545 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:55.446545 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:55.447488 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:55.447488 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:55.447488 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:00:55.447488 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:00:55.447488 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:00:55.447488 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:00:55.447488 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:00:55.447488 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:00:55.447488 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 03:00:55.447488 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:55.454321 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 430/844] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 10 03:00:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:00:55.455988 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee4eb01-aa0d-4a68-8bd6-c1b869fdb2d9 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:55.556999 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b209f-fa07-40e5-b1ef-87f4d9a44979 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:55.557510 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b209f-fa07-40e5-b1ef-87f4d9a44979 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:55.557958 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b209f-fa07-40e5-b1ef-87f4d9a44979 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:55.560973 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 431/845] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:00:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:00:55.565536 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb22ef-95a7-4ade-afa5-b00216c8ecf3 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:55.566020 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb22ef-95a7-4ade-afa5-b00216c8ecf3 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:55.566447 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb22ef-95a7-4ade-afa5-b00216c8ecf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:55.586800 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-cacb22ef-95a7-4ade-afa5-b00216c8ecf3 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:55.588253 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-cacb22ef-95a7-4ade-afa5-b00216c8ecf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:55.590690 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee4eb01-aa0d-4a68-8bd6-c1b869fdb2d9 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:55.629907 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfcccb4-001f-4c99-99bd-cf38fc5bc820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:55.631965 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfcccb4-001f-4c99-99bd-cf38fc5bc820 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:55.632283 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfcccb4-001f-4c99-99bd-cf38fc5bc820 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:55.632565 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfcccb4-001f-4c99-99bd-cf38fc5bc820 None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:55.633427 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfcccb4-001f-4c99-99bd-cf38fc5bc820 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:55.633768 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfcccb4-001f-4c99-99bd-cf38fc5bc820 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:55.636479 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfcccb4-001f-4c99-99bd-cf38fc5bc820 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:55.668131 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 415/846] 10.222.0.65 () {56 vars in 1135 bytes} [Tue May 10 03:00:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:55.669848 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfcccb4-001f-4c99-99bd-cf38fc5bc820 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:55.679929 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 432/847] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:00:55 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 03:00:55.703992 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb22ef-95a7-4ade-afa5-b00216c8ecf3 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:55.790735 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfcccb4-001f-4c99-99bd-cf38fc5bc820 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:55.810822 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb22ef-95a7-4ade-afa5-b00216c8ecf3 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:55.829754 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae56c553-5471-4945-a0d1-b7774e3ca430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:55.830941 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56c553-5471-4945-a0d1-b7774e3ca430 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:55.831308 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56c553-5471-4945-a0d1-b7774e3ca430 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:55.831644 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56c553-5471-4945-a0d1-b7774e3ca430 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:55.848497 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31494adb-77b7-48f0-b42e-b9dda4344af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:55.849571 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31494adb-77b7-48f0-b42e-b9dda4344af5 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:55.850385 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31494adb-77b7-48f0-b42e-b9dda4344af5 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:55.850814 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31494adb-77b7-48f0-b42e-b9dda4344af5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:55.851924 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31494adb-77b7-48f0-b42e-b9dda4344af5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:55.853587 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31494adb-77b7-48f0-b42e-b9dda4344af5 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:55.869782 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-31494adb-77b7-48f0-b42e-b9dda4344af5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 03:00:55.869782 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:55.869782 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 03:00:55.869782 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 03:00:55.869782 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 03:00:55.869782 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 03:00:55.869782 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 03:00:55.869782 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:00:55.869782 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 03:00:55.869782 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:55.869782 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 03:00:55.869782 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:55.869782 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:55.869782 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:55.869782 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:55.869782 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:55.870885 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:55.870885 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:55.870885 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:55.870885 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:55.870885 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:55.870885 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:55.870885 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:55.870885 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 03:00:55.870885 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 03:00:55.870885 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 03:00:55.870885 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 03:00:55.870885 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:55.870885 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:55.870885 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:55.870885 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:55.870885 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:55.871829 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:55.871829 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:55.871829 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:55.871829 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:55.871829 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:55.871829 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:55.871829 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:55.871829 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:55.871829 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:55.871829 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:55.871829 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:55.871829 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 03:00:55.871829 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:00:55.871829 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 03:00:55.871829 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:55.880829 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 433/848] 10.222.0.65 () {56 vars in 1132 bytes} [Tue May 10 03:00:55 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:55.882400 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31494adb-77b7-48f0-b42e-b9dda4344af5 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:55.913247 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae56c553-5471-4945-a0d1-b7774e3ca430 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:55.915414 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae56c553-5471-4945-a0d1-b7774e3ca430 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:55.990283 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31494adb-77b7-48f0-b42e-b9dda4344af5 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:56.032821 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 416/849] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 10 03:00:55 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 03:00:56.033016 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f58c180-9ded-48de-afc1-81b71a8efba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:56.033722 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58c180-9ded-48de-afc1-81b71a8efba5 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:56.034192 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58c180-9ded-48de-afc1-81b71a8efba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:56.034688 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58c180-9ded-48de-afc1-81b71a8efba5 None admin] PATH_INFO: `/v3/services` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:56.035310 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae56c553-5471-4945-a0d1-b7774e3ca430 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:56.035899 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f58c180-9ded-48de-afc1-81b71a8efba5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:56.036368 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f58c180-9ded-48de-afc1-81b71a8efba5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:56.038659 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f58c180-9ded-48de-afc1-81b71a8efba5 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:56.045085 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 434/850] 10.222.0.65 () {56 vars in 1126 bytes} [Tue May 10 03:00:55 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:56.054640 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f58c180-9ded-48de-afc1-81b71a8efba5 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:56.185499 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae56c553-5471-4945-a0d1-b7774e3ca430 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:56.186431 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f58c180-9ded-48de-afc1-81b71a8efba5 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:56.221170 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd8054b-46a1-47e1-a044-80a1ef0b85a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:56.222016 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8054b-46a1-47e1-a044-80a1ef0b85a9 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:56.222403 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8054b-46a1-47e1-a044-80a1ef0b85a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:56.222787 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8054b-46a1-47e1-a044-80a1ef0b85a9 None admin] PATH_INFO: `/v3/services` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:56.223620 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd8054b-46a1-47e1-a044-80a1ef0b85a9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:56.224602 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd8054b-46a1-47e1-a044-80a1ef0b85a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:56.226022 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c96bdc-3341-4678-a385-e0f0dfb42261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:56.226169 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd8054b-46a1-47e1-a044-80a1ef0b85a9 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:56.227092 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c96bdc-3341-4678-a385-e0f0dfb42261 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:56.227524 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c96bdc-3341-4678-a385-e0f0dfb42261 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:56.227953 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c96bdc-3341-4678-a385-e0f0dfb42261 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:56.239166 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c96bdc-3341-4678-a385-e0f0dfb42261 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:56.240378 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 435/851] 10.222.0.65 () {56 vars in 1126 bytes} [Tue May 10 03:00:56 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:56.242289 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c96bdc-3341-4678-a385-e0f0dfb42261 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:56.262806 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-b3c96bdc-3341-4678-a385-e0f0dfb42261 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:56.262806 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:56.262806 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:56.262806 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:56.262806 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:56.262806 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:56.262806 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:56.262806 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:56.262806 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:56.262806 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:56.262806 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:56.262806 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:56.262806 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:00:56.262806 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:00:56.262806 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:00:56.263779 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:00:56.263779 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:56.263779 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:56.263779 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:56.263779 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:56.263779 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:56.263779 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:56.263779 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:56.263779 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:56.263779 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:56.263779 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:56.263779 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:56.263779 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:56.263779 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:56.263779 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:56.263779 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:56.263779 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:56.264691 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:00:56.264691 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:00:56.264691 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:56.264691 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:56.271745 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 417/852] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:00:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:56.273504 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd8054b-46a1-47e1-a044-80a1ef0b85a9 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:56.381765 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd8054b-46a1-47e1-a044-80a1ef0b85a9 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:56.417573 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c32d6-a555-4069-9050-5a91c6376c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:56.418663 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c32d6-a555-4069-9050-5a91c6376c58 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:56.419128 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c32d6-a555-4069-9050-5a91c6376c58 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:56.419614 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c32d6-a555-4069-9050-5a91c6376c58 None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:56.420563 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814c32d6-a555-4069-9050-5a91c6376c58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:56.421052 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814c32d6-a555-4069-9050-5a91c6376c58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:56.422617 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814c32d6-a555-4069-9050-5a91c6376c58 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:56.440190 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 436/853] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:00:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:56.443858 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c96bdc-3341-4678-a385-e0f0dfb42261 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:56.551101 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c96bdc-3341-4678-a385-e0f0dfb42261 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:56.586721 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deb9fd1-db13-4ecf-a364-47cb0d347f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:56.587909 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb9fd1-db13-4ecf-a364-47cb0d347f48 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:56.588412 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb9fd1-db13-4ecf-a364-47cb0d347f48 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:56.588873 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb9fd1-db13-4ecf-a364-47cb0d347f48 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:56.597140 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deb9fd1-db13-4ecf-a364-47cb0d347f48 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:56.599010 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deb9fd1-db13-4ecf-a364-47cb0d347f48 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:56.613790 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-5deb9fd1-db13-4ecf-a364-47cb0d347f48 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:00:56.613790 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:56.613790 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:56.613790 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:56.613790 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:56.613790 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:56.613790 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:56.613790 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:56.613790 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:56.613790 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:56.613790 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:56.613790 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:56.613790 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:00:56.613790 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:00:56.613790 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:00:56.615259 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:00:56.615259 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:56.615259 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:56.615259 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:56.615259 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:56.615259 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:56.615259 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:56.615259 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:56.615259 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:56.615259 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:56.615259 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:56.615259 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:56.615259 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:56.615259 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:56.615259 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:56.615259 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:56.615259 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:56.616175 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:00:56.616175 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:00:56.616175 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:00:56.616175 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:00:56.616175 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:00:56.616175 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:00:56.616175 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:00:56.616175 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:56.617999 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 418/854] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 10 03:00:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:00:56.623915 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c32d6-a555-4069-9050-5a91c6376c58 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:56.694843 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744cf576-ef60-43b1-af64-b89e6c6aa5a9 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:56.695060 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744cf576-ef60-43b1-af64-b89e6c6aa5a9 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:56.695349 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744cf576-ef60-43b1-af64-b89e6c6aa5a9 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:56.697087 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 419/855] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:00:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:00:56.706223 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898dd341-a36c-4fa0-9bfc-0c01a150a7f7 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:56.706223 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898dd341-a36c-4fa0-9bfc-0c01a150a7f7 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:56.706223 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898dd341-a36c-4fa0-9bfc-0c01a150a7f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:56.722973 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-898dd341-a36c-4fa0-9bfc-0c01a150a7f7 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:56.724221 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-898dd341-a36c-4fa0-9bfc-0c01a150a7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:56.728778 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c32d6-a555-4069-9050-5a91c6376c58 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:56.763923 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a07db-0a40-45ab-bb0f-c1e62bd4ca89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:56.764862 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a07db-0a40-45ab-bb0f-c1e62bd4ca89 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:56.765295 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a07db-0a40-45ab-bb0f-c1e62bd4ca89 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:56.765752 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a07db-0a40-45ab-bb0f-c1e62bd4ca89 None admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:56.766692 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8a07db-0a40-45ab-bb0f-c1e62bd4ca89 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:56.767149 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8a07db-0a40-45ab-bb0f-c1e62bd4ca89 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:56.768751 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8a07db-0a40-45ab-bb0f-c1e62bd4ca89 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:56.785810 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 437/856] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 10 03:00:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:56.787331 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a07db-0a40-45ab-bb0f-c1e62bd4ca89 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:56.793249 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 420/857] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:00:56 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:00:56.816628 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898dd341-a36c-4fa0-9bfc-0c01a150a7f7 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:56.900335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a07db-0a40-45ab-bb0f-c1e62bd4ca89 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:56.923741 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898dd341-a36c-4fa0-9bfc-0c01a150a7f7 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:56.947401 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7660bd90-6069-47bc-a162-e68d7ad3c26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:56.948947 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7660bd90-6069-47bc-a162-e68d7ad3c26d None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:56.949442 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7660bd90-6069-47bc-a162-e68d7ad3c26d None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:56.950164 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7660bd90-6069-47bc-a162-e68d7ad3c26d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:56.951366 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7660bd90-6069-47bc-a162-e68d7ad3c26d None admin] RBAC: Adding query filter params (role.id=43105000610f402ca2486e7648018cca, scope.project.id=513e6592cd83457b8ff461b0e5e1fd40, user.id=f1cb8ad43a234233ad602f451f0f8ebf) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:56.952239 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7660bd90-6069-47bc-a162-e68d7ad3c26d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:56.954299 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7660bd90-6069-47bc-a162-e68d7ad3c26d None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:56.961786 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 438/858] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 10 03:00:56 2022] GET /identity/v3/role_assignments?user.id=f1cb8ad43a234233ad602f451f0f8ebf&scope.project.id=513e6592cd83457b8ff461b0e5e1fd40&role.id=43105000610f402ca2486e7648018cca => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:56.962857 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4300df-6028-4c30-bfc2-ee801abfd26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:56.963657 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4300df-6028-4c30-bfc2-ee801abfd26b None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:56.963939 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4300df-6028-4c30-bfc2-ee801abfd26b None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:56.964260 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4300df-6028-4c30-bfc2-ee801abfd26b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:56.983096 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4300df-6028-4c30-bfc2-ee801abfd26b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:00:56.991942 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-da4300df-6028-4c30-bfc2-ee801abfd26b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 03:00:56.991942 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:56.991942 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:56.991942 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:56.991942 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:56.991942 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:56.991942 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:56.991942 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:56.991942 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:56.991942 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:56.991942 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:56.991942 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:56.991942 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:00:56.991942 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:00:56.991942 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:00:56.991942 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:00:57.003246 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:00:57.003246 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:00:57.003246 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:00:57.003246 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:00:57.003246 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:57.003246 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:57.003246 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:57.003246 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:57.003246 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:57.003246 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:57.003246 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:57.003246 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:57.003246 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:57.003246 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:57.003246 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:57.003246 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:57.004105 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:57.004105 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:57.004105 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:57.004105 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:57.004105 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:00:57.004105 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:00:57.004105 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:00:57.004105 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:00:57.004105 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:00:57.004105 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:00:57.004105 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 03:00:57.004105 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:57.004105 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 421/859] 10.222.0.65 () {56 vars in 1102 bytes} [Tue May 10 03:00:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:00:57.004806 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7660bd90-6069-47bc-a162-e68d7ad3c26d None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:57.112936 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7660bd90-6069-47bc-a162-e68d7ad3c26d None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:57.149233 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89686ded-8edf-44b3-82d3-014c41c6b379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:57.149911 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89686ded-8edf-44b3-82d3-014c41c6b379 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:57.150199 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89686ded-8edf-44b3-82d3-014c41c6b379 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:57.150480 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89686ded-8edf-44b3-82d3-014c41c6b379 None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:57.151242 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89686ded-8edf-44b3-82d3-014c41c6b379 None admin] RBAC: Adding query filter params (name=service) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:57.151551 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89686ded-8edf-44b3-82d3-014c41c6b379 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:57.152945 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89686ded-8edf-44b3-82d3-014c41c6b379 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:57.162386 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 439/860] 10.222.0.65 () {56 vars in 1103 bytes} [Tue May 10 03:00:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:57.168079 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4300df-6028-4c30-bfc2-ee801abfd26b None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:57.273426 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4300df-6028-4c30-bfc2-ee801abfd26b None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:57.312203 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc147d4a-e7db-4c11-9fec-783ce6092fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:57.313005 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc147d4a-e7db-4c11-9fec-783ce6092fde None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:57.313285 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc147d4a-e7db-4c11-9fec-783ce6092fde None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:57.313556 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc147d4a-e7db-4c11-9fec-783ce6092fde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:57.324079 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc147d4a-e7db-4c11-9fec-783ce6092fde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:57.325520 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc147d4a-e7db-4c11-9fec-783ce6092fde None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:57.342820 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-bc147d4a-e7db-4c11-9fec-783ce6092fde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:57.342820 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:57.342820 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:57.342820 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:57.342820 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:57.342820 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:57.342820 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:57.342820 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:57.342820 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:57.342820 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:57.342820 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:57.342820 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:57.342820 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:00:57.342820 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:00:57.342820 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:00:57.344894 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:00:57.344894 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:57.344894 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:57.344894 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:57.344894 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:57.344894 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:57.344894 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:57.344894 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:57.344894 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:57.344894 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:57.344894 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:57.344894 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:57.344894 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:57.344894 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:57.344894 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:57.344894 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:57.344894 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:57.347019 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:00:57.347019 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:00:57.347019 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:57.347019 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:57.349397 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 422/861] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:00:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:57.350654 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89686ded-8edf-44b3-82d3-014c41c6b379 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:57.460030 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89686ded-8edf-44b3-82d3-014c41c6b379 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:57.490071 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a360762-3951-4adc-996a-dc2fe1c32bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:57.490750 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a360762-3951-4adc-996a-dc2fe1c32bfd None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:57.491029 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a360762-3951-4adc-996a-dc2fe1c32bfd None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:57.491300 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a360762-3951-4adc-996a-dc2fe1c32bfd None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:57.492058 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a360762-3951-4adc-996a-dc2fe1c32bfd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:57.492412 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a360762-3951-4adc-996a-dc2fe1c32bfd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:57.493883 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a360762-3951-4adc-996a-dc2fe1c32bfd None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:57.511863 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 440/862] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:00:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:57.513305 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc147d4a-e7db-4c11-9fec-783ce6092fde None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:57.618584 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc147d4a-e7db-4c11-9fec-783ce6092fde None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:57.651864 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd7f66b-455c-4aab-bd4b-8df9a90c3bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:57.652711 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7f66b-455c-4aab-bd4b-8df9a90c3bd8 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:57.652989 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7f66b-455c-4aab-bd4b-8df9a90c3bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:57.653257 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7f66b-455c-4aab-bd4b-8df9a90c3bd8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:57.661032 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd7f66b-455c-4aab-bd4b-8df9a90c3bd8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:57.663025 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd7f66b-455c-4aab-bd4b-8df9a90c3bd8 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:57.677366 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-2dd7f66b-455c-4aab-bd4b-8df9a90c3bd8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 03:00:57.677366 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:57.677366 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:57.677366 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:57.677366 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:57.677366 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:57.677366 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:57.677366 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:57.677366 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:57.677366 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:57.677366 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:57.677366 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:57.677366 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:00:57.677366 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:00:57.677366 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:00:57.677366 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:00:57.678364 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:57.678364 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:57.678364 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:00:57.678364 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:00:57.678364 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:00:57.678364 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:00:57.678364 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:57.678364 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:57.678364 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:57.678364 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:57.678364 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:57.678364 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:57.678364 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:57.678364 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:57.678364 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:57.678364 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:57.678364 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:57.678364 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:57.679309 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:57.679309 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:57.679309 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:00:57.679309 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:00:57.679309 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:00:57.679309 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:00:57.679309 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:00:57.679309 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:00:57.679309 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 03:00:57.679309 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:57.683109 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 423/863] 10.222.0.65 () {56 vars in 1117 bytes} [Tue May 10 03:00:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:57.684472 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a360762-3951-4adc-996a-dc2fe1c32bfd None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:57.739107 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffccba53-8064-48e0-8946-6aebc22f8add None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:57.739461 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffccba53-8064-48e0-8946-6aebc22f8add None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:57.739719 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffccba53-8064-48e0-8946-6aebc22f8add None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:57.741096 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 424/864] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:00:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:57.746115 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ed6c5-d3d1-4847-92de-21a1374356e3 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:57.746406 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ed6c5-d3d1-4847-92de-21a1374356e3 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:57.746684 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ed6c5-d3d1-4847-92de-21a1374356e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:57.768415 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-de7ed6c5-d3d1-4847-92de-21a1374356e3 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:57.769981 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-de7ed6c5-d3d1-4847-92de-21a1374356e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:57.793711 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a360762-3951-4adc-996a-dc2fe1c32bfd None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:57.831604 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95676d66-a8c4-4118-b427-14ca5170e898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:57.832319 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95676d66-a8c4-4118-b427-14ca5170e898 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:57.832749 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95676d66-a8c4-4118-b427-14ca5170e898 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:57.833583 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95676d66-a8c4-4118-b427-14ca5170e898 None admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:57.834809 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95676d66-a8c4-4118-b427-14ca5170e898 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:57.835392 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95676d66-a8c4-4118-b427-14ca5170e898 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:57.837005 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95676d66-a8c4-4118-b427-14ca5170e898 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:57.857218 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 425/865] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:00:57 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 03:00:57.857556 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 441/866] 10.222.0.65 () {56 vars in 1149 bytes} [Tue May 10 03:00:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:57.862664 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7ed6c5-d3d1-4847-92de-21a1374356e3 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:57.880483 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95676d66-a8c4-4118-b427-14ca5170e898 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:57.983242 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95676d66-a8c4-4118-b427-14ca5170e898 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:57.991972 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7ed6c5-d3d1-4847-92de-21a1374356e3 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:58.018952 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f7424b-d328-4994-a91c-7b3e4b03f112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:58.019623 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7424b-d328-4994-a91c-7b3e4b03f112 None admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:58.019909 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7424b-d328-4994-a91c-7b3e4b03f112 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:58.020228 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7424b-d328-4994-a91c-7b3e4b03f112 None admin] PATH_INFO: `/v3/services` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:58.021652 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f7424b-d328-4994-a91c-7b3e4b03f112 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:58.022963 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f7424b-d328-4994-a91c-7b3e4b03f112 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:58.036746 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0fd7a1-6753-43f8-900c-d84d008269d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:58.037751 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0fd7a1-6753-43f8-900c-d84d008269d3 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:58.038267 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0fd7a1-6753-43f8-900c-d84d008269d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:58.038756 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0fd7a1-6753-43f8-900c-d84d008269d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:58.116068 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 442/867] 10.222.0.65 () {60 vars in 1141 bytes} [Tue May 10 03:00:57 2022] POST /identity/v3/services => generated 251 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:00:58.129016 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0fd7a1-6753-43f8-900c-d84d008269d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:58.131724 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0fd7a1-6753-43f8-900c-d84d008269d3 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:58.244575 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 426/868] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 10 03:00:57 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 10 03:00:58.250731 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f7424b-d328-4994-a91c-7b3e4b03f112 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:58.371762 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f7424b-d328-4994-a91c-7b3e4b03f112 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:58.405161 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf379b-0b20-4274-97bf-fd40d6790c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:58.405873 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf379b-0b20-4274-97bf-fd40d6790c72 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:58.406149 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf379b-0b20-4274-97bf-fd40d6790c72 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:58.406417 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf379b-0b20-4274-97bf-fd40d6790c72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:58.417446 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdf379b-0b20-4274-97bf-fd40d6790c72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:58.418873 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdf379b-0b20-4274-97bf-fd40d6790c72 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:58.436151 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-7cdf379b-0b20-4274-97bf-fd40d6790c72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:58.436151 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:58.436151 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:58.436151 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:58.436151 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:58.436151 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:58.436151 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:58.436151 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:58.436151 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:58.436151 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:58.436151 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:58.436151 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:58.436151 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:00:58.436151 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:00:58.436151 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:00:58.437176 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:00:58.437176 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:58.437176 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:58.437176 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:58.437176 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:58.437176 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:58.437176 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:58.437176 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:58.437176 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:58.437176 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:58.437176 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:58.437176 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:58.437176 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:58.437176 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:58.437176 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:58.437176 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:58.437176 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:58.438159 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:00:58.438159 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:00:58.438159 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:00:58.438159 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:58.438159 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 443/869] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:00:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:58.444759 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0fd7a1-6753-43f8-900c-d84d008269d3 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:58.550769 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0fd7a1-6753-43f8-900c-d84d008269d3 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:58.585332 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7be8e4-ee40-4d0b-accf-a9a70d2be269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:58.586371 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7be8e4-ee40-4d0b-accf-a9a70d2be269 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:58.586862 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7be8e4-ee40-4d0b-accf-a9a70d2be269 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:58.587343 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7be8e4-ee40-4d0b-accf-a9a70d2be269 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:58.588304 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7be8e4-ee40-4d0b-accf-a9a70d2be269 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:58.588827 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7be8e4-ee40-4d0b-accf-a9a70d2be269 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:58.590438 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7be8e4-ee40-4d0b-accf-a9a70d2be269 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:58.605421 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 427/870] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:00:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:58.610852 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf379b-0b20-4274-97bf-fd40d6790c72 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:58.640385 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd491c1-2948-4352-bc95-1af389e077b2 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:58.640703 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd491c1-2948-4352-bc95-1af389e077b2 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:58.640952 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd491c1-2948-4352-bc95-1af389e077b2 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:58.642549 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 428/871] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:00:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:00:58.647423 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a781e2eb-eb8f-4605-a7ad-a4cad015f46a None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:58.647714 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a781e2eb-eb8f-4605-a7ad-a4cad015f46a None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:58.647997 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a781e2eb-eb8f-4605-a7ad-a4cad015f46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:58.672114 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-a781e2eb-eb8f-4605-a7ad-a4cad015f46a None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:58.672114 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-a781e2eb-eb8f-4605-a7ad-a4cad015f46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:58.718189 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf379b-0b20-4274-97bf-fd40d6790c72 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:58.760783 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a287016a-c92f-4920-8bf8-1e77c144cfff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:58.761733 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a287016a-c92f-4920-8bf8-1e77c144cfff None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:58.762117 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a287016a-c92f-4920-8bf8-1e77c144cfff None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:58.762495 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a287016a-c92f-4920-8bf8-1e77c144cfff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:58.764147 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 429/872] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:00:58 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 03:00:58.769905 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a287016a-c92f-4920-8bf8-1e77c144cfff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:58.772048 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a287016a-c92f-4920-8bf8-1e77c144cfff None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:58.779172 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a781e2eb-eb8f-4605-a7ad-a4cad015f46a None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:58.789077 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-a287016a-c92f-4920-8bf8-1e77c144cfff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:00:58.789077 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:58.789077 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:58.789077 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:58.789077 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:58.789077 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:58.789077 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:58.789077 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:58.789077 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:58.789077 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:58.789077 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:58.789077 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:58.789077 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:00:58.789077 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:00:58.789077 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:00:58.790034 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:00:58.790034 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:58.790034 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:58.790034 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:58.790034 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:58.790034 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:58.790034 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:58.790034 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:58.790034 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:00:58.790034 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:58.790034 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:58.790034 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:58.790034 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:58.790034 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:58.790034 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:58.790034 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:58.790034 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:58.790917 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:00:58.790917 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:00:58.790917 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:00:58.790917 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:00:58.790917 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:00:58.790917 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:00:58.790917 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:00:58.790917 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:00:58.791354 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 444/873] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 10 03:00:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:58.797123 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a287016a-c92f-4920-8bf8-1e77c144cfff None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:58.879634 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a781e2eb-eb8f-4605-a7ad-a4cad015f46a None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:58.902093 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a287016a-c92f-4920-8bf8-1e77c144cfff None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:58.915667 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98088d78-277c-41ea-86c5-9963bc009ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:58.916662 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98088d78-277c-41ea-86c5-9963bc009ed1 None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:58.917048 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98088d78-277c-41ea-86c5-9963bc009ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:58.917974 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98088d78-277c-41ea-86c5-9963bc009ed1 None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:58.919025 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98088d78-277c-41ea-86c5-9963bc009ed1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:58.920874 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98088d78-277c-41ea-86c5-9963bc009ed1 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:58.940105 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a999bfd-8ba5-4a8e-9863-4a54df30c0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:58.940105 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a999bfd-8ba5-4a8e-9863-4a54df30c0ed None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:58.940105 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a999bfd-8ba5-4a8e-9863-4a54df30c0ed None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:58.940105 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a999bfd-8ba5-4a8e-9863-4a54df30c0ed None admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:58.940506 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a999bfd-8ba5-4a8e-9863-4a54df30c0ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:58.940506 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a999bfd-8ba5-4a8e-9863-4a54df30c0ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:58.940971 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a999bfd-8ba5-4a8e-9863-4a54df30c0ed None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:58.953024 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 445/874] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 10 03:00:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:58.959098 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a999bfd-8ba5-4a8e-9863-4a54df30c0ed None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:59.024097 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 430/875] 10.222.0.65 () {60 vars in 1141 bytes} [Tue May 10 03:00:58 2022] POST /identity/v3/services => generated 269 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:00:59.063514 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a999bfd-8ba5-4a8e-9863-4a54df30c0ed None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:59.108978 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b7915a-5b2f-4a46-a69e-8aea1870c36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:59.109650 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b7915a-5b2f-4a46-a69e-8aea1870c36c None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:59.109934 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b7915a-5b2f-4a46-a69e-8aea1870c36c None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:59.110211 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b7915a-5b2f-4a46-a69e-8aea1870c36c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:59.111051 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b7915a-5b2f-4a46-a69e-8aea1870c36c None admin] RBAC: Adding query filter params (role.id=9a5640186d0940658e691be68ccf9205, scope.project.id=513e6592cd83457b8ff461b0e5e1fd40, user.id=6ebfab3ff0b24f4aaabb8c6bb0ad10c6) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:59.111365 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b7915a-5b2f-4a46-a69e-8aea1870c36c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:59.112862 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b7915a-5b2f-4a46-a69e-8aea1870c36c None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:59.119817 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 446/876] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 10 03:00:58 2022] GET /identity/v3/role_assignments?user.id=6ebfab3ff0b24f4aaabb8c6bb0ad10c6&scope.project.id=513e6592cd83457b8ff461b0e5e1fd40&role.id=9a5640186d0940658e691be68ccf9205 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:00:59.356435 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9accbfbd-5bae-4eb9-a361-b17caaf2428f None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:59.356777 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9accbfbd-5bae-4eb9-a361-b17caaf2428f None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:59.356952 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9accbfbd-5bae-4eb9-a361-b17caaf2428f None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:59.358562 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 431/877] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:00:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:00:59.364962 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53476536-a396-4173-a22f-89da59431951 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:59.365264 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53476536-a396-4173-a22f-89da59431951 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:59.365523 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53476536-a396-4173-a22f-89da59431951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:59.383969 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-53476536-a396-4173-a22f-89da59431951 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:00:59.385177 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-53476536-a396-4173-a22f-89da59431951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:00:59.460098 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 447/878] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:00:59 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 03:00:59.476988 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9accbfbd-5bae-4eb9-a361-b17caaf2428f None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:59.578362 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9accbfbd-5bae-4eb9-a361-b17caaf2428f None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:59.615230 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698afee1-17cd-42ab-b18d-92af56c86a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:59.616411 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698afee1-17cd-42ab-b18d-92af56c86a6f None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:59.616911 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698afee1-17cd-42ab-b18d-92af56c86a6f None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:59.617395 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698afee1-17cd-42ab-b18d-92af56c86a6f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:59.618262 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698afee1-17cd-42ab-b18d-92af56c86a6f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:59.619821 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698afee1-17cd-42ab-b18d-92af56c86a6f None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:59.632747 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-698afee1-17cd-42ab-b18d-92af56c86a6f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 03:00:59.632747 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:59.632747 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 03:00:59.632747 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 03:00:59.632747 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 03:00:59.632747 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 03:00:59.632747 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 03:00:59.632747 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:00:59.632747 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 03:00:59.632747 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:59.632747 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 03:00:59.632747 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:59.632747 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:00:59.632747 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:00:59.632747 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:00:59.632747 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:00:59.632747 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:00:59.633799 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:00:59.633799 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:00:59.633799 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:00:59.633799 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:00:59.633799 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:00:59.633799 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:00:59.633799 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 03:00:59.633799 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 03:00:59.633799 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 03:00:59.633799 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 03:00:59.633799 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:00:59.633799 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:00:59.633799 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:00:59.633799 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:00:59.633799 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:00:59.633799 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:00:59.634641 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:00:59.634641 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:00:59.634641 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:00:59.634641 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:00:59.634641 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:00:59.634641 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:00:59.634641 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:00:59.634641 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:00:59.634641 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:00:59.634641 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:00:59.634641 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 03:00:59.634641 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:00:59.634641 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 03:00:59.634641 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:00:59.637487 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 432/879] 10.222.0.65 () {56 vars in 1126 bytes} [Tue May 10 03:00:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:00:59.648061 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53476536-a396-4173-a22f-89da59431951 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:59.741209 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53476536-a396-4173-a22f-89da59431951 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:59.774347 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404fcefb-e921-4ec0-8394-0ff678577aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:59.775016 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404fcefb-e921-4ec0-8394-0ff678577aca None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:59.775298 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404fcefb-e921-4ec0-8394-0ff678577aca None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:59.775573 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404fcefb-e921-4ec0-8394-0ff678577aca None admin] PATH_INFO: `/v3/services` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:59.776315 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404fcefb-e921-4ec0-8394-0ff678577aca None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:59.776620 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404fcefb-e921-4ec0-8394-0ff678577aca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:59.777969 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404fcefb-e921-4ec0-8394-0ff678577aca None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:59.783141 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 448/880] 10.222.0.65 () {56 vars in 1122 bytes} [Tue May 10 03:00:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:00:59.788580 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698afee1-17cd-42ab-b18d-92af56c86a6f None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:00:59.889200 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698afee1-17cd-42ab-b18d-92af56c86a6f None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:00:59.922889 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f9afc2-4a47-45df-9c73-0293746aea0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:00:59.923560 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9afc2-4a47-45df-9c73-0293746aea0f None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:00:59.923842 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9afc2-4a47-45df-9c73-0293746aea0f None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:00:59.924146 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9afc2-4a47-45df-9c73-0293746aea0f None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:00:59.924855 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f9afc2-4a47-45df-9c73-0293746aea0f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:00:59.925157 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f9afc2-4a47-45df-9c73-0293746aea0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:00:59.926515 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f9afc2-4a47-45df-9c73-0293746aea0f None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:00:59.936186 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 433/881] 10.222.0.65 () {56 vars in 1122 bytes} [Tue May 10 03:00:59 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:00.503471 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93891aae-16bf-406e-933d-692dacfb2d92 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:00.504049 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93891aae-16bf-406e-933d-692dacfb2d92 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:00.504049 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93891aae-16bf-406e-933d-692dacfb2d92 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:00.505678 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 449/882] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:01:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:00.511369 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae5ae9-496a-4b15-9a9f-4972a96c2b07 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:00.511663 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae5ae9-496a-4b15-9a9f-4972a96c2b07 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:00.511947 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae5ae9-496a-4b15-9a9f-4972a96c2b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:00.529102 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-a1ae5ae9-496a-4b15-9a9f-4972a96c2b07 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:00.530304 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-a1ae5ae9-496a-4b15-9a9f-4972a96c2b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:00.595590 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 434/883] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:01:00 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:01:00.618121 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93891aae-16bf-406e-933d-692dacfb2d92 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:00.718111 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93891aae-16bf-406e-933d-692dacfb2d92 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:00.754530 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd2b614-45db-48c1-8c43-40a779050559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:00.756275 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd2b614-45db-48c1-8c43-40a779050559 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:00.756689 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd2b614-45db-48c1-8c43-40a779050559 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:00.757094 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd2b614-45db-48c1-8c43-40a779050559 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:00.758089 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd2b614-45db-48c1-8c43-40a779050559 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:00.760194 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd2b614-45db-48c1-8c43-40a779050559 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:00.778877 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-afd2b614-45db-48c1-8c43-40a779050559 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 03:01:00.778877 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:00.778877 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 03:01:00.778877 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 03:01:00.778877 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 03:01:00.778877 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 03:01:00.778877 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 03:01:00.778877 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:01:00.778877 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 03:01:00.778877 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:01:00.778877 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 03:01:00.778877 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:01:00.778877 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:00.778877 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:00.778877 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:00.778877 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:00.778877 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:00.781867 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:00.781867 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:00.781867 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:00.781867 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:00.781867 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:00.781867 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:00.781867 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 03:01:00.781867 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 03:01:00.781867 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 03:01:00.781867 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 03:01:00.781867 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:00.781867 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:00.781867 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:00.781867 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:00.781867 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:00.781867 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:00.783969 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:00.783969 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:01:00.783969 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:00.783969 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:00.783969 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:00.783969 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:00.783969 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:00.783969 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:00.783969 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:00.783969 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:00.783969 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 03:01:00.783969 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:01:00.783969 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 03:01:00.783969 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:01:00.783969 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 450/884] 10.222.0.65 () {56 vars in 1114 bytes} [Tue May 10 03:01:00 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:00.786752 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ae5ae9-496a-4b15-9a9f-4972a96c2b07 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:00.896513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ae5ae9-496a-4b15-9a9f-4972a96c2b07 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:00.930766 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0732ffe-29e8-476a-957d-75657c42aff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:00.931442 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0732ffe-29e8-476a-957d-75657c42aff6 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:00.931728 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0732ffe-29e8-476a-957d-75657c42aff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:00.932018 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0732ffe-29e8-476a-957d-75657c42aff6 None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:00.932742 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0732ffe-29e8-476a-957d-75657c42aff6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:00.933046 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0732ffe-29e8-476a-957d-75657c42aff6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:00.934423 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0732ffe-29e8-476a-957d-75657c42aff6 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:00.939559 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 435/885] 10.222.0.65 () {56 vars in 1114 bytes} [Tue May 10 03:01:00 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:00.945946 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd2b614-45db-48c1-8c43-40a779050559 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:01.048404 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd2b614-45db-48c1-8c43-40a779050559 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:01.088108 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4be5f9-6261-4893-9c37-55da955e0f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:01.090572 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4be5f9-6261-4893-9c37-55da955e0f4f None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:01.091102 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4be5f9-6261-4893-9c37-55da955e0f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:01.091601 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4be5f9-6261-4893-9c37-55da955e0f4f None admin] PATH_INFO: `/v3/services` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:01.092564 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4be5f9-6261-4893-9c37-55da955e0f4f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:01.093101 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4be5f9-6261-4893-9c37-55da955e0f4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:01.094690 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4be5f9-6261-4893-9c37-55da955e0f4f None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:01.100926 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 451/886] 10.222.0.65 () {56 vars in 1114 bytes} [Tue May 10 03:01:00 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:01:01.106366 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0732ffe-29e8-476a-957d-75657c42aff6 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:01.210823 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0732ffe-29e8-476a-957d-75657c42aff6 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:01.249085 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905444d4-cf1d-4ede-86f1-a302da17a0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:01.249752 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905444d4-cf1d-4ede-86f1-a302da17a0b0 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:01.250038 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905444d4-cf1d-4ede-86f1-a302da17a0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:01.250316 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905444d4-cf1d-4ede-86f1-a302da17a0b0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:01.251184 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905444d4-cf1d-4ede-86f1-a302da17a0b0 None admin] RBAC: Adding query filter params (interface=public, service_id=db57e567f69246979ebf5eec83dfa917, region_id=RegionOne) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:01.251506 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905444d4-cf1d-4ede-86f1-a302da17a0b0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:01.252916 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905444d4-cf1d-4ede-86f1-a302da17a0b0 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:01.261618 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 436/887] 10.222.0.65 () {56 vars in 1251 bytes} [Tue May 10 03:01:01 2022] GET /identity/v3/endpoints?service_id=db57e567f69246979ebf5eec83dfa917&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:01.267098 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4be5f9-6261-4893-9c37-55da955e0f4f None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:01.378669 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4be5f9-6261-4893-9c37-55da955e0f4f None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:01.412135 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c37cb-6c36-4e53-8240-d0dd6c1ae64d None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:01.412448 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c37cb-6c36-4e53-8240-d0dd6c1ae64d None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:01.412693 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c37cb-6c36-4e53-8240-d0dd6c1ae64d None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:01.414263 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f52da-83a3-4b52-aba4-3ad44d277d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:01.414542 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 437/888] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:01:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:01:01.415460 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f52da-83a3-4b52-aba4-3ad44d277d03 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:01.415954 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f52da-83a3-4b52-aba4-3ad44d277d03 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:01.416482 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f52da-83a3-4b52-aba4-3ad44d277d03 None admin] PATH_INFO: `/v3/services` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:01.417374 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9f52da-83a3-4b52-aba4-3ad44d277d03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:01.419020 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9f52da-83a3-4b52-aba4-3ad44d277d03 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:01.419140 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f400d70-4cff-4631-8434-4a0c93f2d4b0 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:01.419434 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f400d70-4cff-4631-8434-4a0c93f2d4b0 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:01.419706 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f400d70-4cff-4631-8434-4a0c93f2d4b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:01.426298 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 452/889] 10.222.0.65 () {56 vars in 1087 bytes} [Tue May 10 03:01:01 2022] GET /identity/v3/services => generated 1268 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:01:01.439161 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-0f400d70-4cff-4631-8434-4a0c93f2d4b0 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:01.440822 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-0f400d70-4cff-4631-8434-4a0c93f2d4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:01.508625 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c4087-1b49-4229-b579-e6ad007354b0 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:01.509160 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c4087-1b49-4229-b579-e6ad007354b0 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:01.509160 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c4087-1b49-4229-b579-e6ad007354b0 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:01.510715 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 453/890] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:01:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:01:01.516644 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43476b32-fe24-41fc-a5f6-2834185d023a None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:01.517064 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43476b32-fe24-41fc-a5f6-2834185d023a None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:01.517421 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43476b32-fe24-41fc-a5f6-2834185d023a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:01.519354 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 438/891] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:01:01 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 03:01:01.537359 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-43476b32-fe24-41fc-a5f6-2834185d023a None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:01.538722 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-43476b32-fe24-41fc-a5f6-2834185d023a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:01.546819 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f400d70-4cff-4631-8434-4a0c93f2d4b0 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:01.620180 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 454/892] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:01:01 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 03:01:01.639698 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43476b32-fe24-41fc-a5f6-2834185d023a None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:01.652522 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f400d70-4cff-4631-8434-4a0c93f2d4b0 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:01.692757 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d52f7b-6de0-4775-a4af-48a957e9328b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:01.693587 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d52f7b-6de0-4775-a4af-48a957e9328b None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:01.693872 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d52f7b-6de0-4775-a4af-48a957e9328b None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:01.694148 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d52f7b-6de0-4775-a4af-48a957e9328b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:01.694806 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d52f7b-6de0-4775-a4af-48a957e9328b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:01.697056 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d52f7b-6de0-4775-a4af-48a957e9328b None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:01.714002 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-32d52f7b-6de0-4775-a4af-48a957e9328b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 03:01:01.714002 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:01.714002 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 03:01:01.714002 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 03:01:01.714002 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 03:01:01.714002 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 03:01:01.714002 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 03:01:01.714002 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:01:01.714002 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 03:01:01.714002 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:01:01.714002 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 03:01:01.714002 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:01:01.714002 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:01.714002 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:01.714002 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:01.714002 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:01.715134 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:01.715134 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:01.715134 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:01.715134 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:01.715134 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:01.715134 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:01.715134 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:01.715134 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 03:01:01.715134 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 03:01:01.715134 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 03:01:01.715134 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 03:01:01.715134 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:01.715134 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:01.715134 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:01.715134 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:01.715134 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:01.716171 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:01.716171 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:01.716171 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:01:01.716171 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:01.716171 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:01.716171 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:01.716171 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:01.716171 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:01.716171 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:01.716171 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:01.716171 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:01.716171 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 03:01:01.716171 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:01:01.716171 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 03:01:01.716171 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:01:01.716171 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 439/893] 10.222.0.65 () {56 vars in 1132 bytes} [Tue May 10 03:01:01 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:01:01.725008 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d52f7b-6de0-4775-a4af-48a957e9328b None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:01.745838 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43476b32-fe24-41fc-a5f6-2834185d023a None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:01.780962 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b1654-12b3-423a-aec2-de4a30162d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:01.781961 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b1654-12b3-423a-aec2-de4a30162d31 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:01.782608 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b1654-12b3-423a-aec2-de4a30162d31 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:01.782989 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b1654-12b3-423a-aec2-de4a30162d31 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:01.793596 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5b1654-12b3-423a-aec2-de4a30162d31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:01:01.802450 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-bc5b1654-12b3-423a-aec2-de4a30162d31 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 03:01:01.802450 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:01.802450 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:01.802450 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:01.802450 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:01.802450 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:01.802450 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:01.802450 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:01.802450 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:01.802450 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:01.802450 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:01.802450 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:01.802450 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:01:01.802450 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:01:01.802450 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:01:01.802450 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:01:01.803607 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:01:01.803607 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:01:01.803607 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:01:01.803607 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:01:01.803607 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:01.803607 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:01.803607 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:01.803607 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:01.803607 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:01.803607 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:01.803607 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:01.803607 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:01:01.803607 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:01.803607 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:01.803607 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:01.803607 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:01.804808 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:01.804808 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:01.804808 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:01.804808 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:01.804808 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:01:01.804808 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:01:01.804808 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:01:01.804808 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:01:01.804808 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:01:01.804808 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:01:01.804808 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 03:01:01.804808 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:01:01.806873 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 455/894] 10.222.0.65 () {56 vars in 1120 bytes} [Tue May 10 03:01:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:01:01.812607 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b1654-12b3-423a-aec2-de4a30162d31 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:01.839450 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d52f7b-6de0-4775-a4af-48a957e9328b None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:01.883641 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ed99e-86bf-4421-a3b9-0a196eafdf29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:01.884599 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ed99e-86bf-4421-a3b9-0a196eafdf29 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:01.885214 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ed99e-86bf-4421-a3b9-0a196eafdf29 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:01.885665 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ed99e-86bf-4421-a3b9-0a196eafdf29 None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:01.887318 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22ed99e-86bf-4421-a3b9-0a196eafdf29 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:01.887783 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22ed99e-86bf-4421-a3b9-0a196eafdf29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:01.889334 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22ed99e-86bf-4421-a3b9-0a196eafdf29 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:01.896101 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 440/895] 10.222.0.65 () {56 vars in 1126 bytes} [Tue May 10 03:01:01 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:01.901309 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ed99e-86bf-4421-a3b9-0a196eafdf29 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:01.916921 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b1654-12b3-423a-aec2-de4a30162d31 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:01.958847 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf0e8e-036f-402f-a5d1-e34d2d051243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:01.959714 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf0e8e-036f-402f-a5d1-e34d2d051243 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:01.960266 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf0e8e-036f-402f-a5d1-e34d2d051243 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:01.960502 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf0e8e-036f-402f-a5d1-e34d2d051243 None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:01.961413 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacf0e8e-036f-402f-a5d1-e34d2d051243 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:01.961775 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacf0e8e-036f-402f-a5d1-e34d2d051243 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:01.963218 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacf0e8e-036f-402f-a5d1-e34d2d051243 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:01.976295 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 456/896] 10.222.0.65 () {56 vars in 1115 bytes} [Tue May 10 03:01:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:01.978026 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf0e8e-036f-402f-a5d1-e34d2d051243 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:02.017638 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ed99e-86bf-4421-a3b9-0a196eafdf29 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:02.052589 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9612de8f-a50f-47da-8b2c-39fdb4071adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:02.053555 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612de8f-a50f-47da-8b2c-39fdb4071adc None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:02.054023 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612de8f-a50f-47da-8b2c-39fdb4071adc None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:02.054539 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612de8f-a50f-47da-8b2c-39fdb4071adc None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:02.055426 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9612de8f-a50f-47da-8b2c-39fdb4071adc None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:02.055922 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9612de8f-a50f-47da-8b2c-39fdb4071adc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:02.057556 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9612de8f-a50f-47da-8b2c-39fdb4071adc None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:02.063239 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 441/897] 10.222.0.65 () {56 vars in 1126 bytes} [Tue May 10 03:01:01 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:02.077435 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9612de8f-a50f-47da-8b2c-39fdb4071adc None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:02.080243 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf0e8e-036f-402f-a5d1-e34d2d051243 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:02.114676 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd92f1f0-683e-4b6e-8406-68da054bbb01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:02.115858 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd92f1f0-683e-4b6e-8406-68da054bbb01 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:02.116395 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd92f1f0-683e-4b6e-8406-68da054bbb01 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:02.116909 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd92f1f0-683e-4b6e-8406-68da054bbb01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:02.128744 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd92f1f0-683e-4b6e-8406-68da054bbb01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:02.130856 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd92f1f0-683e-4b6e-8406-68da054bbb01 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:02.151274 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-cd92f1f0-683e-4b6e-8406-68da054bbb01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:02.151274 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:02.151274 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:02.151274 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:02.151274 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:02.151274 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:02.151274 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:02.151274 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:02.151274 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:02.151274 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:02.151274 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:02.151274 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:02.151274 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:02.151274 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:02.151274 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:02.152288 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:02.152288 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:02.152288 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:02.152288 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:02.152288 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:02.152288 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:02.152288 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:02.152288 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:02.152288 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:01:02.152288 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:02.152288 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:02.152288 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:02.152288 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:02.152288 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:02.152288 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:02.152288 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:02.152288 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:02.153183 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:02.153183 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:02.153183 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:02.153183 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:01:02.157623 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 457/898] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:01:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:02.159057 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd92f1f0-683e-4b6e-8406-68da054bbb01 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:02.186667 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9612de8f-a50f-47da-8b2c-39fdb4071adc None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:02.219967 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbe3297-7cfb-4d2e-979f-848bb7c8dcce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:02.220982 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe3297-7cfb-4d2e-979f-848bb7c8dcce None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:02.221451 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe3297-7cfb-4d2e-979f-848bb7c8dcce None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:02.221911 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe3297-7cfb-4d2e-979f-848bb7c8dcce None admin] PATH_INFO: `/v3/endpoints` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:02.222881 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbe3297-7cfb-4d2e-979f-848bb7c8dcce None admin] RBAC: Adding query filter params (interface=public, service_id=f74963de4652400fa9ef43d218bac986, region_id=RegionOne) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:02.223949 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbe3297-7cfb-4d2e-979f-848bb7c8dcce None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:02.225675 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbe3297-7cfb-4d2e-979f-848bb7c8dcce None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:02.235585 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 442/899] 10.222.0.65 () {56 vars in 1251 bytes} [Tue May 10 03:01:02 2022] GET /identity/v3/endpoints?service_id=f74963de4652400fa9ef43d218bac986&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:02.237187 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbe3297-7cfb-4d2e-979f-848bb7c8dcce None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:02.263356 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd92f1f0-683e-4b6e-8406-68da054bbb01 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:02.298773 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d17c7e-49b3-4a3d-9d4a-255ea4d2331f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:02.299880 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d17c7e-49b3-4a3d-9d4a-255ea4d2331f None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:02.300430 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d17c7e-49b3-4a3d-9d4a-255ea4d2331f None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:02.300818 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d17c7e-49b3-4a3d-9d4a-255ea4d2331f None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:02.302287 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d17c7e-49b3-4a3d-9d4a-255ea4d2331f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:02.302672 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d17c7e-49b3-4a3d-9d4a-255ea4d2331f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:02.304243 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d17c7e-49b3-4a3d-9d4a-255ea4d2331f None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:02.321315 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 458/900] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:01:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:01:02.322442 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960af950-e69d-47ee-b24e-7fd445405e37 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:02.322737 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960af950-e69d-47ee-b24e-7fd445405e37 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:02.323015 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960af950-e69d-47ee-b24e-7fd445405e37 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:02.324345 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 459/901] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:01:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:02.325031 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960af950-e69d-47ee-b24e-7fd445405e37 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:02.347624 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbe3297-7cfb-4d2e-979f-848bb7c8dcce None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:02.382690 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a75e569-48c9-4fe4-8c2c-232677a3cdd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:02.383365 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75e569-48c9-4fe4-8c2c-232677a3cdd7 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:02.383662 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75e569-48c9-4fe4-8c2c-232677a3cdd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:02.383935 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75e569-48c9-4fe4-8c2c-232677a3cdd7 None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:02.384646 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a75e569-48c9-4fe4-8c2c-232677a3cdd7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:02.386031 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a75e569-48c9-4fe4-8c2c-232677a3cdd7 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:02.392036 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 443/902] 10.222.0.65 () {56 vars in 1087 bytes} [Tue May 10 03:01:02 2022] GET /identity/v3/services => generated 1268 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:01:02.393352 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059d398-f227-4536-9bc3-6c82af299e9e None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:02.393638 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059d398-f227-4536-9bc3-6c82af299e9e None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:02.393919 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059d398-f227-4536-9bc3-6c82af299e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:02.416928 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-3059d398-f227-4536-9bc3-6c82af299e9e None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:02.418692 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-3059d398-f227-4536-9bc3-6c82af299e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:02.432621 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960af950-e69d-47ee-b24e-7fd445405e37 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:02.482805 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f804191-b107-4913-a112-63d40b227440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:02.484091 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f804191-b107-4913-a112-63d40b227440 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:02.484665 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f804191-b107-4913-a112-63d40b227440 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:02.485172 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f804191-b107-4913-a112-63d40b227440 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:02.500053 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f804191-b107-4913-a112-63d40b227440 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:02.501925 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f804191-b107-4913-a112-63d40b227440 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:02.518198 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 444/903] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:01:02 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:01:02.520080 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-4f804191-b107-4913-a112-63d40b227440 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 03:01:02.520080 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:02.520080 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:02.520080 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:02.520080 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:02.520080 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:02.520080 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:02.520080 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:02.520080 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:02.520080 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:02.520080 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:02.520080 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:02.520080 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:01:02.520080 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:01:02.520080 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:01:02.520080 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:01:02.521995 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:02.521995 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:02.521995 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:01:02.521995 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:02.521995 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:01:02.521995 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:02.521995 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:02.521995 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:02.521995 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:02.521995 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:02.521995 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:02.521995 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:01:02.521995 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:02.521995 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:02.521995 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:02.521995 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:02.521995 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:02.521995 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:02.523279 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:02.523279 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:02.523279 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:01:02.523279 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:01:02.523279 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:01:02.523279 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:01:02.523279 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:01:02.523279 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:01:02.523279 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 03:01:02.523279 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:01:02.527137 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 460/904] 10.222.0.65 () {56 vars in 1117 bytes} [Tue May 10 03:01:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:02.528203 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3059d398-f227-4536-9bc3-6c82af299e9e None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:02.547450 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f804191-b107-4913-a112-63d40b227440 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:02.656119 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3059d398-f227-4536-9bc3-6c82af299e9e None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:02.688057 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f804191-b107-4913-a112-63d40b227440 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:02.693500 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016352f9-e126-47f2-b5eb-2ccdaa0d5cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:02.694421 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016352f9-e126-47f2-b5eb-2ccdaa0d5cac None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:02.694914 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016352f9-e126-47f2-b5eb-2ccdaa0d5cac None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:02.695398 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016352f9-e126-47f2-b5eb-2ccdaa0d5cac None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:02.696504 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016352f9-e126-47f2-b5eb-2ccdaa0d5cac None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:02.697046 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016352f9-e126-47f2-b5eb-2ccdaa0d5cac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:02.698694 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016352f9-e126-47f2-b5eb-2ccdaa0d5cac None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:02.717062 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 445/905] 10.222.0.65 () {56 vars in 1149 bytes} [Tue May 10 03:01:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:02.722143 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016352f9-e126-47f2-b5eb-2ccdaa0d5cac None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:02.737750 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d353cdf-2aa6-4d84-8291-d3e295a12974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:02.738797 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d353cdf-2aa6-4d84-8291-d3e295a12974 None admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:02.739312 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d353cdf-2aa6-4d84-8291-d3e295a12974 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:02.739855 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d353cdf-2aa6-4d84-8291-d3e295a12974 None admin] PATH_INFO: `/v3/services` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:02.740825 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d353cdf-2aa6-4d84-8291-d3e295a12974 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:02.742397 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d353cdf-2aa6-4d84-8291-d3e295a12974 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:02.816502 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 461/906] 10.222.0.65 () {60 vars in 1141 bytes} [Tue May 10 03:01:02 2022] POST /identity/v3/services => generated 241 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:01:02.833821 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016352f9-e126-47f2-b5eb-2ccdaa0d5cac None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:02.887029 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cdfa5b-0c58-43ec-b69b-9f2fb82c3c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:02.887772 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cdfa5b-0c58-43ec-b69b-9f2fb82c3c02 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:02.888088 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cdfa5b-0c58-43ec-b69b-9f2fb82c3c02 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:02.888373 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cdfa5b-0c58-43ec-b69b-9f2fb82c3c02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:02.965061 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cdfa5b-0c58-43ec-b69b-9f2fb82c3c02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:02.966502 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cdfa5b-0c58-43ec-b69b-9f2fb82c3c02 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:03.071859 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 446/907] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 10 03:01:02 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 03:01:03.077825 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d353cdf-2aa6-4d84-8291-d3e295a12974 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:03.184607 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d353cdf-2aa6-4d84-8291-d3e295a12974 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:03.219227 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00f069-3388-41a7-bbaf-e9b95b3cc62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:03.219982 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00f069-3388-41a7-bbaf-e9b95b3cc62e None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:03.220299 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00f069-3388-41a7-bbaf-e9b95b3cc62e None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:03.220575 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00f069-3388-41a7-bbaf-e9b95b3cc62e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:03.232271 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f00f069-3388-41a7-bbaf-e9b95b3cc62e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:03.233728 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f00f069-3388-41a7-bbaf-e9b95b3cc62e None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:03.252225 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-9f00f069-3388-41a7-bbaf-e9b95b3cc62e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:03.252225 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:03.252225 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:03.252225 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:03.252225 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:03.252225 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:03.252225 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:03.252225 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:03.252225 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:03.252225 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:03.252225 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:03.252225 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:03.252225 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:03.252225 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:03.252225 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:03.253697 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:03.253697 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:03.253697 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:03.253697 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:03.253697 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:03.253697 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:03.253697 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:03.253697 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:03.253697 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:01:03.253697 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:03.253697 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:03.253697 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:03.253697 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:03.253697 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:03.253697 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:03.253697 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:03.253697 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:03.255193 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:03.255193 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:03.255193 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:03.255193 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:01:03.255193 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 462/908] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:01:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:03.264435 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cdfa5b-0c58-43ec-b69b-9f2fb82c3c02 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:03.375428 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cdfa5b-0c58-43ec-b69b-9f2fb82c3c02 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:03.409212 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa9cc7e-6340-403e-8866-f9bb5f589007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:03.410227 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9cc7e-6340-403e-8866-f9bb5f589007 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:03.410711 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9cc7e-6340-403e-8866-f9bb5f589007 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:03.411740 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9cc7e-6340-403e-8866-f9bb5f589007 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:03.412697 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa9cc7e-6340-403e-8866-f9bb5f589007 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:03.413225 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa9cc7e-6340-403e-8866-f9bb5f589007 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:03.414791 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa9cc7e-6340-403e-8866-f9bb5f589007 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:03.426570 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 447/909] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:01:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:03.432250 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00f069-3388-41a7-bbaf-e9b95b3cc62e None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:03.534585 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00f069-3388-41a7-bbaf-e9b95b3cc62e None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:03.572867 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f1ae1e-40c7-4d45-8e3f-4745a3c7f02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:03.573665 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1ae1e-40c7-4d45-8e3f-4745a3c7f02b None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:03.573949 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1ae1e-40c7-4d45-8e3f-4745a3c7f02b None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:03.574220 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1ae1e-40c7-4d45-8e3f-4745a3c7f02b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:03.581152 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f1ae1e-40c7-4d45-8e3f-4745a3c7f02b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:03.582590 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f1ae1e-40c7-4d45-8e3f-4745a3c7f02b None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:03.601531 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-e1f1ae1e-40c7-4d45-8e3f-4745a3c7f02b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:01:03.601531 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:03.601531 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:03.601531 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:03.601531 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:03.601531 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:03.601531 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:03.601531 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:03.601531 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:03.601531 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:03.601531 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:03.601531 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:03.601531 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:01:03.601531 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:01:03.601531 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:01:03.602478 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:01:03.602478 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:03.602478 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:03.602478 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:03.602478 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:03.602478 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:03.602478 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:03.602478 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:03.602478 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:01:03.602478 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:03.602478 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:03.602478 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:03.602478 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:03.602478 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:03.602478 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:03.602478 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:03.602478 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:03.603582 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:01:03.603582 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:01:03.603582 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:01:03.603582 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:01:03.603582 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:01:03.603582 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:01:03.603582 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:01:03.603582 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:01:03.603582 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 463/910] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 10 03:01:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:03.611363 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa9cc7e-6340-403e-8866-f9bb5f589007 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:03.719995 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa9cc7e-6340-403e-8866-f9bb5f589007 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:03.754161 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab00e336-4a1c-453e-967d-9dc8c74d4a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:03.755815 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00e336-4a1c-453e-967d-9dc8c74d4a2b None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:03.756332 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00e336-4a1c-453e-967d-9dc8c74d4a2b None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:03.756813 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00e336-4a1c-453e-967d-9dc8c74d4a2b None admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:03.757822 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab00e336-4a1c-453e-967d-9dc8c74d4a2b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:03.758338 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab00e336-4a1c-453e-967d-9dc8c74d4a2b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:03.760023 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab00e336-4a1c-453e-967d-9dc8c74d4a2b None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:03.774123 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 448/911] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 10 03:01:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:03.781094 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f1ae1e-40c7-4d45-8e3f-4745a3c7f02b None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:03.805887 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4172d74-f019-436d-9366-f2edbe814276 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:03.806095 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4172d74-f019-436d-9366-f2edbe814276 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:03.806378 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4172d74-f019-436d-9366-f2edbe814276 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:03.807999 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 449/912] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:01:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:01:03.813080 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baad4f7-20b5-4824-8113-2c6722d8a84d None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:03.813369 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baad4f7-20b5-4824-8113-2c6722d8a84d None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:03.813652 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baad4f7-20b5-4824-8113-2c6722d8a84d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:03.837239 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-7baad4f7-20b5-4824-8113-2c6722d8a84d None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:03.838780 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-7baad4f7-20b5-4824-8113-2c6722d8a84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:03.901021 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f1ae1e-40c7-4d45-8e3f-4745a3c7f02b None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:03.916248 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 450/913] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:01:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 03:01:03.932066 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baad4f7-20b5-4824-8113-2c6722d8a84d None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:03.936629 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef6a25-386b-490f-bfe8-d751e1e0b3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:03.937282 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef6a25-386b-490f-bfe8-d751e1e0b3c9 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:03.937563 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef6a25-386b-490f-bfe8-d751e1e0b3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:03.937832 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef6a25-386b-490f-bfe8-d751e1e0b3c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:03.938656 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ef6a25-386b-490f-bfe8-d751e1e0b3c9 None admin] RBAC: Adding query filter params (role.id=6c4dad34321647f5a6822a530300110c, scope.project.id=513e6592cd83457b8ff461b0e5e1fd40, user.id=6ebfab3ff0b24f4aaabb8c6bb0ad10c6) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:03.938962 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ef6a25-386b-490f-bfe8-d751e1e0b3c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:03.940391 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ef6a25-386b-490f-bfe8-d751e1e0b3c9 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:03.946725 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 464/914] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 10 03:01:03 2022] GET /identity/v3/role_assignments?user.id=6ebfab3ff0b24f4aaabb8c6bb0ad10c6&scope.project.id=513e6592cd83457b8ff461b0e5e1fd40&role.id=6c4dad34321647f5a6822a530300110c => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:04.041037 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baad4f7-20b5-4824-8113-2c6722d8a84d None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:04.078963 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9aec6-2e37-439d-9818-9ba34a8ac5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:04.079713 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9aec6-2e37-439d-9818-9ba34a8ac5e9 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:04.080022 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9aec6-2e37-439d-9818-9ba34a8ac5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:04.080312 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9aec6-2e37-439d-9818-9ba34a8ac5e9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:04.080985 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a9aec6-2e37-439d-9818-9ba34a8ac5e9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:04.082399 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a9aec6-2e37-439d-9818-9ba34a8ac5e9 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:04.095475 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-81a9aec6-2e37-439d-9818-9ba34a8ac5e9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 03:01:04.095475 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:04.095475 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 03:01:04.095475 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 03:01:04.095475 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 03:01:04.095475 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 03:01:04.095475 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 03:01:04.095475 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:01:04.095475 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 03:01:04.095475 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:01:04.095475 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 03:01:04.095475 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:01:04.095475 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:04.095475 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:04.095475 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:04.095475 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:04.095475 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:04.098129 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:04.098129 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:04.098129 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:04.098129 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:04.098129 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:04.098129 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:04.098129 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 03:01:04.098129 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 03:01:04.098129 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 03:01:04.098129 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 03:01:04.098129 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:04.098129 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:04.098129 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:04.098129 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:04.098129 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:04.098129 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:04.100295 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:04.100295 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:01:04.100295 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:04.100295 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:04.100295 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:04.100295 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:04.100295 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:04.100295 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:04.100295 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:04.100295 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:04.100295 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 03:01:04.100295 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:01:04.100295 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 03:01:04.100295 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:01:04.100295 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 451/915] 10.222.0.65 () {56 vars in 1114 bytes} [Tue May 10 03:01:03 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:04.104352 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef6a25-386b-490f-bfe8-d751e1e0b3c9 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:04.208203 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef6a25-386b-490f-bfe8-d751e1e0b3c9 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:04.241872 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29998faf-4eff-4d3a-9773-35e2df996db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:04.242908 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29998faf-4eff-4d3a-9773-35e2df996db6 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:04.243376 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29998faf-4eff-4d3a-9773-35e2df996db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:04.243856 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29998faf-4eff-4d3a-9773-35e2df996db6 None admin] PATH_INFO: `/v3/services` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:04.244765 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29998faf-4eff-4d3a-9773-35e2df996db6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:04.245253 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29998faf-4eff-4d3a-9773-35e2df996db6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:04.246816 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29998faf-4eff-4d3a-9773-35e2df996db6 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:04.252254 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 465/916] 10.222.0.65 () {56 vars in 1114 bytes} [Tue May 10 03:01:04 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:04.258894 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9aec6-2e37-439d-9818-9ba34a8ac5e9 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:04.362776 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9aec6-2e37-439d-9818-9ba34a8ac5e9 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:04.398357 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a9ee6-2d3a-41d5-a97c-01eda3253c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:04.399319 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a9ee6-2d3a-41d5-a97c-01eda3253c95 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:04.399787 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a9ee6-2d3a-41d5-a97c-01eda3253c95 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:04.400290 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a9ee6-2d3a-41d5-a97c-01eda3253c95 None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:04.401180 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214a9ee6-2d3a-41d5-a97c-01eda3253c95 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:04.401680 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214a9ee6-2d3a-41d5-a97c-01eda3253c95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:04.403219 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214a9ee6-2d3a-41d5-a97c-01eda3253c95 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:04.409141 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 452/917] 10.222.0.65 () {56 vars in 1114 bytes} [Tue May 10 03:01:04 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:04.415435 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29998faf-4eff-4d3a-9773-35e2df996db6 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:04.524560 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29998faf-4eff-4d3a-9773-35e2df996db6 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:04.558311 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4188aa55-aac8-469a-9dc7-3a7e2bb9408c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:04.559056 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188aa55-aac8-469a-9dc7-3a7e2bb9408c None admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:04.559252 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188aa55-aac8-469a-9dc7-3a7e2bb9408c None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:04.559519 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188aa55-aac8-469a-9dc7-3a7e2bb9408c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:04.560295 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4188aa55-aac8-469a-9dc7-3a7e2bb9408c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:04.561641 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4188aa55-aac8-469a-9dc7-3a7e2bb9408c None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:04.650670 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 466/918] 10.222.0.65 () {60 vars in 1144 bytes} [Tue May 10 03:01:04 2022] POST /identity/v3/endpoints => generated 346 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:01:04.764968 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642abd9-b72d-43fb-a23f-b6139c249714 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:04.765490 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642abd9-b72d-43fb-a23f-b6139c249714 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:04.765567 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642abd9-b72d-43fb-a23f-b6139c249714 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:04.767223 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 453/919] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:01:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:04.773543 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c3745-aceb-4f2b-96bc-48634f03c81d None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:04.773842 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c3745-aceb-4f2b-96bc-48634f03c81d None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:04.774108 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c3745-aceb-4f2b-96bc-48634f03c81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:04.792966 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-6c5c3745-aceb-4f2b-96bc-48634f03c81d None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:04.794185 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-6c5c3745-aceb-4f2b-96bc-48634f03c81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:04.869629 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 467/920] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:01:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:01:04.892809 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642abd9-b72d-43fb-a23f-b6139c249714 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:04.997306 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642abd9-b72d-43fb-a23f-b6139c249714 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:05.031684 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2cfa3e-1f8f-44b2-b0d0-88663a420e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:05.033088 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2cfa3e-1f8f-44b2-b0d0-88663a420e11 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:05.043232 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2cfa3e-1f8f-44b2-b0d0-88663a420e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:05.043232 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2cfa3e-1f8f-44b2-b0d0-88663a420e11 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:05.043232 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2cfa3e-1f8f-44b2-b0d0-88663a420e11 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:05.043232 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2cfa3e-1f8f-44b2-b0d0-88663a420e11 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:05.049298 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-ba2cfa3e-1f8f-44b2-b0d0-88663a420e11 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 03:01:05.049298 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:05.049298 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 03:01:05.049298 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 03:01:05.049298 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 03:01:05.049298 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 03:01:05.049298 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 03:01:05.049298 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:01:05.049298 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 03:01:05.049298 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:01:05.049298 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 03:01:05.049298 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:01:05.049298 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:05.049298 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:05.049298 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:05.049298 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:05.050222 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:05.050222 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:05.050222 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:05.050222 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:05.050222 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:05.050222 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:05.050222 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:05.050222 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 03:01:05.050222 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 03:01:05.050222 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 03:01:05.050222 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 03:01:05.050222 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:05.050222 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:05.050222 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:05.050222 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:05.050222 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:05.051075 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:05.051075 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:05.051075 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:01:05.051075 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:05.051075 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:05.051075 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:05.051075 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:05.051075 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:05.051075 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:05.051075 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:05.051075 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:05.051075 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 03:01:05.051075 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:01:05.051075 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 03:01:05.051075 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:01:05.053639 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 454/921] 10.222.0.65 () {56 vars in 1132 bytes} [Tue May 10 03:01:04 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:05.059792 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c3745-aceb-4f2b-96bc-48634f03c81d None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:05.167842 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c3745-aceb-4f2b-96bc-48634f03c81d None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:05.205538 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2d069c-f1d9-4b51-a86c-00c16923e155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:05.206227 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d069c-f1d9-4b51-a86c-00c16923e155 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:05.206507 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d069c-f1d9-4b51-a86c-00c16923e155 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:05.206796 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d069c-f1d9-4b51-a86c-00c16923e155 None admin] PATH_INFO: `/v3/services` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:05.207504 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2d069c-f1d9-4b51-a86c-00c16923e155 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:05.208412 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2d069c-f1d9-4b51-a86c-00c16923e155 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:05.209781 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2d069c-f1d9-4b51-a86c-00c16923e155 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:05.214973 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 468/922] 10.222.0.65 () {56 vars in 1126 bytes} [Tue May 10 03:01:05 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:01:05.220476 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2cfa3e-1f8f-44b2-b0d0-88663a420e11 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:05.277946 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c8604b-47c1-427a-8cc3-36f35afaacf2 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:05.278252 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c8604b-47c1-427a-8cc3-36f35afaacf2 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:05.278446 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c8604b-47c1-427a-8cc3-36f35afaacf2 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:05.280120 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 469/923] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:01:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:01:05.286080 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946cb18-5d05-402d-b8c9-fdd7728f6719 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:05.286367 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946cb18-5d05-402d-b8c9-fdd7728f6719 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:05.286646 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946cb18-5d05-402d-b8c9-fdd7728f6719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:05.306673 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-a946cb18-5d05-402d-b8c9-fdd7728f6719 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:05.307874 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-a946cb18-5d05-402d-b8c9-fdd7728f6719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:05.333857 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2cfa3e-1f8f-44b2-b0d0-88663a420e11 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:05.369046 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414de30a-b892-4d62-bf53-d3cdb4012260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:05.370011 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414de30a-b892-4d62-bf53-d3cdb4012260 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:05.370502 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414de30a-b892-4d62-bf53-d3cdb4012260 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:05.370961 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414de30a-b892-4d62-bf53-d3cdb4012260 None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:05.371841 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414de30a-b892-4d62-bf53-d3cdb4012260 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:05.372400 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414de30a-b892-4d62-bf53-d3cdb4012260 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:05.373994 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414de30a-b892-4d62-bf53-d3cdb4012260 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:05.384266 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 455/924] 10.222.0.65 () {56 vars in 1126 bytes} [Tue May 10 03:01:05 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:05.385714 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414de30a-b892-4d62-bf53-d3cdb4012260 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:05.400732 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 470/925] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:01:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 03:01:05.422796 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a946cb18-5d05-402d-b8c9-fdd7728f6719 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:05.509794 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414de30a-b892-4d62-bf53-d3cdb4012260 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:05.528606 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a946cb18-5d05-402d-b8c9-fdd7728f6719 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:05.553070 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e43ca8-3e98-4d1f-a88d-bef700223b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:05.554163 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e43ca8-3e98-4d1f-a88d-bef700223b2f None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:05.554579 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e43ca8-3e98-4d1f-a88d-bef700223b2f None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:05.554991 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e43ca8-3e98-4d1f-a88d-bef700223b2f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:05.556276 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e43ca8-3e98-4d1f-a88d-bef700223b2f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:05.557984 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e43ca8-3e98-4d1f-a88d-bef700223b2f None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:05.564114 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf84fb5-9c18-4cab-ba67-3ca0d8394712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:05.565530 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf84fb5-9c18-4cab-ba67-3ca0d8394712 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:05.566067 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf84fb5-9c18-4cab-ba67-3ca0d8394712 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:05.566522 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf84fb5-9c18-4cab-ba67-3ca0d8394712 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:05.568034 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf84fb5-9c18-4cab-ba67-3ca0d8394712 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:05.569762 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf84fb5-9c18-4cab-ba67-3ca0d8394712 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:05.582470 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-ccf84fb5-9c18-4cab-ba67-3ca0d8394712 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 03:01:05.582470 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:05.582470 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 03:01:05.582470 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 03:01:05.582470 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 03:01:05.582470 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 03:01:05.582470 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 03:01:05.582470 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:01:05.582470 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 03:01:05.582470 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:01:05.582470 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 03:01:05.582470 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:01:05.582470 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:05.582470 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:05.582470 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:05.582470 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:05.582470 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:05.583517 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:05.583517 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:05.583517 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:05.583517 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:05.583517 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:05.583517 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:05.583517 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 03:01:05.583517 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 03:01:05.583517 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 03:01:05.583517 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 03:01:05.583517 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:05.583517 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:05.583517 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:05.583517 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:05.583517 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:05.583517 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:05.592487 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:05.592487 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:01:05.592487 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:05.592487 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:05.592487 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:05.592487 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:05.592487 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:05.592487 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:05.592487 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:05.592487 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:05.592487 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 03:01:05.592487 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:01:05.592487 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 03:01:05.592487 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:01:05.592487 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 471/926] 10.222.0.65 () {56 vars in 1126 bytes} [Tue May 10 03:01:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:01:05.593341 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf84fb5-9c18-4cab-ba67-3ca0d8394712 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:05.652033 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 456/927] 10.222.0.65 () {60 vars in 1144 bytes} [Tue May 10 03:01:05 2022] POST /identity/v3/endpoints => generated 347 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:01:05.699573 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf84fb5-9c18-4cab-ba67-3ca0d8394712 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:05.742611 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b98c4d-7cfa-4b63-8806-77b66e6dbcf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:05.743297 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b98c4d-7cfa-4b63-8806-77b66e6dbcf3 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:05.743582 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b98c4d-7cfa-4b63-8806-77b66e6dbcf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:05.743858 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b98c4d-7cfa-4b63-8806-77b66e6dbcf3 None admin] PATH_INFO: `/v3/services` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:05.744611 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b98c4d-7cfa-4b63-8806-77b66e6dbcf3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:05.744919 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b98c4d-7cfa-4b63-8806-77b66e6dbcf3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:05.746307 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b98c4d-7cfa-4b63-8806-77b66e6dbcf3 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:05.752078 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 472/928] 10.222.0.65 () {56 vars in 1122 bytes} [Tue May 10 03:01:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:01:05.758365 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e43ca8-3e98-4d1f-a88d-bef700223b2f None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:05.870986 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e43ca8-3e98-4d1f-a88d-bef700223b2f None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:05.906438 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a03d4-6d7f-4f01-8dcd-85ac61fdb8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:05.907788 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a03d4-6d7f-4f01-8dcd-85ac61fdb8a4 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:05.908303 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a03d4-6d7f-4f01-8dcd-85ac61fdb8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:05.908776 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a03d4-6d7f-4f01-8dcd-85ac61fdb8a4 None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:05.909682 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47a03d4-6d7f-4f01-8dcd-85ac61fdb8a4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:05.910270 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47a03d4-6d7f-4f01-8dcd-85ac61fdb8a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:05.912424 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47a03d4-6d7f-4f01-8dcd-85ac61fdb8a4 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:05.918268 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 457/929] 10.222.0.65 () {56 vars in 1122 bytes} [Tue May 10 03:01:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:05.928057 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b98c4d-7cfa-4b63-8806-77b66e6dbcf3 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:06.026336 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b98c4d-7cfa-4b63-8806-77b66e6dbcf3 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:06.060992 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32351d0-4cbd-47db-b166-f9ab1d5d3422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:06.061658 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32351d0-4cbd-47db-b166-f9ab1d5d3422 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:06.061943 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32351d0-4cbd-47db-b166-f9ab1d5d3422 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:06.062261 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32351d0-4cbd-47db-b166-f9ab1d5d3422 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:06.063029 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32351d0-4cbd-47db-b166-f9ab1d5d3422 None admin] RBAC: Adding query filter params (interface=public, service_id=916ea52531954ec78db8b51401272141, region_id=RegionOne) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:06.063338 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32351d0-4cbd-47db-b166-f9ab1d5d3422 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:06.064727 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32351d0-4cbd-47db-b166-f9ab1d5d3422 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:06.070259 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 473/930] 10.222.0.65 () {56 vars in 1251 bytes} [Tue May 10 03:01:05 2022] GET /identity/v3/endpoints?service_id=916ea52531954ec78db8b51401272141&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:06.075749 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a03d4-6d7f-4f01-8dcd-85ac61fdb8a4 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:06.182328 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a03d4-6d7f-4f01-8dcd-85ac61fdb8a4 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:06.215617 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8dc527-c3ce-4500-b20c-791482903d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:06.216318 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8dc527-c3ce-4500-b20c-791482903d85 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:06.216604 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8dc527-c3ce-4500-b20c-791482903d85 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:06.216882 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8dc527-c3ce-4500-b20c-791482903d85 None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:06.217567 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8dc527-c3ce-4500-b20c-791482903d85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:06.218938 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8dc527-c3ce-4500-b20c-791482903d85 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:06.225856 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 458/931] 10.222.0.65 () {56 vars in 1087 bytes} [Tue May 10 03:01:06 2022] GET /identity/v3/services => generated 1497 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:01:06.293828 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c4196-28e6-46a0-ba4a-aabfc9a31c46 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:06.294503 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c4196-28e6-46a0-ba4a-aabfc9a31c46 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:06.295029 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c4196-28e6-46a0-ba4a-aabfc9a31c46 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:06.297087 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 474/932] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:01:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:06.303293 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845269b-0720-41aa-939e-2c6ff8ea33cc None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:06.303945 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845269b-0720-41aa-939e-2c6ff8ea33cc None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:06.304429 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845269b-0720-41aa-939e-2c6ff8ea33cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:06.327426 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-5845269b-0720-41aa-939e-2c6ff8ea33cc None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:06.329033 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-5845269b-0720-41aa-939e-2c6ff8ea33cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:06.408102 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 459/933] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:01:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:01:06.424646 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c4196-28e6-46a0-ba4a-aabfc9a31c46 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:06.540096 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c4196-28e6-46a0-ba4a-aabfc9a31c46 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:06.579833 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed616e0b-b22e-4910-af84-cc89cec79e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:06.580682 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed616e0b-b22e-4910-af84-cc89cec79e14 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:06.581086 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed616e0b-b22e-4910-af84-cc89cec79e14 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:06.581374 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed616e0b-b22e-4910-af84-cc89cec79e14 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:06.592018 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed616e0b-b22e-4910-af84-cc89cec79e14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:01:06.600380 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-ed616e0b-b22e-4910-af84-cc89cec79e14 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 03:01:06.600380 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:06.600380 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:06.600380 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:06.600380 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:06.600380 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:06.600380 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:06.600380 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:06.600380 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:06.600380 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:06.600380 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:06.600380 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:06.600380 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:01:06.600380 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:01:06.600380 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:01:06.600380 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:01:06.601318 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:01:06.601318 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:01:06.601318 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:01:06.601318 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:01:06.601318 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:06.601318 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:06.601318 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:06.601318 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:06.601318 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:06.601318 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:06.601318 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:06.601318 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:01:06.601318 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:06.601318 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:06.601318 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:06.601318 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:06.602640 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:06.602640 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:06.602640 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:06.602640 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:06.602640 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:01:06.602640 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:01:06.602640 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:01:06.602640 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:01:06.602640 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:01:06.602640 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:01:06.602640 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 03:01:06.602640 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:01:06.602640 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 475/934] 10.222.0.65 () {56 vars in 1120 bytes} [Tue May 10 03:01:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:06.607728 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5845269b-0720-41aa-939e-2c6ff8ea33cc None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:06.708757 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5845269b-0720-41aa-939e-2c6ff8ea33cc None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:06.747932 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d5f6f-b99b-411e-8290-6befd9a45c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:06.748636 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d5f6f-b99b-411e-8290-6befd9a45c6d None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:06.748919 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d5f6f-b99b-411e-8290-6befd9a45c6d None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:06.749247 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d5f6f-b99b-411e-8290-6befd9a45c6d None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:06.750004 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540d5f6f-b99b-411e-8290-6befd9a45c6d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:06.750313 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540d5f6f-b99b-411e-8290-6befd9a45c6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:06.751682 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540d5f6f-b99b-411e-8290-6befd9a45c6d None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:06.760146 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 460/935] 10.222.0.65 () {56 vars in 1115 bytes} [Tue May 10 03:01:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:06.765931 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed616e0b-b22e-4910-af84-cc89cec79e14 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:06.872377 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed616e0b-b22e-4910-af84-cc89cec79e14 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:06.905149 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f1a6a6-8652-4278-8915-76e7a75aaf2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:06.905946 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1a6a6-8652-4278-8915-76e7a75aaf2a None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:06.906277 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1a6a6-8652-4278-8915-76e7a75aaf2a None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:06.906561 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1a6a6-8652-4278-8915-76e7a75aaf2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:06.922045 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f1a6a6-8652-4278-8915-76e7a75aaf2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:06.923495 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f1a6a6-8652-4278-8915-76e7a75aaf2a None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:06.945475 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-c3f1a6a6-8652-4278-8915-76e7a75aaf2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:06.945475 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:06.945475 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:06.945475 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:06.945475 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:06.945475 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:06.945475 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:06.945475 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:06.945475 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:06.945475 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:06.945475 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:06.945475 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:06.945475 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:06.945475 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:06.945475 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:06.946410 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:06.946410 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:06.946410 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:06.946410 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:06.946410 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:06.946410 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:06.946410 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:06.946410 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:06.946410 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:01:06.946410 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:06.946410 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:06.946410 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:06.946410 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:06.946410 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:06.946410 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:06.946410 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:06.946410 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:06.947383 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:06.947383 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:06.947383 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:06.947383 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:01:06.950646 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 476/936] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:01:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:06.956985 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d5f6f-b99b-411e-8290-6befd9a45c6d None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:06.998364 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b898b-dfa0-45d6-adc9-607f9aed6fc5 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:06.998364 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b898b-dfa0-45d6-adc9-607f9aed6fc5 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:06.998364 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b898b-dfa0-45d6-adc9-607f9aed6fc5 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:06.998364 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 477/937] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:01:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:01:06.998364 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd86116-4e69-47eb-8e80-a17b9d898c88 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:06.998364 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd86116-4e69-47eb-8e80-a17b9d898c88 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:06.998909 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd86116-4e69-47eb-8e80-a17b9d898c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:07.013547 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-7cd86116-4e69-47eb-8e80-a17b9d898c88 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:07.015100 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-7cd86116-4e69-47eb-8e80-a17b9d898c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:07.060908 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d5f6f-b99b-411e-8290-6befd9a45c6d None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:07.085633 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 478/938] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:01:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:01:07.099554 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb07f1-5c6e-438b-8e0d-b418d8e04adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:07.100359 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb07f1-5c6e-438b-8e0d-b418d8e04adb None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:07.100641 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb07f1-5c6e-438b-8e0d-b418d8e04adb None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:07.100918 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb07f1-5c6e-438b-8e0d-b418d8e04adb None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:07.101642 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedb07f1-5c6e-438b-8e0d-b418d8e04adb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:07.101949 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedb07f1-5c6e-438b-8e0d-b418d8e04adb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:07.103382 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedb07f1-5c6e-438b-8e0d-b418d8e04adb None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:07.108030 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd86116-4e69-47eb-8e80-a17b9d898c88 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:07.115934 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 461/939] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:01:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:07.121301 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb07f1-5c6e-438b-8e0d-b418d8e04adb None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:07.209682 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd86116-4e69-47eb-8e80-a17b9d898c88 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:07.220386 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb07f1-5c6e-438b-8e0d-b418d8e04adb None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:07.244611 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb2d8ba-5c70-419f-8d48-e318510fd3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:07.245836 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2d8ba-5c70-419f-8d48-e318510fd3fa None admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:07.246331 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2d8ba-5c70-419f-8d48-e318510fd3fa None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:07.246814 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2d8ba-5c70-419f-8d48-e318510fd3fa None admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:07.247732 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb2d8ba-5c70-419f-8d48-e318510fd3fa None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:07.249447 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb2d8ba-5c70-419f-8d48-e318510fd3fa None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:07.251040 dv-cinder-830094-4-smb devstack@keystone.service[80197]: WARNING keystone.server.flask.common [None req-8bb2d8ba-5c70-419f-8d48-e318510fd3fa None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 10 03:01:07.257424 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e58fba-817c-4c6f-a636-a6152007feff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:07.258241 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e58fba-817c-4c6f-a636-a6152007feff None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:07.258525 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e58fba-817c-4c6f-a636-a6152007feff None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:07.258801 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e58fba-817c-4c6f-a636-a6152007feff None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:07.266357 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e58fba-817c-4c6f-a636-a6152007feff None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:07.267869 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e58fba-817c-4c6f-a636-a6152007feff None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:07.284149 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-a3e58fba-817c-4c6f-a636-a6152007feff None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 03:01:07.284149 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:07.284149 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:07.284149 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:07.284149 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:07.284149 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:07.284149 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:07.284149 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:07.284149 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:07.284149 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:07.284149 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:07.284149 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:07.284149 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:01:07.284149 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:01:07.284149 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:01:07.284149 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:01:07.285105 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:07.285105 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:07.285105 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:01:07.285105 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:07.285105 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:01:07.285105 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:07.285105 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:07.285105 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:07.285105 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:07.285105 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:07.285105 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:07.285105 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:01:07.285105 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:07.285105 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:07.285105 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:07.285105 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:07.285105 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:07.285105 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:07.286639 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:07.286639 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:07.286639 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:01:07.286639 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:01:07.286639 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:01:07.286639 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:01:07.286639 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:01:07.286639 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:01:07.286639 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 03:01:07.286639 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:01:07.290446 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 462/940] 10.222.0.65 () {56 vars in 1117 bytes} [Tue May 10 03:01:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:01:07.291385 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e58fba-817c-4c6f-a636-a6152007feff None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:07.301253 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.sql.core [None req-8bb2d8ba-5c70-419f-8d48-e318510fd3fa None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 10 03:01:07.301253 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 10 03:01:07.301253 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [parameters: {'id': 'ea43278a276f4a0ab5e929a5253a8c04', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 10 03:01:07.301253 dv-cinder-830094-4-smb devstack@keystone.service[80197]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80197) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 10 03:01:07.324092 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-8bb2d8ba-5c70-419f-8d48-e318510fd3fa None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ea43278a276f4a0ab5e929a5253a8c04.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ea43278a276f4a0ab5e929a5253a8c04. May 10 03:01:07.324092 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:07.324092 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 03:01:07.324092 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 03:01:07.324092 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 03:01:07.324092 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 03:01:07.324092 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 03:01:07.324092 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application result = self._query(query) May 10 03:01:07.324092 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 03:01:07.324092 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application conn.query(q) May 10 03:01:07.324092 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 03:01:07.324092 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 03:01:07.324092 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 03:01:07.324951 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application result.read() May 10 03:01:07.324951 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 03:01:07.324951 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 03:01:07.324951 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 03:01:07.324951 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 03:01:07.324951 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 03:01:07.324951 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 03:01:07.324951 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 03:01:07.324951 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 03:01:07.324951 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 10 03:01:07.324951 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:01:07.324951 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 10 03:01:07.324951 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:01:07.324951 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:07.324951 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 10 03:01:07.324951 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 10 03:01:07.324951 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 10 03:01:07.324951 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return project_ref.to_dict() May 10 03:01:07.325933 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 03:01:07.325933 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application next(self.gen) May 10 03:01:07.325933 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 10 03:01:07.325933 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application yield resource May 10 03:01:07.325933 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 03:01:07.325933 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application next(self.gen) May 10 03:01:07.325933 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 10 03:01:07.325933 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application self.session.rollback() May 10 03:01:07.325933 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 03:01:07.325933 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application self.force_reraise() May 10 03:01:07.325933 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 03:01:07.325933 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise self.value May 10 03:01:07.325933 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 10 03:01:07.325933 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 10 03:01:07.325933 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 10 03:01:07.325933 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application session.commit() May 10 03:01:07.325933 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 10 03:01:07.326833 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 10 03:01:07.326833 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 10 03:01:07.326833 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application self._prepare_impl() May 10 03:01:07.326833 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 10 03:01:07.326833 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application self.session.flush() May 10 03:01:07.326833 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 10 03:01:07.326833 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application self._flush(objects) May 10 03:01:07.326833 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 10 03:01:07.326833 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 10 03:01:07.326833 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 10 03:01:07.326833 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application compat.raise_( May 10 03:01:07.326833 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 03:01:07.326833 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception May 10 03:01:07.326833 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 10 03:01:07.326833 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application flush_context.execute() May 10 03:01:07.326833 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 10 03:01:07.326833 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rec.execute(self) May 10 03:01:07.327716 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 10 03:01:07.327716 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 10 03:01:07.327716 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 10 03:01:07.327716 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application _emit_insert_statements( May 10 03:01:07.327716 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 10 03:01:07.327716 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application c = connection._execute_20( May 10 03:01:07.327716 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 10 03:01:07.327716 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 10 03:01:07.327716 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 10 03:01:07.327716 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 10 03:01:07.327716 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 10 03:01:07.327716 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ret = self._execute_context( May 10 03:01:07.327716 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 10 03:01:07.327716 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 10 03:01:07.327716 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 10 03:01:07.338881 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 10 03:01:07.338881 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 03:01:07.338881 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception May 10 03:01:07.338881 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 03:01:07.338881 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 03:01:07.338881 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 03:01:07.338881 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 03:01:07.338881 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 03:01:07.338881 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application result = self._query(query) May 10 03:01:07.338881 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 03:01:07.338881 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application conn.query(q) May 10 03:01:07.338881 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 03:01:07.338881 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 03:01:07.338881 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 03:01:07.338881 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application result.read() May 10 03:01:07.338881 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 03:01:07.338881 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 03:01:07.339792 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 03:01:07.339792 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 03:01:07.339792 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 03:01:07.339792 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 03:01:07.339792 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 03:01:07.339792 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 03:01:07.339792 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 10 03:01:07.339792 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 10 03:01:07.339792 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [parameters: {'id': 'ea43278a276f4a0ab5e929a5253a8c04', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 10 03:01:07.339792 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 10 03:01:07.339792 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:01:07.339792 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 03:01:07.339792 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:01:07.339792 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:07.339792 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 10 03:01:07.340625 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 10 03:01:07.340625 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 10 03:01:07.340625 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 10 03:01:07.340625 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 10 03:01:07.340625 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:01:07.340625 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 03:01:07.340625 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:01:07.340625 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:07.340625 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:07.340625 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:07.340625 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:07.340625 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:07.340625 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:07.340625 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:07.340625 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:07.340625 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:07.340625 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:07.341505 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:07.341505 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 10 03:01:07.341505 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 10 03:01:07.341505 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:07.341505 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:07.341505 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 10 03:01:07.341505 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.Conflict( May 10 03:01:07.341505 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ea43278a276f4a0ab5e929a5253a8c04. May 10 03:01:07.341505 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:01:07.341505 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 479/941] 10.222.0.65 () {60 vars in 1140 bytes} [Tue May 10 03:01:07 2022] POST /identity/v3/projects => generated 262 bytes in 223 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 10 03:01:07.341505 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb2d8ba-5c70-419f-8d48-e318510fd3fa None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:07.422153 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e58fba-817c-4c6f-a636-a6152007feff None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:07.465754 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb2d8ba-5c70-419f-8d48-e318510fd3fa None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:07.472895 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfcb6b0-e933-4f01-8f72-e77e64f7f198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:07.473888 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfcb6b0-e933-4f01-8f72-e77e64f7f198 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:07.474312 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfcb6b0-e933-4f01-8f72-e77e64f7f198 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:07.475169 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfcb6b0-e933-4f01-8f72-e77e64f7f198 None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:07.476192 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfcb6b0-e933-4f01-8f72-e77e64f7f198 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:07.476999 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfcb6b0-e933-4f01-8f72-e77e64f7f198 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:07.478934 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfcb6b0-e933-4f01-8f72-e77e64f7f198 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:07.502624 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 463/942] 10.222.0.65 () {56 vars in 1149 bytes} [Tue May 10 03:01:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:07.508491 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfcb6b0-e933-4f01-8f72-e77e64f7f198 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:07.509287 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b65171d-e89f-4127-9478-63fbd9153b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:07.510311 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b65171d-e89f-4127-9478-63fbd9153b6e None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:07.510889 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b65171d-e89f-4127-9478-63fbd9153b6e None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:07.511332 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b65171d-e89f-4127-9478-63fbd9153b6e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:07.518694 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b65171d-e89f-4127-9478-63fbd9153b6e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:07.521339 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b65171d-e89f-4127-9478-63fbd9153b6e None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:07.536807 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-9b65171d-e89f-4127-9478-63fbd9153b6e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:01:07.536807 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:07.536807 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:07.536807 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:07.536807 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:07.536807 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:07.536807 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:07.536807 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:07.536807 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:07.536807 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:07.536807 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:07.536807 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:07.536807 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:01:07.536807 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:01:07.536807 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:01:07.537733 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:01:07.537733 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:07.537733 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:07.537733 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:07.537733 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:07.537733 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:07.537733 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:07.537733 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:07.537733 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:01:07.537733 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:07.537733 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:07.537733 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:07.537733 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:07.537733 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:07.537733 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:07.537733 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:07.537733 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:07.538630 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:01:07.538630 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:01:07.538630 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:01:07.538630 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:01:07.538630 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:01:07.538630 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:01:07.538630 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:01:07.538630 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:01:07.545753 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 480/943] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 10 03:01:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:07.546921 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b65171d-e89f-4127-9478-63fbd9153b6e None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:07.613804 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfcb6b0-e933-4f01-8f72-e77e64f7f198 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:07.646849 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b65171d-e89f-4127-9478-63fbd9153b6e None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:07.649110 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541789fe-bae2-4b0b-a994-66a69205769c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:07.650685 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541789fe-bae2-4b0b-a994-66a69205769c None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:07.650685 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541789fe-bae2-4b0b-a994-66a69205769c None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:07.650685 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541789fe-bae2-4b0b-a994-66a69205769c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:07.660953 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541789fe-bae2-4b0b-a994-66a69205769c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:07.662405 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541789fe-bae2-4b0b-a994-66a69205769c None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:07.680110 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-541789fe-bae2-4b0b-a994-66a69205769c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:07.680110 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:07.680110 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:07.680110 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:07.680110 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:07.680110 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:07.680110 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:07.680110 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:07.680110 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:07.680110 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:07.680110 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:07.680110 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:07.680110 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:07.680110 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:07.680110 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:07.681036 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:07.681036 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:07.681036 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:07.681036 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:07.681036 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:07.681036 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:07.681036 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:07.681036 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:07.681036 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:01:07.681036 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:07.681036 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:07.681036 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:07.681036 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:07.681036 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:07.681036 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:07.681036 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:07.681036 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:07.681936 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:07.681936 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:07.681936 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:07.681936 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:01:07.684149 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 464/944] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:01:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:01:07.687190 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541789fe-bae2-4b0b-a994-66a69205769c None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:07.688853 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6408ba15-9da0-4a07-bdab-d3aaa0f18511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:07.689526 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408ba15-9da0-4a07-bdab-d3aaa0f18511 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:07.689810 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408ba15-9da0-4a07-bdab-d3aaa0f18511 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:07.690080 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408ba15-9da0-4a07-bdab-d3aaa0f18511 None admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:07.690842 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6408ba15-9da0-4a07-bdab-d3aaa0f18511 None admin] RBAC: Adding query filter params (name=service) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:07.691144 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6408ba15-9da0-4a07-bdab-d3aaa0f18511 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:07.693792 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6408ba15-9da0-4a07-bdab-d3aaa0f18511 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:07.720151 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 481/945] 10.222.0.65 () {56 vars in 1112 bytes} [Tue May 10 03:01:07 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:07.800985 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541789fe-bae2-4b0b-a994-66a69205769c None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:07.842488 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92be8837-178e-46ce-814e-d5431e00f56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:07.843576 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be8837-178e-46ce-814e-d5431e00f56f None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:07.844094 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be8837-178e-46ce-814e-d5431e00f56f None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:07.844651 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be8837-178e-46ce-814e-d5431e00f56f None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:07.845639 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92be8837-178e-46ce-814e-d5431e00f56f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:07.846154 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92be8837-178e-46ce-814e-d5431e00f56f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:07.847834 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92be8837-178e-46ce-814e-d5431e00f56f None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:07.861370 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 465/946] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:01:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:07.867881 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6408ba15-9da0-4a07-bdab-d3aaa0f18511 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:07.969853 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6408ba15-9da0-4a07-bdab-d3aaa0f18511 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:07.997292 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271a905-3dbc-4aed-80d7-053ab76d964b None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:07.998252 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271a905-3dbc-4aed-80d7-053ab76d964b None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:07.998760 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271a905-3dbc-4aed-80d7-053ab76d964b None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:08.001674 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 466/947] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:01:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:01:08.007321 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925ab1d-00de-4d1f-b733-fc505ec2686e None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:08.007560 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925ab1d-00de-4d1f-b733-fc505ec2686e None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:08.007823 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925ab1d-00de-4d1f-b733-fc505ec2686e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:08.009785 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a50af-1859-4c87-9d96-91af2baabadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:08.010586 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a50af-1859-4c87-9d96-91af2baabadc None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:08.010872 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a50af-1859-4c87-9d96-91af2baabadc None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:08.011149 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a50af-1859-4c87-9d96-91af2baabadc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:08.019405 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4a50af-1859-4c87-9d96-91af2baabadc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:08.026750 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4a50af-1859-4c87-9d96-91af2baabadc None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:08.028249 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-3925ab1d-00de-4d1f-b733-fc505ec2686e None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:08.029465 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-3925ab1d-00de-4d1f-b733-fc505ec2686e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:08.036434 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-4e4a50af-1859-4c87-9d96-91af2baabadc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:01:08.036434 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:08.036434 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:08.036434 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:08.036434 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:08.036434 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:08.036434 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:08.036434 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:08.036434 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:08.036434 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:08.036434 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:08.036434 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:08.036434 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:01:08.036434 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:01:08.036434 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:01:08.037396 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:01:08.037396 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:08.037396 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:08.037396 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:08.037396 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:08.037396 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:08.037396 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:08.037396 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:08.037396 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:01:08.037396 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:08.037396 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:08.037396 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:08.037396 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:08.037396 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:08.037396 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:08.037396 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:08.037396 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:08.038307 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:01:08.038307 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:01:08.038307 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:01:08.038307 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:01:08.038307 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:01:08.038307 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:01:08.038307 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:01:08.038307 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:01:08.038307 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 482/948] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 10 03:01:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:08.043580 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a50af-1859-4c87-9d96-91af2baabadc None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:08.109337 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 467/949] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:01:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:01:08.130313 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3925ab1d-00de-4d1f-b733-fc505ec2686e None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:08.156109 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a50af-1859-4c87-9d96-91af2baabadc None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:08.200162 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd6feb6-1d85-48f8-924b-2ec2971afb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:08.200992 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6feb6-1d85-48f8-924b-2ec2971afb5f None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:08.201599 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6feb6-1d85-48f8-924b-2ec2971afb5f None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:08.201893 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6feb6-1d85-48f8-924b-2ec2971afb5f None admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:08.202963 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd6feb6-1d85-48f8-924b-2ec2971afb5f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:08.203274 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd6feb6-1d85-48f8-924b-2ec2971afb5f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:08.204884 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd6feb6-1d85-48f8-924b-2ec2971afb5f None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:08.224112 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 483/950] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 10 03:01:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:08.227501 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd6feb6-1d85-48f8-924b-2ec2971afb5f None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:08.249077 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3925ab1d-00de-4d1f-b733-fc505ec2686e None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:08.293366 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c661bf-f54b-4226-aca2-d5ed31cb78f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:08.294204 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c661bf-f54b-4226-aca2-d5ed31cb78f3 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:08.294485 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c661bf-f54b-4226-aca2-d5ed31cb78f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:08.294761 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c661bf-f54b-4226-aca2-d5ed31cb78f3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:08.295423 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c661bf-f54b-4226-aca2-d5ed31cb78f3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:08.297277 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c661bf-f54b-4226-aca2-d5ed31cb78f3 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:08.312462 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-c2c661bf-f54b-4226-aca2-d5ed31cb78f3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 10 03:01:08.312462 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:08.312462 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 03:01:08.312462 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 03:01:08.312462 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 03:01:08.312462 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 03:01:08.312462 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 03:01:08.312462 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:01:08.312462 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 03:01:08.312462 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:01:08.312462 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 03:01:08.312462 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:01:08.312462 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:08.312462 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:08.312462 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:08.312462 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:08.312462 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:08.313520 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:08.313520 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:08.313520 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:08.313520 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:08.313520 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:08.313520 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:08.313520 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 03:01:08.313520 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 03:01:08.313520 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 03:01:08.313520 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 03:01:08.313520 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:08.313520 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:08.313520 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:08.313520 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:08.313520 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:08.313520 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:08.314358 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:08.314358 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:01:08.314358 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:08.314358 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:08.314358 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:08.314358 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:08.314358 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:08.314358 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:08.314358 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:08.314358 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:08.314358 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 03:01:08.314358 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:01:08.314358 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 03:01:08.314358 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:01:08.319368 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 468/951] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 10 03:01:08 2022] GET /identity/v3/services/compute => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:01:08.320261 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c661bf-f54b-4226-aca2-d5ed31cb78f3 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:08.361396 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd6feb6-1d85-48f8-924b-2ec2971afb5f None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:08.396346 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f10d64-620d-4df8-a56c-43b8a6485cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:08.397301 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f10d64-620d-4df8-a56c-43b8a6485cb0 None admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:08.397607 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f10d64-620d-4df8-a56c-43b8a6485cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:08.397947 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f10d64-620d-4df8-a56c-43b8a6485cb0 None admin] PATH_INFO: `/v3/projects/513e6592cd83457b8ff461b0e5e1fd40/users/6ebfab3ff0b24f4aaabb8c6bb0ad10c6/roles/6c4dad34321647f5a6822a530300110c` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:08.400423 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f10d64-620d-4df8-a56c-43b8a6485cb0 None admin] RBAC: Authorizing `identity:create_grant(project_id=513e6592cd83457b8ff461b0e5e1fd40, user_id=6ebfab3ff0b24f4aaabb8c6bb0ad10c6, role_id=6c4dad34321647f5a6822a530300110c)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:08.401897 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f10d64-620d-4df8-a56c-43b8a6485cb0 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:08.433210 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c661bf-f54b-4226-aca2-d5ed31cb78f3 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:08.480339 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865cca0b-5ff7-4998-a9de-4789a3a2a300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:08.480339 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865cca0b-5ff7-4998-a9de-4789a3a2a300 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:08.480339 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865cca0b-5ff7-4998-a9de-4789a3a2a300 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:08.480339 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865cca0b-5ff7-4998-a9de-4789a3a2a300 None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:08.480778 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865cca0b-5ff7-4998-a9de-4789a3a2a300 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:08.480778 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865cca0b-5ff7-4998-a9de-4789a3a2a300 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:08.480778 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865cca0b-5ff7-4998-a9de-4789a3a2a300 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:08.481940 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 484/952] 10.222.0.65 () {58 vars in 1439 bytes} [Tue May 10 03:01:08 2022] PUT /identity/v3/projects/513e6592cd83457b8ff461b0e5e1fd40/users/6ebfab3ff0b24f4aaabb8c6bb0ad10c6/roles/6c4dad34321647f5a6822a530300110c => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:01:08.489810 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 469/953] 10.222.0.65 () {56 vars in 1112 bytes} [Tue May 10 03:01:08 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:08.491023 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f10d64-620d-4df8-a56c-43b8a6485cb0 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:08.587734 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb61a3b-d940-4257-b531-485af9674ab5 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:08.588084 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb61a3b-d940-4257-b531-485af9674ab5 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:08.588349 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb61a3b-d940-4257-b531-485af9674ab5 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:08.592157 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 470/954] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:01:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:01:08.595963 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb8c18-4f7d-4838-a233-91030fbab15e None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:08.596295 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb8c18-4f7d-4838-a233-91030fbab15e None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:08.596577 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb8c18-4f7d-4838-a233-91030fbab15e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:08.601423 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f10d64-620d-4df8-a56c-43b8a6485cb0 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:08.618614 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-12eb8c18-4f7d-4838-a233-91030fbab15e None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:08.619761 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-12eb8c18-4f7d-4838-a233-91030fbab15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:08.645295 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b39d6c5-9ab1-4505-80ed-d25dfeea10e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:08.646399 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b39d6c5-9ab1-4505-80ed-d25dfeea10e8 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:08.646830 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b39d6c5-9ab1-4505-80ed-d25dfeea10e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:08.647247 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b39d6c5-9ab1-4505-80ed-d25dfeea10e8 None admin] PATH_INFO: `/v3/services` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:08.648109 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b39d6c5-9ab1-4505-80ed-d25dfeea10e8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:08.648467 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b39d6c5-9ab1-4505-80ed-d25dfeea10e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:08.649871 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b39d6c5-9ab1-4505-80ed-d25dfeea10e8 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:08.658423 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 485/955] 10.222.0.65 () {56 vars in 1112 bytes} [Tue May 10 03:01:08 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:08.705071 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 471/956] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:01:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 03:01:08.728705 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b39d6c5-9ab1-4505-80ed-d25dfeea10e8 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:08.844338 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b39d6c5-9ab1-4505-80ed-d25dfeea10e8 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:08.881368 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301cb3f7-9f06-4f2b-bfbc-0fbb02b25c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:08.882188 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301cb3f7-9f06-4f2b-bfbc-0fbb02b25c34 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:08.882471 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301cb3f7-9f06-4f2b-bfbc-0fbb02b25c34 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:08.882744 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301cb3f7-9f06-4f2b-bfbc-0fbb02b25c34 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:08.883410 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301cb3f7-9f06-4f2b-bfbc-0fbb02b25c34 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:08.884896 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301cb3f7-9f06-4f2b-bfbc-0fbb02b25c34 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:08.897993 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-301cb3f7-9f06-4f2b-bfbc-0fbb02b25c34 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 03:01:08.897993 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:08.897993 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 03:01:08.897993 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 03:01:08.897993 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 03:01:08.897993 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 03:01:08.897993 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 03:01:08.897993 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:01:08.897993 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 03:01:08.897993 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:01:08.897993 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 03:01:08.897993 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:01:08.897993 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:08.897993 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:08.897993 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:08.897993 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:08.897993 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:08.899011 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:08.899011 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:08.899011 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:08.899011 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:08.899011 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:08.899011 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:08.899011 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 03:01:08.899011 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 03:01:08.899011 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 03:01:08.899011 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 03:01:08.899011 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:08.899011 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:08.899011 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:08.899011 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:08.899011 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:08.899011 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:08.900276 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:08.900276 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:01:08.900276 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:08.900276 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:08.900276 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:08.900276 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:08.900276 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:08.900276 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:08.900276 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:08.900276 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:08.900276 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 03:01:08.900276 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:01:08.900276 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 03:01:08.900276 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:01:08.900276 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 486/957] 10.222.0.65 () {56 vars in 1126 bytes} [Tue May 10 03:01:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:08.908468 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb8c18-4f7d-4838-a233-91030fbab15e None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:09.012508 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb8c18-4f7d-4838-a233-91030fbab15e None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:09.048779 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8bb756-3f32-4f9d-af01-4c398c0f67e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:09.049471 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8bb756-3f32-4f9d-af01-4c398c0f67e7 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:09.049760 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8bb756-3f32-4f9d-af01-4c398c0f67e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:09.050046 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8bb756-3f32-4f9d-af01-4c398c0f67e7 None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:09.050821 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8bb756-3f32-4f9d-af01-4c398c0f67e7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:09.051134 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8bb756-3f32-4f9d-af01-4c398c0f67e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:09.053579 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8bb756-3f32-4f9d-af01-4c398c0f67e7 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:09.059044 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 472/958] 10.222.0.65 () {56 vars in 1122 bytes} [Tue May 10 03:01:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:09.064514 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301cb3f7-9f06-4f2b-bfbc-0fbb02b25c34 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:09.167788 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301cb3f7-9f06-4f2b-bfbc-0fbb02b25c34 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:09.203165 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f1a811-ce06-451c-83b0-0e78fdd1d761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:09.203841 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1a811-ce06-451c-83b0-0e78fdd1d761 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:09.204209 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1a811-ce06-451c-83b0-0e78fdd1d761 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:09.204498 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1a811-ce06-451c-83b0-0e78fdd1d761 None admin] PATH_INFO: `/v3/services` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:09.205215 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f1a811-ce06-451c-83b0-0e78fdd1d761 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:09.205526 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f1a811-ce06-451c-83b0-0e78fdd1d761 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:09.206893 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f1a811-ce06-451c-83b0-0e78fdd1d761 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:09.212182 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 487/959] 10.222.0.65 () {56 vars in 1122 bytes} [Tue May 10 03:01:09 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:09.217788 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8bb756-3f32-4f9d-af01-4c398c0f67e7 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:09.325949 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8bb756-3f32-4f9d-af01-4c398c0f67e7 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:09.361101 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07fa1c4-a0f4-4f05-816c-4a8725a3654e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:09.361769 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07fa1c4-a0f4-4f05-816c-4a8725a3654e None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:09.362054 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07fa1c4-a0f4-4f05-816c-4a8725a3654e None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:09.362336 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07fa1c4-a0f4-4f05-816c-4a8725a3654e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:09.363091 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07fa1c4-a0f4-4f05-816c-4a8725a3654e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:09.364680 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07fa1c4-a0f4-4f05-816c-4a8725a3654e None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:09.444659 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 473/960] 10.222.0.65 () {60 vars in 1144 bytes} [Tue May 10 03:01:09 2022] POST /identity/v3/endpoints => generated 349 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:01:10.139918 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d1249-6688-473a-9472-fb6b0cb3adb6 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:10.140692 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d1249-6688-473a-9472-fb6b0cb3adb6 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:10.140692 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d1249-6688-473a-9472-fb6b0cb3adb6 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:10.142084 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 488/961] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:01:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:10.147762 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a4ecd-c37c-44f9-a1b3-49fcb7098bb8 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:10.148256 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a4ecd-c37c-44f9-a1b3-49fcb7098bb8 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:10.148411 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a4ecd-c37c-44f9-a1b3-49fcb7098bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:10.165514 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-c34a4ecd-c37c-44f9-a1b3-49fcb7098bb8 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:10.166706 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-c34a4ecd-c37c-44f9-a1b3-49fcb7098bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:10.240311 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 474/962] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:01:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:01:10.264948 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3d1249-6688-473a-9472-fb6b0cb3adb6 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:10.364507 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3d1249-6688-473a-9472-fb6b0cb3adb6 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:10.399827 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5369954e-84f2-4458-91b3-a9519cb006db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:10.400866 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369954e-84f2-4458-91b3-a9519cb006db None admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:10.401346 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369954e-84f2-4458-91b3-a9519cb006db None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:10.401830 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369954e-84f2-4458-91b3-a9519cb006db None admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:10.402746 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5369954e-84f2-4458-91b3-a9519cb006db None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:10.404375 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5369954e-84f2-4458-91b3-a9519cb006db None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:10.448452 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.sql.core [None req-5369954e-84f2-4458-91b3-a9519cb006db None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 10 03:01:10.448452 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 10 03:01:10.448452 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [parameters: {'user_id': '5f14fd3ff3914fd1bfb77c57a59cd1dc', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 10 03:01:10.448452 dv-cinder-830094-4-smb devstack@keystone.service[80197]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80197) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 10 03:01:10.459049 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-5369954e-84f2-4458-91b3-a9519cb006db None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 10 03:01:10.459049 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:10.459049 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 03:01:10.459049 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 03:01:10.459049 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 03:01:10.459049 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 03:01:10.459049 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 03:01:10.459049 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application result = self._query(query) May 10 03:01:10.459049 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 03:01:10.459049 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application conn.query(q) May 10 03:01:10.459049 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 03:01:10.459049 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 03:01:10.459049 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 03:01:10.459049 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application result.read() May 10 03:01:10.459049 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 03:01:10.465883 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 03:01:10.465883 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 03:01:10.465883 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 03:01:10.465883 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 03:01:10.465883 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 03:01:10.465883 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 03:01:10.465883 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 03:01:10.465883 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 10 03:01:10.465883 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:01:10.465883 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 10 03:01:10.465883 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:01:10.465883 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:10.465883 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 10 03:01:10.465883 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 10 03:01:10.465883 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 10 03:01:10.465883 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 10 03:01:10.465883 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 03:01:10.465883 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application next(self.gen) May 10 03:01:10.466823 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 10 03:01:10.466823 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application yield resource May 10 03:01:10.466823 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 03:01:10.466823 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application next(self.gen) May 10 03:01:10.466823 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 10 03:01:10.466823 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application self.session.rollback() May 10 03:01:10.466823 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 03:01:10.466823 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application self.force_reraise() May 10 03:01:10.466823 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 03:01:10.466823 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise self.value May 10 03:01:10.466823 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 10 03:01:10.466823 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 10 03:01:10.466823 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 10 03:01:10.466823 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application session.commit() May 10 03:01:10.466823 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 10 03:01:10.466823 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 10 03:01:10.466823 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 10 03:01:10.467695 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application self._prepare_impl() May 10 03:01:10.467695 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 10 03:01:10.467695 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application self.session.flush() May 10 03:01:10.467695 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 10 03:01:10.467695 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application self._flush(objects) May 10 03:01:10.467695 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 10 03:01:10.467695 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 10 03:01:10.467695 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 10 03:01:10.467695 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application compat.raise_( May 10 03:01:10.467695 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 03:01:10.467695 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception May 10 03:01:10.467695 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 10 03:01:10.467695 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application flush_context.execute() May 10 03:01:10.467695 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 10 03:01:10.467695 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rec.execute(self) May 10 03:01:10.467695 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 10 03:01:10.467695 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 10 03:01:10.468889 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 10 03:01:10.468889 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application _emit_insert_statements( May 10 03:01:10.468889 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 10 03:01:10.468889 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application result = connection._execute_20( May 10 03:01:10.468889 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 10 03:01:10.468889 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 10 03:01:10.468889 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 10 03:01:10.468889 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 10 03:01:10.468889 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 10 03:01:10.468889 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ret = self._execute_context( May 10 03:01:10.468889 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 10 03:01:10.468889 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 10 03:01:10.468889 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 10 03:01:10.468889 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 10 03:01:10.468889 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 03:01:10.468889 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception May 10 03:01:10.469741 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 03:01:10.469741 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 03:01:10.469741 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 03:01:10.469741 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 03:01:10.469741 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 03:01:10.469741 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application result = self._query(query) May 10 03:01:10.469741 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 03:01:10.469741 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application conn.query(q) May 10 03:01:10.469741 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 03:01:10.469741 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 03:01:10.469741 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 03:01:10.469741 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application result.read() May 10 03:01:10.469741 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 03:01:10.469741 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 03:01:10.469741 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 03:01:10.469741 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 03:01:10.470585 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 03:01:10.470585 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 03:01:10.470585 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 03:01:10.470585 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 03:01:10.470585 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 10 03:01:10.470585 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 10 03:01:10.470585 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [parameters: {'user_id': '5f14fd3ff3914fd1bfb77c57a59cd1dc', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 10 03:01:10.470585 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 10 03:01:10.470585 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:01:10.470585 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 03:01:10.470585 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:01:10.470585 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:10.470585 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:10.470585 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:10.470585 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:10.471455 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:10.471455 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:10.471455 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:10.471455 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:10.471455 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:10.471455 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:10.471455 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:10.471455 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 10 03:01:10.471455 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 10 03:01:10.471455 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:10.471455 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:10.471455 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:01:10.471455 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:10.471455 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:01:10.471455 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:10.471455 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 10 03:01:10.471455 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 10 03:01:10.472548 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 10 03:01:10.472548 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 10 03:01:10.472548 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 10 03:01:10.472548 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 10 03:01:10.472548 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 10 03:01:10.472548 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:01:10.472548 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 489/963] 10.222.0.65 () {60 vars in 1131 bytes} [Tue May 10 03:01:10 2022] POST /identity/v3/users => generated 160 bytes in 194 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:10.472945 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a4ecd-c37c-44f9-a1b3-49fcb7098bb8 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:10.563844 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a4ecd-c37c-44f9-a1b3-49fcb7098bb8 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:10.598934 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5063bb71-816c-4ce2-b867-7d13fdf668fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:10.599774 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063bb71-816c-4ce2-b867-7d13fdf668fe None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:10.600083 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063bb71-816c-4ce2-b867-7d13fdf668fe None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:10.600358 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063bb71-816c-4ce2-b867-7d13fdf668fe None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:10.608873 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5063bb71-816c-4ce2-b867-7d13fdf668fe None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:10.610403 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5063bb71-816c-4ce2-b867-7d13fdf668fe None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:10.627548 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-5063bb71-816c-4ce2-b867-7d13fdf668fe None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 10 03:01:10.627548 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:10.627548 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:10.627548 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:10.627548 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:10.627548 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:10.627548 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:10.627548 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:10.627548 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:10.627548 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:10.627548 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:10.627548 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:10.627548 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:01:10.627548 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:01:10.627548 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:01:10.627548 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:01:10.629990 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:10.629990 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:10.629990 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:01:10.629990 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:10.629990 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:01:10.629990 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:10.629990 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:10.629990 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:10.629990 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:10.629990 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:10.629990 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:10.629990 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:01:10.629990 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:10.629990 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:10.629990 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:10.629990 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:10.629990 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:10.629990 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:10.632371 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:10.632371 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:10.632371 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:01:10.632371 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:01:10.632371 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:01:10.632371 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:01:10.632371 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:01:10.632371 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:01:10.632371 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 10 03:01:10.632371 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:01:10.632371 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 475/964] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 10 03:01:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:10.636114 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5369954e-84f2-4458-91b3-a9519cb006db None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:10.733762 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5369954e-84f2-4458-91b3-a9519cb006db None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:10.770516 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f7370-9d11-4ecc-a844-b7b08d6a251c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:10.771189 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f7370-9d11-4ecc-a844-b7b08d6a251c None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:10.771468 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f7370-9d11-4ecc-a844-b7b08d6a251c None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:10.771739 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f7370-9d11-4ecc-a844-b7b08d6a251c None admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:10.772634 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8f7370-9d11-4ecc-a844-b7b08d6a251c None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:10.772941 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8f7370-9d11-4ecc-a844-b7b08d6a251c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:10.774558 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8f7370-9d11-4ecc-a844-b7b08d6a251c None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:10.790692 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd207d59-52ba-4602-b967-cdda0a55a2c6 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:10.791005 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd207d59-52ba-4602-b967-cdda0a55a2c6 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:10.791245 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd207d59-52ba-4602-b967-cdda0a55a2c6 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:10.792976 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 476/965] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:01:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:10.798863 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80818fd4-9ac8-422a-85bb-44c42af50145 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:10.799176 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80818fd4-9ac8-422a-85bb-44c42af50145 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:10.799432 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80818fd4-9ac8-422a-85bb-44c42af50145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:10.816961 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 490/966] 10.222.0.65 () {56 vars in 1101 bytes} [Tue May 10 03:01:10 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:10.817545 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-80818fd4-9ac8-422a-85bb-44c42af50145 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:10.818849 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-80818fd4-9ac8-422a-85bb-44c42af50145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:10.893044 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 477/967] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:01:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 03:01:10.917985 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f7370-9d11-4ecc-a844-b7b08d6a251c None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:10.996833 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d10c0-1537-4897-8ab8-355bd9c3c089 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:10.996833 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d10c0-1537-4897-8ab8-355bd9c3c089 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:10.996833 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d10c0-1537-4897-8ab8-355bd9c3c089 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:10.999503 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 478/968] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:01:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:01:11.006034 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51bb919-b1e8-489b-a025-6f3ac1a61876 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:11.006679 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51bb919-b1e8-489b-a025-6f3ac1a61876 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:11.007163 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51bb919-b1e8-489b-a025-6f3ac1a61876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:11.028915 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-c51bb919-b1e8-489b-a025-6f3ac1a61876 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:11.030121 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-c51bb919-b1e8-489b-a025-6f3ac1a61876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:11.033910 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f7370-9d11-4ecc-a844-b7b08d6a251c None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:11.077906 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e451c99-ce7b-4545-b4d4-c2b2c2dad30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:11.078740 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e451c99-ce7b-4545-b4d4-c2b2c2dad30e None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:11.079021 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e451c99-ce7b-4545-b4d4-c2b2c2dad30e None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:11.079293 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e451c99-ce7b-4545-b4d4-c2b2c2dad30e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:11.090535 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e451c99-ce7b-4545-b4d4-c2b2c2dad30e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:01:11.099208 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-1e451c99-ce7b-4545-b4d4-c2b2c2dad30e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 03:01:11.099208 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:11.099208 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:11.099208 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:11.099208 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:11.099208 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:11.099208 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:11.099208 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:11.099208 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:11.099208 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:11.099208 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:11.099208 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:11.099208 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:01:11.099208 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:01:11.099208 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:01:11.099208 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:01:11.100228 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:01:11.100228 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:01:11.100228 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:01:11.100228 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:01:11.100228 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:11.100228 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:11.100228 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:11.100228 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:11.100228 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:11.100228 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:11.100228 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:11.100228 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:01:11.100228 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:11.100228 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:11.100228 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:11.100228 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:11.101095 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:11.101095 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:11.101095 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:11.101095 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:11.101095 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:01:11.101095 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:01:11.101095 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:01:11.101095 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:01:11.101095 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:01:11.101095 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:01:11.101095 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 03:01:11.101095 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:01:11.101095 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 491/969] 10.222.0.65 () {56 vars in 1120 bytes} [Tue May 10 03:01:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:11.108290 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e451c99-ce7b-4545-b4d4-c2b2c2dad30e None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:11.118299 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 479/970] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:01:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:01:11.139864 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51bb919-b1e8-489b-a025-6f3ac1a61876 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:11.212578 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e451c99-ce7b-4545-b4d4-c2b2c2dad30e None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:11.243294 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51bb919-b1e8-489b-a025-6f3ac1a61876 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:11.244721 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7034a991-dc4c-4642-b505-b82e89aa069c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:11.245393 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034a991-dc4c-4642-b505-b82e89aa069c None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:11.245687 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034a991-dc4c-4642-b505-b82e89aa069c None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:11.245968 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034a991-dc4c-4642-b505-b82e89aa069c None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:11.246731 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7034a991-dc4c-4642-b505-b82e89aa069c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:11.247099 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7034a991-dc4c-4642-b505-b82e89aa069c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:11.248457 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7034a991-dc4c-4642-b505-b82e89aa069c None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:11.257580 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 492/971] 10.222.0.65 () {56 vars in 1115 bytes} [Tue May 10 03:01:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:01:11.262653 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7034a991-dc4c-4642-b505-b82e89aa069c None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:11.283459 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c5b03-fb3f-4778-a791-dc077715eaed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:11.284182 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c5b03-fb3f-4778-a791-dc077715eaed None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:11.284467 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c5b03-fb3f-4778-a791-dc077715eaed None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:11.284747 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c5b03-fb3f-4778-a791-dc077715eaed None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:11.285484 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67c5b03-fb3f-4778-a791-dc077715eaed None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:11.286900 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67c5b03-fb3f-4778-a791-dc077715eaed None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:11.358030 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 480/972] 10.222.0.65 () {60 vars in 1141 bytes} [Tue May 10 03:01:11 2022] POST /identity/v3/services => generated 242 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:01:11.377900 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7034a991-dc4c-4642-b505-b82e89aa069c None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:11.427522 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00def32a-0588-4e1a-93e0-2db7eb843604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:11.428490 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00def32a-0588-4e1a-93e0-2db7eb843604 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:11.428775 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00def32a-0588-4e1a-93e0-2db7eb843604 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:11.429129 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00def32a-0588-4e1a-93e0-2db7eb843604 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:11.440644 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00def32a-0588-4e1a-93e0-2db7eb843604 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:11.442663 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00def32a-0588-4e1a-93e0-2db7eb843604 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:11.464353 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-00def32a-0588-4e1a-93e0-2db7eb843604 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:11.464353 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:11.464353 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:11.464353 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:11.464353 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:11.464353 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:11.464353 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:11.464353 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:11.464353 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:11.464353 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:11.464353 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:11.464353 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:11.464353 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:11.464353 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:11.464353 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:11.465508 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:11.465508 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:11.465508 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:11.465508 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:11.465508 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:11.465508 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:11.465508 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:11.465508 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:11.465508 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:01:11.465508 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:11.465508 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:11.465508 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:11.465508 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:11.465508 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:11.465508 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:11.465508 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:11.465508 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:11.466398 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:11.466398 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:11.466398 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:11.466398 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:01:11.467139 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 493/973] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:01:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:11.472472 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c5b03-fb3f-4778-a791-dc077715eaed None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:11.575277 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c5b03-fb3f-4778-a791-dc077715eaed None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:11.608252 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9699e7f-f8ec-4762-8082-2046ac604eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:11.608926 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9699e7f-f8ec-4762-8082-2046ac604eab None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:11.609210 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9699e7f-f8ec-4762-8082-2046ac604eab None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:11.609486 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9699e7f-f8ec-4762-8082-2046ac604eab None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:11.610207 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9699e7f-f8ec-4762-8082-2046ac604eab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:11.610518 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9699e7f-f8ec-4762-8082-2046ac604eab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:11.611896 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9699e7f-f8ec-4762-8082-2046ac604eab None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:11.624871 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 481/974] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:01:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:11.631397 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00def32a-0588-4e1a-93e0-2db7eb843604 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:11.730888 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00def32a-0588-4e1a-93e0-2db7eb843604 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:11.764959 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5623205-85cf-41b1-ad0c-8d875540513a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:11.765771 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5623205-85cf-41b1-ad0c-8d875540513a None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:11.766054 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5623205-85cf-41b1-ad0c-8d875540513a None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:11.766374 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5623205-85cf-41b1-ad0c-8d875540513a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:11.773430 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5623205-85cf-41b1-ad0c-8d875540513a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:11.774877 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5623205-85cf-41b1-ad0c-8d875540513a None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:11.790019 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-a5623205-85cf-41b1-ad0c-8d875540513a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 03:01:11.790019 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:11.790019 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:11.790019 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:11.790019 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:11.790019 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:11.790019 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:11.790019 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:11.790019 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:11.790019 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:11.790019 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:11.790019 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:11.790019 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:01:11.790019 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:01:11.790019 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:01:11.790019 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:01:11.790977 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:11.790977 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:11.790977 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:01:11.790977 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:11.790977 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:01:11.790977 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:11.790977 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:11.790977 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:11.790977 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:11.790977 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:11.790977 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:11.790977 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:01:11.790977 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:11.790977 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:11.790977 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:11.790977 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:11.790977 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:11.790977 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:11.791902 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:11.791902 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:11.791902 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:01:11.791902 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:01:11.791902 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:01:11.791902 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:01:11.791902 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:01:11.791902 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:01:11.791902 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 03:01:11.791902 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:01:11.791902 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 494/975] 10.222.0.65 () {56 vars in 1117 bytes} [Tue May 10 03:01:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:01:11.798095 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9699e7f-f8ec-4762-8082-2046ac604eab None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:11.822987 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf253e0-ad34-4c9c-b8f7-776d090329dc None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:11.823293 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf253e0-ad34-4c9c-b8f7-776d090329dc None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:11.823551 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf253e0-ad34-4c9c-b8f7-776d090329dc None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:11.824933 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 495/976] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:01:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:01:11.830019 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c3dbc-fc6e-4b74-b5cc-2a2150cc171d None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:11.830305 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c3dbc-fc6e-4b74-b5cc-2a2150cc171d None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:11.830551 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c3dbc-fc6e-4b74-b5cc-2a2150cc171d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:11.846753 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-193c3dbc-fc6e-4b74-b5cc-2a2150cc171d None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:11.848336 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-193c3dbc-fc6e-4b74-b5cc-2a2150cc171d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:11.897317 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9699e7f-f8ec-4762-8082-2046ac604eab None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:11.921977 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 496/977] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:01:11 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 03:01:11.931547 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5fba49-fc19-45eb-9471-a6efc50ec7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:11.932244 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fba49-fc19-45eb-9471-a6efc50ec7e6 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:11.932529 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fba49-fc19-45eb-9471-a6efc50ec7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:11.932805 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fba49-fc19-45eb-9471-a6efc50ec7e6 None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:11.933643 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5fba49-fc19-45eb-9471-a6efc50ec7e6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:11.933952 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5fba49-fc19-45eb-9471-a6efc50ec7e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:11.935387 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5fba49-fc19-45eb-9471-a6efc50ec7e6 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:11.946487 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193c3dbc-fc6e-4b74-b5cc-2a2150cc171d None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:11.953593 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 482/978] 10.222.0.65 () {56 vars in 1149 bytes} [Tue May 10 03:01:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:11.959012 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5fba49-fc19-45eb-9471-a6efc50ec7e6 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:12.048407 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193c3dbc-fc6e-4b74-b5cc-2a2150cc171d None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:12.061015 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5fba49-fc19-45eb-9471-a6efc50ec7e6 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:12.081758 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec67118d-9cbd-47ee-9f88-94d3e5d00701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:12.082526 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67118d-9cbd-47ee-9f88-94d3e5d00701 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:12.082815 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67118d-9cbd-47ee-9f88-94d3e5d00701 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:12.083093 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67118d-9cbd-47ee-9f88-94d3e5d00701 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:12.083750 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec67118d-9cbd-47ee-9f88-94d3e5d00701 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:12.085178 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec67118d-9cbd-47ee-9f88-94d3e5d00701 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:12.094229 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70586b40-2aca-4057-8fc1-98780d91c1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:12.094881 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70586b40-2aca-4057-8fc1-98780d91c1fe None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:12.095169 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70586b40-2aca-4057-8fc1-98780d91c1fe None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:12.095439 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70586b40-2aca-4057-8fc1-98780d91c1fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:12.097186 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-ec67118d-9cbd-47ee-9f88-94d3e5d00701 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 03:01:12.097186 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:12.097186 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 03:01:12.097186 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 03:01:12.097186 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 03:01:12.097186 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 03:01:12.097186 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 03:01:12.097186 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:01:12.097186 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 03:01:12.097186 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:01:12.097186 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 03:01:12.097186 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:01:12.097186 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:12.097186 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:12.097186 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:12.097186 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:12.097186 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:12.098758 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:12.098758 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:12.098758 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:12.098758 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:12.098758 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:12.098758 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:12.098758 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 03:01:12.098758 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 03:01:12.098758 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 03:01:12.098758 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 03:01:12.098758 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:12.098758 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:12.098758 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:12.098758 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:12.098758 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:12.098758 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:12.099798 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:12.099798 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:01:12.099798 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:12.099798 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:12.099798 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:12.099798 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:12.099798 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:12.099798 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:12.099798 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:12.099798 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:12.099798 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 03:01:12.099798 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:01:12.099798 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 03:01:12.099798 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:01:12.099798 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 497/979] 10.222.0.65 () {56 vars in 1126 bytes} [Tue May 10 03:01:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:01:12.104752 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec67118d-9cbd-47ee-9f88-94d3e5d00701 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:12.166612 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70586b40-2aca-4057-8fc1-98780d91c1fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:12.168104 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70586b40-2aca-4057-8fc1-98780d91c1fe None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:12.199755 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec67118d-9cbd-47ee-9f88-94d3e5d00701 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:12.232631 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd1de6b-dcb2-4c2b-819f-5c34eba14f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:12.233281 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd1de6b-dcb2-4c2b-819f-5c34eba14f86 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:12.233568 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd1de6b-dcb2-4c2b-819f-5c34eba14f86 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:12.234498 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd1de6b-dcb2-4c2b-819f-5c34eba14f86 None admin] PATH_INFO: `/v3/services` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:12.234608 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd1de6b-dcb2-4c2b-819f-5c34eba14f86 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:12.234850 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd1de6b-dcb2-4c2b-819f-5c34eba14f86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:12.236238 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd1de6b-dcb2-4c2b-819f-5c34eba14f86 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:12.241804 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 498/980] 10.222.0.65 () {56 vars in 1122 bytes} [Tue May 10 03:01:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:01:12.247120 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd1de6b-dcb2-4c2b-819f-5c34eba14f86 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:12.263936 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 483/981] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 10 03:01:11 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 10 03:01:12.269184 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70586b40-2aca-4057-8fc1-98780d91c1fe None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:12.346669 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd1de6b-dcb2-4c2b-819f-5c34eba14f86 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:12.367728 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70586b40-2aca-4057-8fc1-98780d91c1fe None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:12.378922 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57fc03e-0b39-4d45-8a31-37c5aedf9579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:12.379614 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57fc03e-0b39-4d45-8a31-37c5aedf9579 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:12.379891 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57fc03e-0b39-4d45-8a31-37c5aedf9579 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:12.380194 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57fc03e-0b39-4d45-8a31-37c5aedf9579 None admin] PATH_INFO: `/v3/services` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:12.380926 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57fc03e-0b39-4d45-8a31-37c5aedf9579 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:12.381232 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57fc03e-0b39-4d45-8a31-37c5aedf9579 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:12.382588 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57fc03e-0b39-4d45-8a31-37c5aedf9579 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:12.387539 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 499/982] 10.222.0.65 () {56 vars in 1122 bytes} [Tue May 10 03:01:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:01:12.392954 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57fc03e-0b39-4d45-8a31-37c5aedf9579 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:12.401249 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af76445f-8304-4ef5-ae0e-e0118376ea30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:12.402387 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af76445f-8304-4ef5-ae0e-e0118376ea30 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:12.402387 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af76445f-8304-4ef5-ae0e-e0118376ea30 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:12.402583 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af76445f-8304-4ef5-ae0e-e0118376ea30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:12.413039 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af76445f-8304-4ef5-ae0e-e0118376ea30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:12.414798 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af76445f-8304-4ef5-ae0e-e0118376ea30 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:12.431801 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-af76445f-8304-4ef5-ae0e-e0118376ea30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:12.431801 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:12.431801 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:12.431801 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:12.431801 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:12.431801 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:12.431801 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:12.431801 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:12.431801 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:12.431801 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:12.431801 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:12.431801 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:12.431801 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:12.431801 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:12.431801 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:12.432870 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:12.432870 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:12.432870 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:12.432870 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:12.432870 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:12.432870 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:12.432870 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:12.432870 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:12.432870 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:01:12.432870 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:12.432870 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:12.432870 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:12.432870 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:12.432870 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:12.432870 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:12.432870 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:12.432870 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:12.436865 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:12.436865 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:12.436865 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:12.436865 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:01:12.436865 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 484/983] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:01:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:12.438456 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af76445f-8304-4ef5-ae0e-e0118376ea30 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:12.501292 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57fc03e-0b39-4d45-8a31-37c5aedf9579 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:12.534557 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0b19c-e216-4daa-a01a-42f344412f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:12.535219 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0b19c-e216-4daa-a01a-42f344412f6b None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:12.535520 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0b19c-e216-4daa-a01a-42f344412f6b None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:12.536358 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0b19c-e216-4daa-a01a-42f344412f6b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:12.536795 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af76445f-8304-4ef5-ae0e-e0118376ea30 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:12.537169 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a0b19c-e216-4daa-a01a-42f344412f6b None admin] RBAC: Adding query filter params (interface=admin, service_id=916ea52531954ec78db8b51401272141, region_id=RegionOne) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:12.537482 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a0b19c-e216-4daa-a01a-42f344412f6b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:12.538858 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a0b19c-e216-4daa-a01a-42f344412f6b None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:12.548131 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 500/984] 10.222.0.65 () {56 vars in 1249 bytes} [Tue May 10 03:01:12 2022] GET /identity/v3/endpoints?service_id=916ea52531954ec78db8b51401272141&interface=admin®ion_id=RegionOne => generated 193 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:01:12.549122 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0b19c-e216-4daa-a01a-42f344412f6b None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:12.570278 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606079df-24f3-454c-b153-af4da98278e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:12.570963 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606079df-24f3-454c-b153-af4da98278e3 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:12.571300 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606079df-24f3-454c-b153-af4da98278e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:12.571581 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606079df-24f3-454c-b153-af4da98278e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:12.572335 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606079df-24f3-454c-b153-af4da98278e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:12.572639 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606079df-24f3-454c-b153-af4da98278e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:12.574000 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606079df-24f3-454c-b153-af4da98278e3 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:12.589753 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 485/985] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:01:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:01:12.590846 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606079df-24f3-454c-b153-af4da98278e3 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:12.648205 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0b19c-e216-4daa-a01a-42f344412f6b None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:12.680851 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f23274-b079-44bd-b6ed-e58766d39d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:12.681521 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f23274-b079-44bd-b6ed-e58766d39d4b None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:12.681805 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f23274-b079-44bd-b6ed-e58766d39d4b None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:12.682084 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f23274-b079-44bd-b6ed-e58766d39d4b None admin] PATH_INFO: `/v3/services` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:12.682770 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f23274-b079-44bd-b6ed-e58766d39d4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:12.684181 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f23274-b079-44bd-b6ed-e58766d39d4b None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:12.685139 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606079df-24f3-454c-b153-af4da98278e3 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:12.700031 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 501/986] 10.222.0.65 () {56 vars in 1087 bytes} [Tue May 10 03:01:12 2022] GET /identity/v3/services => generated 1727 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:01:12.721193 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1190f207-0669-4e4c-a815-c31b8b35d845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:12.722016 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1190f207-0669-4e4c-a815-c31b8b35d845 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:12.722301 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1190f207-0669-4e4c-a815-c31b8b35d845 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:12.722575 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1190f207-0669-4e4c-a815-c31b8b35d845 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:12.730346 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1190f207-0669-4e4c-a815-c31b8b35d845 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:12.731817 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1190f207-0669-4e4c-a815-c31b8b35d845 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:12.746911 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-1190f207-0669-4e4c-a815-c31b8b35d845 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:01:12.746911 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:12.746911 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:12.746911 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:12.746911 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:12.746911 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:12.746911 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:12.746911 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:12.746911 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:12.746911 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:12.746911 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:12.746911 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:12.746911 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:01:12.746911 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:01:12.746911 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:01:12.747855 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:01:12.747855 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:12.747855 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:12.747855 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:12.747855 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:12.747855 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:12.747855 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:12.747855 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:12.747855 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:01:12.747855 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:12.747855 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:12.747855 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:12.747855 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:12.747855 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:12.747855 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:12.747855 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:12.747855 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:12.748781 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:01:12.748781 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:01:12.748781 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:01:12.748781 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:01:12.748781 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:01:12.748781 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:01:12.748781 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:01:12.748781 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:01:12.748781 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 486/987] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 10 03:01:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:01:12.754037 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f23274-b079-44bd-b6ed-e58766d39d4b None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:12.855379 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f23274-b079-44bd-b6ed-e58766d39d4b None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:12.888940 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a65b763-426a-441f-971c-b3bc629277e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:12.889601 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65b763-426a-441f-971c-b3bc629277e3 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:12.889881 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65b763-426a-441f-971c-b3bc629277e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:12.890155 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65b763-426a-441f-971c-b3bc629277e3 None admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:12.890940 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a65b763-426a-441f-971c-b3bc629277e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:12.891249 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a65b763-426a-441f-971c-b3bc629277e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:12.892703 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a65b763-426a-441f-971c-b3bc629277e3 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:12.905557 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 502/988] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 10 03:01:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:01:12.911666 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1190f207-0669-4e4c-a815-c31b8b35d845 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:13.008671 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1190f207-0669-4e4c-a815-c31b8b35d845 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:13.042471 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af69ec2b-aa5b-4117-b0e9-147ab35969c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:13.043134 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af69ec2b-aa5b-4117-b0e9-147ab35969c1 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:13.043418 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af69ec2b-aa5b-4117-b0e9-147ab35969c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:13.043695 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af69ec2b-aa5b-4117-b0e9-147ab35969c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:13.044559 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af69ec2b-aa5b-4117-b0e9-147ab35969c1 None admin] RBAC: Adding query filter params (role.id=6c4dad34321647f5a6822a530300110c, scope.project.id=513e6592cd83457b8ff461b0e5e1fd40, user.id=6ebfab3ff0b24f4aaabb8c6bb0ad10c6) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:13.044876 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af69ec2b-aa5b-4117-b0e9-147ab35969c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:13.046308 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af69ec2b-aa5b-4117-b0e9-147ab35969c1 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:13.053215 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 487/989] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 10 03:01:12 2022] GET /identity/v3/role_assignments?user.id=6ebfab3ff0b24f4aaabb8c6bb0ad10c6&scope.project.id=513e6592cd83457b8ff461b0e5e1fd40&role.id=6c4dad34321647f5a6822a530300110c => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:13.611534 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fd5dc-ad79-477f-b9b5-d7ad507ddde8 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:13.612277 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fd5dc-ad79-477f-b9b5-d7ad507ddde8 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:13.612277 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fd5dc-ad79-477f-b9b5-d7ad507ddde8 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:13.614234 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 503/990] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:01:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:13.619203 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafb8fd-6ec6-4291-a894-ee818505a16f None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:13.619607 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafb8fd-6ec6-4291-a894-ee818505a16f None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:13.619787 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafb8fd-6ec6-4291-a894-ee818505a16f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:13.636313 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-6bafb8fd-6ec6-4291-a894-ee818505a16f None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:13.637504 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-6bafb8fd-6ec6-4291-a894-ee818505a16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:13.701366 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 488/991] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:01:13 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:01:13.727929 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0fd5dc-ad79-477f-b9b5-d7ad507ddde8 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:13.826906 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0fd5dc-ad79-477f-b9b5-d7ad507ddde8 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:13.860170 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1774551-6a7b-42f5-8767-1d033231be64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:13.860967 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1774551-6a7b-42f5-8767-1d033231be64 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:13.861252 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1774551-6a7b-42f5-8767-1d033231be64 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:13.861526 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1774551-6a7b-42f5-8767-1d033231be64 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:13.862182 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1774551-6a7b-42f5-8767-1d033231be64 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:13.863611 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1774551-6a7b-42f5-8767-1d033231be64 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:13.875316 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-c1774551-6a7b-42f5-8767-1d033231be64 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 10 03:01:13.875316 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:13.875316 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 03:01:13.875316 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 03:01:13.875316 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 03:01:13.875316 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 03:01:13.875316 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 03:01:13.875316 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:01:13.875316 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 03:01:13.875316 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:01:13.875316 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 03:01:13.875316 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:01:13.875316 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:13.875316 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:13.875316 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:13.875316 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:13.875316 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:13.876335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:13.876335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:13.876335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:13.876335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:13.876335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:13.876335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:13.876335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 03:01:13.876335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 03:01:13.876335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 03:01:13.876335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 03:01:13.876335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:13.876335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:13.876335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:13.876335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:13.876335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:13.876335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:13.877222 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:13.877222 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:01:13.877222 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:13.877222 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:13.877222 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:13.877222 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:13.877222 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:13.877222 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:13.877222 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:13.877222 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:13.877222 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 03:01:13.877222 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:01:13.877222 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 03:01:13.877222 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:01:13.884671 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 504/992] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 10 03:01:13 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:13.884831 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bafb8fd-6ec6-4291-a894-ee818505a16f None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:13.978211 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bafb8fd-6ec6-4291-a894-ee818505a16f None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:14.011999 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3594f38-ecab-4686-9dff-af3747929a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:14.012688 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3594f38-ecab-4686-9dff-af3747929a74 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:14.012968 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3594f38-ecab-4686-9dff-af3747929a74 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:14.013303 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3594f38-ecab-4686-9dff-af3747929a74 None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:14.014064 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3594f38-ecab-4686-9dff-af3747929a74 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:14.014374 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3594f38-ecab-4686-9dff-af3747929a74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:14.015808 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3594f38-ecab-4686-9dff-af3747929a74 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:14.021299 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 489/993] 10.222.0.65 () {56 vars in 1112 bytes} [Tue May 10 03:01:13 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:14.029139 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1774551-6a7b-42f5-8767-1d033231be64 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:14.125657 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1774551-6a7b-42f5-8767-1d033231be64 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:14.157343 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7fefc3-443c-4717-b5c3-2db297d731dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:14.158007 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7fefc3-443c-4717-b5c3-2db297d731dd None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:14.158294 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7fefc3-443c-4717-b5c3-2db297d731dd None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:14.158586 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7fefc3-443c-4717-b5c3-2db297d731dd None admin] PATH_INFO: `/v3/services` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:14.159274 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7fefc3-443c-4717-b5c3-2db297d731dd None admin] RBAC: Adding query filter params (type=compute) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:14.159581 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7fefc3-443c-4717-b5c3-2db297d731dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:14.161530 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7fefc3-443c-4717-b5c3-2db297d731dd None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:14.170907 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 505/994] 10.222.0.65 () {56 vars in 1112 bytes} [Tue May 10 03:01:14 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:14.172289 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3594f38-ecab-4686-9dff-af3747929a74 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:14.269363 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3594f38-ecab-4686-9dff-af3747929a74 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:14.303220 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f5c2c-2938-465c-ba8b-9040296116d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:14.304063 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f5c2c-2938-465c-ba8b-9040296116d3 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:14.304449 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f5c2c-2938-465c-ba8b-9040296116d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:14.304825 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f5c2c-2938-465c-ba8b-9040296116d3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:14.305719 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12f5c2c-2938-465c-ba8b-9040296116d3 None admin] RBAC: Adding query filter params (interface=public, service_id=730dd4c0496c4ca1af884a942fb72a0c, region_id=RegionOne) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:14.306157 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12f5c2c-2938-465c-ba8b-9040296116d3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:14.307639 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12f5c2c-2938-465c-ba8b-9040296116d3 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:14.312842 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 490/995] 10.222.0.65 () {56 vars in 1251 bytes} [Tue May 10 03:01:14 2022] GET /identity/v3/endpoints?service_id=730dd4c0496c4ca1af884a942fb72a0c&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:14.318704 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7fefc3-443c-4717-b5c3-2db297d731dd None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:14.414473 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7fefc3-443c-4717-b5c3-2db297d731dd None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:14.447115 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0825e496-33a4-400e-8bf7-d116c533a311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:14.447778 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825e496-33a4-400e-8bf7-d116c533a311 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:14.451306 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825e496-33a4-400e-8bf7-d116c533a311 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:14.451306 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825e496-33a4-400e-8bf7-d116c533a311 None admin] PATH_INFO: `/v3/services` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:14.451306 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0825e496-33a4-400e-8bf7-d116c533a311 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:14.451306 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0825e496-33a4-400e-8bf7-d116c533a311 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:14.471604 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 506/996] 10.222.0.65 () {56 vars in 1087 bytes} [Tue May 10 03:01:14 2022] GET /identity/v3/services => generated 1727 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:01:14.919958 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687f1e6-73ce-46e5-8cb2-6a71e8f610f9 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:14.920538 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687f1e6-73ce-46e5-8cb2-6a71e8f610f9 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:14.920538 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687f1e6-73ce-46e5-8cb2-6a71e8f610f9 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:14.921924 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 491/997] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:01:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:14.927771 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ccb733-0cd4-48e2-b432-7e906dd5f856 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:14.928183 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ccb733-0cd4-48e2-b432-7e906dd5f856 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:14.928345 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ccb733-0cd4-48e2-b432-7e906dd5f856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:14.945599 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-a6ccb733-0cd4-48e2-b432-7e906dd5f856 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:14.946768 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-a6ccb733-0cd4-48e2-b432-7e906dd5f856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:15.012043 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 507/998] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:01:14 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:01:15.042694 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687f1e6-73ce-46e5-8cb2-6a71e8f610f9 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:15.157329 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687f1e6-73ce-46e5-8cb2-6a71e8f610f9 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:15.190260 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4324e8-028f-436a-a296-a000ca116a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:15.190981 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4324e8-028f-436a-a296-a000ca116a63 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:15.191260 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4324e8-028f-436a-a296-a000ca116a63 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:15.191525 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4324e8-028f-436a-a296-a000ca116a63 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:15.192351 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4324e8-028f-436a-a296-a000ca116a63 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:15.193768 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4324e8-028f-436a-a296-a000ca116a63 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:15.206307 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-ec4324e8-028f-436a-a296-a000ca116a63 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 03:01:15.206307 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:15.206307 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 03:01:15.206307 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 03:01:15.206307 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 03:01:15.206307 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 03:01:15.206307 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 03:01:15.206307 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:01:15.206307 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 03:01:15.206307 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:01:15.206307 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 03:01:15.206307 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:01:15.206307 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:15.206307 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:15.206307 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:15.206307 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:15.206307 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:15.207307 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:15.207307 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:15.207307 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:15.207307 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:15.207307 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:15.207307 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:15.207307 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 03:01:15.207307 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 03:01:15.207307 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 03:01:15.207307 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 03:01:15.207307 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:15.207307 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:15.207307 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:15.207307 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:15.207307 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:15.207307 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:15.208596 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:15.208596 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:01:15.208596 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:15.208596 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:15.208596 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:15.208596 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:15.208596 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:15.208596 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:15.208596 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:15.208596 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:15.208596 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 03:01:15.208596 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:01:15.208596 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 03:01:15.208596 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:01:15.212090 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 492/999] 10.222.0.65 () {56 vars in 1126 bytes} [Tue May 10 03:01:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:15.213798 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ccb733-0cd4-48e2-b432-7e906dd5f856 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:15.286318 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2467030-b290-4b0e-a5b8-36cf42d76695 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:15.286678 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2467030-b290-4b0e-a5b8-36cf42d76695 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:15.286880 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2467030-b290-4b0e-a5b8-36cf42d76695 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:15.288400 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 493/1000] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:01:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:01:15.293120 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab378a8-fc73-4181-856d-08ecefe5f712 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:15.293408 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab378a8-fc73-4181-856d-08ecefe5f712 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:15.293690 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab378a8-fc73-4181-856d-08ecefe5f712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:15.309503 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ccb733-0cd4-48e2-b432-7e906dd5f856 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:15.310001 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-7ab378a8-fc73-4181-856d-08ecefe5f712 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:15.311184 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-7ab378a8-fc73-4181-856d-08ecefe5f712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:15.342400 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb559f3-4943-438e-be23-ea57180ca913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:15.343060 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb559f3-4943-438e-be23-ea57180ca913 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:15.343336 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb559f3-4943-438e-be23-ea57180ca913 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:15.343606 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb559f3-4943-438e-be23-ea57180ca913 None admin] PATH_INFO: `/v3/services` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:15.344335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb559f3-4943-438e-be23-ea57180ca913 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:15.345362 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb559f3-4943-438e-be23-ea57180ca913 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:15.346002 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb559f3-4943-438e-be23-ea57180ca913 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:15.352154 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 508/1001] 10.222.0.65 () {56 vars in 1122 bytes} [Tue May 10 03:01:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:15.356947 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb559f3-4943-438e-be23-ea57180ca913 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:15.381504 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 494/1002] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:01:15 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 03:01:15.403584 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab378a8-fc73-4181-856d-08ecefe5f712 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:15.457096 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb559f3-4943-438e-be23-ea57180ca913 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:15.501494 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b4c00-aa27-4e44-9837-a312972992e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:15.502168 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b4c00-aa27-4e44-9837-a312972992e6 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:15.502713 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b4c00-aa27-4e44-9837-a312972992e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:15.502713 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b4c00-aa27-4e44-9837-a312972992e6 None admin] PATH_INFO: `/v3/services` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:15.503403 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7b4c00-aa27-4e44-9837-a312972992e6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:15.503708 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7b4c00-aa27-4e44-9837-a312972992e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:15.505111 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7b4c00-aa27-4e44-9837-a312972992e6 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:15.509869 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 509/1003] 10.222.0.65 () {56 vars in 1122 bytes} [Tue May 10 03:01:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:01:15.515127 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab378a8-fc73-4181-856d-08ecefe5f712 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:15.515422 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b4c00-aa27-4e44-9837-a312972992e6 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:15.550558 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb346a2-2a62-4c2a-80bd-133c8af3e34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:15.551342 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb346a2-2a62-4c2a-80bd-133c8af3e34f None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:15.551624 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb346a2-2a62-4c2a-80bd-133c8af3e34f None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:15.551896 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb346a2-2a62-4c2a-80bd-133c8af3e34f None admin] PATH_INFO: `/v3/services/image` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:15.552605 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb346a2-2a62-4c2a-80bd-133c8af3e34f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:15.553978 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb346a2-2a62-4c2a-80bd-133c8af3e34f None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:15.565393 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-2eb346a2-2a62-4c2a-80bd-133c8af3e34f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 10 03:01:15.565393 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:15.565393 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 03:01:15.565393 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 03:01:15.565393 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 03:01:15.565393 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 03:01:15.565393 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 03:01:15.565393 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:01:15.565393 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 03:01:15.565393 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:01:15.565393 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 03:01:15.565393 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:01:15.565393 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:15.565393 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:15.565393 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:15.565393 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:15.565393 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:15.566425 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:15.566425 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:15.566425 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:15.566425 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:15.566425 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:15.566425 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:15.566425 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 03:01:15.566425 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 03:01:15.566425 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 03:01:15.566425 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 03:01:15.566425 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:15.566425 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:15.566425 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:15.566425 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:15.566425 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:15.566425 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:15.567254 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:15.567254 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:01:15.567254 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:15.567254 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:15.567254 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:15.567254 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:15.567254 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:15.567254 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:15.567254 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:15.567254 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:15.567254 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 03:01:15.567254 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:01:15.567254 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 03:01:15.567254 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:01:15.571817 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 495/1004] 10.222.0.65 () {56 vars in 1105 bytes} [Tue May 10 03:01:15 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:01:15.572534 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb346a2-2a62-4c2a-80bd-133c8af3e34f None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:15.612442 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b4c00-aa27-4e44-9837-a312972992e6 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:15.645634 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b8a764-51a4-4715-a2ca-6fef8686a503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:15.646266 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b8a764-51a4-4715-a2ca-6fef8686a503 None admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:15.646555 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b8a764-51a4-4715-a2ca-6fef8686a503 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:15.646813 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b8a764-51a4-4715-a2ca-6fef8686a503 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:15.647545 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b8a764-51a4-4715-a2ca-6fef8686a503 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:15.648921 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b8a764-51a4-4715-a2ca-6fef8686a503 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:15.670898 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb346a2-2a62-4c2a-80bd-133c8af3e34f None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:15.702893 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde6cddc-cde1-42ab-8d80-e3dcdd4bbe1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:15.709371 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde6cddc-cde1-42ab-8d80-e3dcdd4bbe1c None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:15.709371 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde6cddc-cde1-42ab-8d80-e3dcdd4bbe1c None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:15.709371 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde6cddc-cde1-42ab-8d80-e3dcdd4bbe1c None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:15.709371 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde6cddc-cde1-42ab-8d80-e3dcdd4bbe1c None admin] RBAC: Adding query filter params (name=image) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:15.709371 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde6cddc-cde1-42ab-8d80-e3dcdd4bbe1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:15.709371 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde6cddc-cde1-42ab-8d80-e3dcdd4bbe1c None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:15.711690 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 496/1005] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:01:15 2022] GET /identity/v3/services?name=image => generated 122 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:15.717103 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde6cddc-cde1-42ab-8d80-e3dcdd4bbe1c None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:15.734835 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 510/1006] 10.222.0.65 () {60 vars in 1144 bytes} [Tue May 10 03:01:15 2022] POST /identity/v3/endpoints => generated 325 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:01:15.820442 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde6cddc-cde1-42ab-8d80-e3dcdd4bbe1c None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:15.861360 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0511bdd0-306e-4381-85ad-b69ce42bc33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:15.862050 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511bdd0-306e-4381-85ad-b69ce42bc33e None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:15.862335 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511bdd0-306e-4381-85ad-b69ce42bc33e None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:15.862613 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511bdd0-306e-4381-85ad-b69ce42bc33e None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:15.863325 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0511bdd0-306e-4381-85ad-b69ce42bc33e None admin] RBAC: Adding query filter params (type=image) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:15.863674 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0511bdd0-306e-4381-85ad-b69ce42bc33e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:15.865112 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0511bdd0-306e-4381-85ad-b69ce42bc33e None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:15.876385 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 497/1007] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:01:15 2022] GET /identity/v3/services?type=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:01:16.705573 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0441db-4840-4036-a018-40feb91eb21a None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:16.706069 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0441db-4840-4036-a018-40feb91eb21a None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:16.706069 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0441db-4840-4036-a018-40feb91eb21a None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:16.707480 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 511/1008] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:01:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:16.712742 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66536eb5-2aa9-4906-8d92-a3e6abac56bf None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:16.713143 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66536eb5-2aa9-4906-8d92-a3e6abac56bf None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:16.713300 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66536eb5-2aa9-4906-8d92-a3e6abac56bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:16.731524 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-66536eb5-2aa9-4906-8d92-a3e6abac56bf None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:16.732753 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-66536eb5-2aa9-4906-8d92-a3e6abac56bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:16.797178 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 498/1009] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:01:16 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:01:16.819131 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0441db-4840-4036-a018-40feb91eb21a None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:16.918019 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0441db-4840-4036-a018-40feb91eb21a None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:16.950074 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711066cf-35dc-4b4a-b6ba-012250be189c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:16.950871 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711066cf-35dc-4b4a-b6ba-012250be189c None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:16.951157 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711066cf-35dc-4b4a-b6ba-012250be189c None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:16.951433 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711066cf-35dc-4b4a-b6ba-012250be189c None admin] PATH_INFO: `/v3/services/compute` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:16.952121 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711066cf-35dc-4b4a-b6ba-012250be189c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:16.953479 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711066cf-35dc-4b4a-b6ba-012250be189c None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:16.965807 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-711066cf-35dc-4b4a-b6ba-012250be189c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 10 03:01:16.965807 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:16.965807 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 03:01:16.965807 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 03:01:16.965807 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 03:01:16.965807 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 03:01:16.965807 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 03:01:16.965807 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:01:16.965807 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 03:01:16.965807 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:01:16.965807 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 03:01:16.965807 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:01:16.965807 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:16.965807 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:16.965807 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:16.965807 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:16.965807 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:16.966839 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:16.966839 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:16.966839 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:16.966839 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:16.966839 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:16.966839 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:16.966839 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 03:01:16.966839 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 03:01:16.966839 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 03:01:16.966839 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 03:01:16.966839 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:16.966839 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:16.966839 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:16.966839 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:16.966839 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:16.966839 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:16.967889 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:16.967889 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:01:16.967889 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:16.967889 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:16.967889 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:16.967889 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:16.967889 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:16.967889 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:16.967889 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:16.967889 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:16.967889 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 03:01:16.967889 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:01:16.967889 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 03:01:16.967889 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:01:16.967889 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 512/1010] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 10 03:01:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:16.973923 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66536eb5-2aa9-4906-8d92-a3e6abac56bf None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:17.080637 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66536eb5-2aa9-4906-8d92-a3e6abac56bf None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:17.115408 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c666595-a393-4cf9-8a2b-652d9dffee8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:17.116109 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c666595-a393-4cf9-8a2b-652d9dffee8c None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:17.116398 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c666595-a393-4cf9-8a2b-652d9dffee8c None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:17.116679 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c666595-a393-4cf9-8a2b-652d9dffee8c None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:17.117389 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c666595-a393-4cf9-8a2b-652d9dffee8c None admin] RBAC: Adding query filter params (name=compute) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:17.117702 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c666595-a393-4cf9-8a2b-652d9dffee8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:17.119089 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c666595-a393-4cf9-8a2b-652d9dffee8c None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:17.128276 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 499/1011] 10.222.0.65 () {56 vars in 1112 bytes} [Tue May 10 03:01:16 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:17.129763 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711066cf-35dc-4b4a-b6ba-012250be189c None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:17.226801 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711066cf-35dc-4b4a-b6ba-012250be189c None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:17.258018 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48713658-2bc2-434d-913d-72bc0454093d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:17.258670 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48713658-2bc2-434d-913d-72bc0454093d None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:17.258952 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48713658-2bc2-434d-913d-72bc0454093d None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:17.259226 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48713658-2bc2-434d-913d-72bc0454093d None admin] PATH_INFO: `/v3/services` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:17.259952 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48713658-2bc2-434d-913d-72bc0454093d None admin] RBAC: Adding query filter params (type=compute) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:17.260285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48713658-2bc2-434d-913d-72bc0454093d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:17.261644 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48713658-2bc2-434d-913d-72bc0454093d None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:17.266381 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 513/1012] 10.222.0.65 () {56 vars in 1112 bytes} [Tue May 10 03:01:17 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:17.272494 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c666595-a393-4cf9-8a2b-652d9dffee8c None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:17.367248 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c666595-a393-4cf9-8a2b-652d9dffee8c None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:17.402030 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a01aeeb-5f4a-4806-ac4e-60a851774e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:17.402704 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01aeeb-5f4a-4806-ac4e-60a851774e9f None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:17.402989 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01aeeb-5f4a-4806-ac4e-60a851774e9f None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:17.403268 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01aeeb-5f4a-4806-ac4e-60a851774e9f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:17.404260 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a01aeeb-5f4a-4806-ac4e-60a851774e9f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:17.405425 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a01aeeb-5f4a-4806-ac4e-60a851774e9f None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:17.496113 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 500/1013] 10.222.0.65 () {60 vars in 1144 bytes} [Tue May 10 03:01:17 2022] POST /identity/v3/endpoints => generated 334 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:01:18.011697 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33430e5-6d63-4753-9168-b843cfaf6d8d None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:18.012240 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33430e5-6d63-4753-9168-b843cfaf6d8d None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:18.012318 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33430e5-6d63-4753-9168-b843cfaf6d8d None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:18.013912 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 514/1014] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:01:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:18.019005 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d8657-82f8-46a4-96de-d1e3f441fc99 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:18.019388 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d8657-82f8-46a4-96de-d1e3f441fc99 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:18.019555 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d8657-82f8-46a4-96de-d1e3f441fc99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:18.037807 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-f53d8657-82f8-46a4-96de-d1e3f441fc99 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:18.039005 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-f53d8657-82f8-46a4-96de-d1e3f441fc99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:18.088358 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93517ee1-07e5-42fd-b873-a64567679e8d None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:18.088697 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93517ee1-07e5-42fd-b873-a64567679e8d None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:18.088924 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93517ee1-07e5-42fd-b873-a64567679e8d None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:18.091719 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 515/1015] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:01:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:01:18.095409 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f3d289-b366-48d7-bab5-66db5e0da2c2 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:18.095660 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f3d289-b366-48d7-bab5-66db5e0da2c2 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:18.095932 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f3d289-b366-48d7-bab5-66db5e0da2c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:18.112576 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-48f3d289-b366-48d7-bab5-66db5e0da2c2 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:18.112740 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 501/1016] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:01:18 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:01:18.114127 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-48f3d289-b366-48d7-bab5-66db5e0da2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:18.135933 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53d8657-82f8-46a4-96de-d1e3f441fc99 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:18.178674 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 516/1017] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:01:18 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 03:01:18.200797 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f3d289-b366-48d7-bab5-66db5e0da2c2 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:18.232649 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53d8657-82f8-46a4-96de-d1e3f441fc99 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:18.266092 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec5f3a-e9fa-49f9-9a79-1af7143d4020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:18.266811 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec5f3a-e9fa-49f9-9a79-1af7143d4020 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:18.267096 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec5f3a-e9fa-49f9-9a79-1af7143d4020 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:18.267372 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec5f3a-e9fa-49f9-9a79-1af7143d4020 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:18.268605 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcec5f3a-e9fa-49f9-9a79-1af7143d4020 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:18.270604 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcec5f3a-e9fa-49f9-9a79-1af7143d4020 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:18.277002 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 502/1018] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:01:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:01:18.277768 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec5f3a-e9fa-49f9-9a79-1af7143d4020 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:18.301477 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f3d289-b366-48d7-bab5-66db5e0da2c2 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:18.334657 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d147d18c-14ed-4713-b881-f7cddf4077e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:18.335594 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d147d18c-14ed-4713-b881-f7cddf4077e0 None admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:18.335594 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d147d18c-14ed-4713-b881-f7cddf4077e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:18.335865 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d147d18c-14ed-4713-b881-f7cddf4077e0 None admin] PATH_INFO: `/v3/services` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:18.336624 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d147d18c-14ed-4713-b881-f7cddf4077e0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:18.337972 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d147d18c-14ed-4713-b881-f7cddf4077e0 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:18.373985 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec5f3a-e9fa-49f9-9a79-1af7143d4020 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:18.407167 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2075595-4724-42a5-8384-b54dcdb864b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:18.407846 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2075595-4724-42a5-8384-b54dcdb864b1 None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:18.408163 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2075595-4724-42a5-8384-b54dcdb864b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:18.408448 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2075595-4724-42a5-8384-b54dcdb864b1 None admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:18.408917 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 517/1019] 10.222.0.65 () {60 vars in 1141 bytes} [Tue May 10 03:01:18 2022] POST /identity/v3/services => generated 242 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:01:18.412686 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2075595-4724-42a5-8384-b54dcdb864b1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:18.414178 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2075595-4724-42a5-8384-b54dcdb864b1 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:18.490416 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 503/1020] 10.222.0.65 () {60 vars in 1141 bytes} [Tue May 10 03:01:18 2022] POST /identity/v3/projects => generated 311 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:01:19.817667 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5941d5-bea5-4e5b-bcae-0cf18d94cfb1 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:19.818160 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5941d5-bea5-4e5b-bcae-0cf18d94cfb1 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:19.818160 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5941d5-bea5-4e5b-bcae-0cf18d94cfb1 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:19.819535 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 518/1021] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:01:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:19.824646 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb9b9b-363a-4b2b-9a0e-151228ecb78b None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:19.825047 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb9b9b-363a-4b2b-9a0e-151228ecb78b None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:19.825218 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb9b9b-363a-4b2b-9a0e-151228ecb78b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:19.841976 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-9bdb9b9b-363a-4b2b-9a0e-151228ecb78b None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:19.843157 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-9bdb9b9b-363a-4b2b-9a0e-151228ecb78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:19.912689 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 504/1022] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:01:19 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:01:19.935125 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5941d5-bea5-4e5b-bcae-0cf18d94cfb1 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:20.031195 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5941d5-bea5-4e5b-bcae-0cf18d94cfb1 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:20.063801 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c3351-4400-4995-9acd-dff5d2ee4619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:20.064637 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c3351-4400-4995-9acd-dff5d2ee4619 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:20.064915 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c3351-4400-4995-9acd-dff5d2ee4619 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:20.065183 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c3351-4400-4995-9acd-dff5d2ee4619 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:20.075002 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55c3351-4400-4995-9acd-dff5d2ee4619 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:01:20.083514 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-f55c3351-4400-4995-9acd-dff5d2ee4619 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 03:01:20.083514 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:20.083514 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:20.083514 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:20.083514 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:20.083514 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:20.083514 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:20.083514 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:20.083514 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:20.083514 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:20.083514 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:20.083514 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:20.083514 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:01:20.083514 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:01:20.083514 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:01:20.083514 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:01:20.084701 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:01:20.084701 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:01:20.084701 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:01:20.084701 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:01:20.084701 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:20.084701 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:20.084701 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:20.084701 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:20.084701 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:20.084701 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:20.084701 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:20.084701 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:01:20.084701 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:20.084701 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:20.084701 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:20.084701 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:20.085543 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:20.085543 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:20.085543 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:20.085543 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:20.085543 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:01:20.085543 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:01:20.085543 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:01:20.085543 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:01:20.085543 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:01:20.085543 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:01:20.085543 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 03:01:20.085543 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:01:20.086883 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 519/1023] 10.222.0.65 () {56 vars in 1120 bytes} [Tue May 10 03:01:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:20.090821 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb9b9b-363a-4b2b-9a0e-151228ecb78b None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:20.185842 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb9b9b-363a-4b2b-9a0e-151228ecb78b None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:20.218869 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a8d7c9-c030-492c-809a-963407ece1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:20.219540 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8d7c9-c030-492c-809a-963407ece1c1 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:20.219823 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8d7c9-c030-492c-809a-963407ece1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:20.220124 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8d7c9-c030-492c-809a-963407ece1c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:20.220871 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a8d7c9-c030-492c-809a-963407ece1c1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:20.221176 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a8d7c9-c030-492c-809a-963407ece1c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:20.222539 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a8d7c9-c030-492c-809a-963407ece1c1 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:20.234976 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 505/1024] 10.222.0.65 () {56 vars in 1115 bytes} [Tue May 10 03:01:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:01:20.236638 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c3351-4400-4995-9acd-dff5d2ee4619 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:20.333959 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c3351-4400-4995-9acd-dff5d2ee4619 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:20.365400 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b36a461-7131-492e-aa79-e115a5f2f4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:20.366191 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36a461-7131-492e-aa79-e115a5f2f4c0 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:20.366472 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36a461-7131-492e-aa79-e115a5f2f4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:20.366744 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36a461-7131-492e-aa79-e115a5f2f4c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:20.376845 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b36a461-7131-492e-aa79-e115a5f2f4c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:20.378294 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b36a461-7131-492e-aa79-e115a5f2f4c0 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:20.395721 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-8b36a461-7131-492e-aa79-e115a5f2f4c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:20.395721 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:20.395721 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:20.395721 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:20.395721 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:20.395721 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:20.395721 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:20.395721 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:20.395721 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:20.395721 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:20.395721 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:20.395721 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:20.395721 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:20.395721 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:20.395721 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:20.396679 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:20.396679 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:20.396679 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:20.396679 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:20.396679 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:20.396679 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:20.396679 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:20.396679 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:20.396679 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:01:20.396679 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:20.396679 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:20.396679 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:20.396679 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:20.396679 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:20.396679 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:20.396679 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:20.396679 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:20.402194 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:20.402194 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:20.402194 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:20.402194 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:01:20.402194 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 520/1025] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:01:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:20.403935 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a8d7c9-c030-492c-809a-963407ece1c1 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:20.499306 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a8d7c9-c030-492c-809a-963407ece1c1 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:20.535857 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914bc387-d2a3-4024-9c6c-80c5a950d414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:20.536581 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914bc387-d2a3-4024-9c6c-80c5a950d414 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:20.536865 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914bc387-d2a3-4024-9c6c-80c5a950d414 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:20.537139 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914bc387-d2a3-4024-9c6c-80c5a950d414 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:20.537872 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914bc387-d2a3-4024-9c6c-80c5a950d414 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:20.538177 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914bc387-d2a3-4024-9c6c-80c5a950d414 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:20.539568 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914bc387-d2a3-4024-9c6c-80c5a950d414 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:20.557360 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 506/1026] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:01:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:20.558969 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b36a461-7131-492e-aa79-e115a5f2f4c0 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:20.660528 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b36a461-7131-492e-aa79-e115a5f2f4c0 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:20.693090 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9726d04-0983-4379-a4de-9755875ad14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:20.697586 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9726d04-0983-4379-a4de-9755875ad14a None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:20.697586 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9726d04-0983-4379-a4de-9755875ad14a None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:20.697586 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9726d04-0983-4379-a4de-9755875ad14a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:20.697845 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ff40d-0f05-48f1-9733-bdaa4f010ca9 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:20.697845 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ff40d-0f05-48f1-9733-bdaa4f010ca9 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:20.697845 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ff40d-0f05-48f1-9733-bdaa4f010ca9 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:20.697845 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 507/1027] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:01:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:01:20.702306 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2596a-d903-43ce-aff7-18fffec2c12a None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:20.702824 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2596a-d903-43ce-aff7-18fffec2c12a None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:20.703314 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2596a-d903-43ce-aff7-18fffec2c12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:20.705591 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9726d04-0983-4379-a4de-9755875ad14a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:20.707086 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9726d04-0983-4379-a4de-9755875ad14a None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:20.720246 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-a6b2596a-d903-43ce-aff7-18fffec2c12a None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:20.721035 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-a9726d04-0983-4379-a4de-9755875ad14a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 03:01:20.721035 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:20.721035 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:20.721035 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:20.721035 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:20.721035 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:20.721035 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:20.721035 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:20.721035 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:20.721035 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:20.721035 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:20.721035 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:20.721035 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:01:20.721035 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:01:20.721035 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:01:20.721035 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:01:20.721998 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:20.721998 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:20.721998 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:01:20.721998 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:20.721998 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:01:20.721998 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:20.721998 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:20.721998 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:20.721998 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:20.721998 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:20.721998 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:20.721998 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:01:20.721998 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:20.721998 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:20.721998 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:20.721998 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:20.721998 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:20.721998 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:20.727688 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:20.727688 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:20.727688 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:01:20.727688 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:01:20.727688 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:01:20.727688 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:01:20.727688 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:01:20.727688 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:01:20.727688 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 03:01:20.727688 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:01:20.728351 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-a6b2596a-d903-43ce-aff7-18fffec2c12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:20.728426 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 521/1028] 10.222.0.65 () {56 vars in 1093 bytes} [Tue May 10 03:01:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:20.730044 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9726d04-0983-4379-a4de-9755875ad14a None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:20.787967 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 508/1029] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:01:20 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 03:01:20.789333 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e724e8fd-29f9-4862-9c0b-b0b32ba2c9c9 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:20.789608 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e724e8fd-29f9-4862-9c0b-b0b32ba2c9c9 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:20.789898 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e724e8fd-29f9-4862-9c0b-b0b32ba2c9c9 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:20.791284 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 509/1030] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:01:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:20.796235 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b8bb2-3c70-4a14-9497-d7baf60a1432 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:20.796528 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b8bb2-3c70-4a14-9497-d7baf60a1432 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:20.796809 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b8bb2-3c70-4a14-9497-d7baf60a1432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:20.813106 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-b86b8bb2-3c70-4a14-9497-d7baf60a1432 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:20.814298 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-b86b8bb2-3c70-4a14-9497-d7baf60a1432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:20.825587 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9726d04-0983-4379-a4de-9755875ad14a None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:20.856635 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c37b87-497d-4f45-a6c7-3340f73169c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:20.857296 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c37b87-497d-4f45-a6c7-3340f73169c3 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:20.857580 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c37b87-497d-4f45-a6c7-3340f73169c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:20.857857 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c37b87-497d-4f45-a6c7-3340f73169c3 None admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:20.858689 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c37b87-497d-4f45-a6c7-3340f73169c3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:20.858997 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c37b87-497d-4f45-a6c7-3340f73169c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:20.860446 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c37b87-497d-4f45-a6c7-3340f73169c3 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:20.877102 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 522/1031] 10.222.0.65 () {56 vars in 1133 bytes} [Tue May 10 03:01:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:01:20.877912 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 510/1032] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:01:20 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:01:20.878342 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c37b87-497d-4f45-a6c7-3340f73169c3 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:20.883458 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b8bb2-3c70-4a14-9497-d7baf60a1432 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:20.975454 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b8bb2-3c70-4a14-9497-d7baf60a1432 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:20.975653 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c37b87-497d-4f45-a6c7-3340f73169c3 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:21.007121 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94069989-e4e5-4b2c-b72c-6e6974255f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:21.007765 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94069989-e4e5-4b2c-b72c-6e6974255f34 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:21.007947 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b681ad37-34b8-41c3-a5e7-8351317bcb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:21.008085 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94069989-e4e5-4b2c-b72c-6e6974255f34 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:21.008338 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94069989-e4e5-4b2c-b72c-6e6974255f34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:21.008759 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681ad37-34b8-41c3-a5e7-8351317bcb76 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:21.009042 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681ad37-34b8-41c3-a5e7-8351317bcb76 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:21.009317 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681ad37-34b8-41c3-a5e7-8351317bcb76 None admin] PATH_INFO: `/v3/services/image` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:21.009971 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b681ad37-34b8-41c3-a5e7-8351317bcb76 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:21.011319 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b681ad37-34b8-41c3-a5e7-8351317bcb76 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:21.022661 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-b681ad37-34b8-41c3-a5e7-8351317bcb76 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 10 03:01:21.022661 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:21.022661 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 03:01:21.022661 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 03:01:21.022661 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 03:01:21.022661 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 03:01:21.022661 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 03:01:21.022661 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:01:21.022661 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 03:01:21.022661 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:01:21.022661 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 03:01:21.022661 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:01:21.022661 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:21.022661 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:21.022661 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:21.022661 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:21.022661 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:21.023642 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:21.023642 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:21.023642 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:21.023642 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:21.023642 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:21.023642 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:21.023642 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 03:01:21.023642 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 03:01:21.023642 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 03:01:21.023642 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 03:01:21.023642 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:21.023642 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:21.023642 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:21.023642 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:21.023642 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:21.023642 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:21.025003 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:21.025003 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:01:21.025003 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:21.025003 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:21.025003 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:21.025003 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:21.025003 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:21.025003 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:21.025003 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:21.025003 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:21.025003 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 03:01:21.025003 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:01:21.025003 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 03:01:21.025003 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:01:21.025003 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 523/1033] 10.222.0.65 () {56 vars in 1105 bytes} [Tue May 10 03:01:20 2022] GET /identity/v3/services/image => generated 86 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:21.025970 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b681ad37-34b8-41c3-a5e7-8351317bcb76 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:21.071538 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94069989-e4e5-4b2c-b72c-6e6974255f34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:21.073001 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94069989-e4e5-4b2c-b72c-6e6974255f34 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:21.122657 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b681ad37-34b8-41c3-a5e7-8351317bcb76 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:21.153499 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e6cf7f-80d3-4f68-9cd4-a40b01ee84d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:21.154269 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6cf7f-80d3-4f68-9cd4-a40b01ee84d1 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:21.154551 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6cf7f-80d3-4f68-9cd4-a40b01ee84d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:21.154821 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6cf7f-80d3-4f68-9cd4-a40b01ee84d1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:21.155990 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e6cf7f-80d3-4f68-9cd4-a40b01ee84d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:21.157692 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e6cf7f-80d3-4f68-9cd4-a40b01ee84d1 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:21.159320 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 524/1034] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:01:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:21.160740 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e6cf7f-80d3-4f68-9cd4-a40b01ee84d1 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:21.167000 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 511/1035] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 10 03:01:20 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 10 03:01:21.167696 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94069989-e4e5-4b2c-b72c-6e6974255f34 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:21.255103 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e6cf7f-80d3-4f68-9cd4-a40b01ee84d1 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:21.260747 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94069989-e4e5-4b2c-b72c-6e6974255f34 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:21.287259 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69937749-ef74-404d-b883-d77fa175751c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:21.287915 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69937749-ef74-404d-b883-d77fa175751c None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:21.288229 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69937749-ef74-404d-b883-d77fa175751c None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:21.288511 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69937749-ef74-404d-b883-d77fa175751c None admin] PATH_INFO: `/v3/services` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:21.289224 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69937749-ef74-404d-b883-d77fa175751c None admin] RBAC: Adding query filter params (name=image) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:21.289530 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69937749-ef74-404d-b883-d77fa175751c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:21.290887 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69937749-ef74-404d-b883-d77fa175751c None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:21.293907 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b4daeb-3495-48a8-9027-2d566ba575ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:21.294569 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4daeb-3495-48a8-9027-2d566ba575ec None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:21.294850 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4daeb-3495-48a8-9027-2d566ba575ec None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:21.295124 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4daeb-3495-48a8-9027-2d566ba575ec None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:21.295742 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 525/1036] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:01:21 2022] GET /identity/v3/services?name=image => generated 122 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:21.295853 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b4daeb-3495-48a8-9027-2d566ba575ec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:21.296391 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69937749-ef74-404d-b883-d77fa175751c None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:21.297265 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b4daeb-3495-48a8-9027-2d566ba575ec None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:21.376104 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 512/1037] 10.222.0.65 () {60 vars in 1132 bytes} [Tue May 10 03:01:21 2022] POST /identity/v3/users => generated 285 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:01:21.376104 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b4daeb-3495-48a8-9027-2d566ba575ec None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:21.399617 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69937749-ef74-404d-b883-d77fa175751c None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:21.435894 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c6ea2a-3f3f-4329-8a45-5cd158684638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:21.436747 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c6ea2a-3f3f-4329-8a45-5cd158684638 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:21.437032 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c6ea2a-3f3f-4329-8a45-5cd158684638 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:21.437309 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c6ea2a-3f3f-4329-8a45-5cd158684638 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:21.449198 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c6ea2a-3f3f-4329-8a45-5cd158684638 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:21.450720 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c6ea2a-3f3f-4329-8a45-5cd158684638 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:21.470236 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-c0c6ea2a-3f3f-4329-8a45-5cd158684638 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:21.470236 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:21.470236 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:21.470236 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:21.470236 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:21.470236 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:21.470236 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:21.470236 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:21.470236 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:21.470236 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:21.470236 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:21.470236 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:21.470236 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:21.470236 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:21.470236 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:21.471239 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:21.471239 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:21.471239 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:21.471239 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:21.471239 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:21.471239 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:21.471239 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:21.471239 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:21.471239 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:01:21.471239 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:21.471239 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:21.471239 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:21.471239 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:21.471239 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:21.471239 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:21.471239 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:21.471239 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:21.472150 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:21.472150 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:21.472150 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:21.472150 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:01:21.472150 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 526/1038] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:01:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:21.474157 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b4daeb-3495-48a8-9027-2d566ba575ec None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:21.478054 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c6ea2a-3f3f-4329-8a45-5cd158684638 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:21.508785 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece46f2-e2d3-45af-90bf-f1f2ca31d0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:21.509384 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece46f2-e2d3-45af-90bf-f1f2ca31d0df None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:21.509670 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece46f2-e2d3-45af-90bf-f1f2ca31d0df None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:21.509948 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece46f2-e2d3-45af-90bf-f1f2ca31d0df None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:21.510674 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eece46f2-e2d3-45af-90bf-f1f2ca31d0df None admin] RBAC: Adding query filter params (type=image) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:21.510986 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eece46f2-e2d3-45af-90bf-f1f2ca31d0df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:21.512432 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eece46f2-e2d3-45af-90bf-f1f2ca31d0df None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:21.517644 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 513/1039] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:01:21 2022] GET /identity/v3/services?type=image => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:21.524979 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece46f2-e2d3-45af-90bf-f1f2ca31d0df None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:21.589636 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c6ea2a-3f3f-4329-8a45-5cd158684638 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:21.627042 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae147ac-de7b-47b7-9a86-3b06a1a926b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:21.627450 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae147ac-de7b-47b7-9a86-3b06a1a926b2 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:21.627720 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae147ac-de7b-47b7-9a86-3b06a1a926b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:21.627991 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae147ac-de7b-47b7-9a86-3b06a1a926b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:21.628739 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae147ac-de7b-47b7-9a86-3b06a1a926b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:21.629071 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae147ac-de7b-47b7-9a86-3b06a1a926b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:21.630294 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece46f2-e2d3-45af-90bf-f1f2ca31d0df None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:21.630399 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae147ac-de7b-47b7-9a86-3b06a1a926b2 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:21.643283 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 527/1040] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:01:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:01:21.648880 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae147ac-de7b-47b7-9a86-3b06a1a926b2 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:21.664713 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a8efa8-ad95-4ec7-bf38-c4cbcb11ac48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:21.665380 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8efa8-ad95-4ec7-bf38-c4cbcb11ac48 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:21.665669 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8efa8-ad95-4ec7-bf38-c4cbcb11ac48 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:21.665946 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8efa8-ad95-4ec7-bf38-c4cbcb11ac48 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:21.666738 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a8efa8-ad95-4ec7-bf38-c4cbcb11ac48 None admin] RBAC: Adding query filter params (interface=public, service_id=d0bf0340673947a5b72ae99f4ce365d5, region_id=RegionOne) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:21.667051 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a8efa8-ad95-4ec7-bf38-c4cbcb11ac48 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:21.668471 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a8efa8-ad95-4ec7-bf38-c4cbcb11ac48 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:21.673545 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 514/1041] 10.222.0.65 () {56 vars in 1251 bytes} [Tue May 10 03:01:21 2022] GET /identity/v3/endpoints?service_id=d0bf0340673947a5b72ae99f4ce365d5&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:01:21.678946 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a8efa8-ad95-4ec7-bf38-c4cbcb11ac48 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:21.745667 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae147ac-de7b-47b7-9a86-3b06a1a926b2 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:21.776549 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a8efa8-ad95-4ec7-bf38-c4cbcb11ac48 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:21.779713 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e136c55a-d5b4-4027-ad79-fe2c42534bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:21.780571 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136c55a-d5b4-4027-ad79-fe2c42534bc0 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:21.780942 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136c55a-d5b4-4027-ad79-fe2c42534bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:21.781227 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136c55a-d5b4-4027-ad79-fe2c42534bc0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:21.788374 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e136c55a-d5b4-4027-ad79-fe2c42534bc0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:21.790078 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e136c55a-d5b4-4027-ad79-fe2c42534bc0 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:21.803477 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-e136c55a-d5b4-4027-ad79-fe2c42534bc0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:01:21.803477 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:21.803477 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:21.803477 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:21.803477 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:21.803477 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:21.803477 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:21.803477 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:21.803477 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:21.803477 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:21.803477 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:21.803477 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:21.803477 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:01:21.803477 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:01:21.803477 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:01:21.804444 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:01:21.804444 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:21.804444 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:21.804444 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:21.804444 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:21.804444 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:21.804444 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:21.804444 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:21.804444 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:01:21.804444 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:21.804444 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:21.804444 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:21.804444 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:21.804444 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:21.804444 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:21.804444 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:21.804444 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:21.805335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:01:21.805335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:01:21.805335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:01:21.805335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:01:21.805335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:01:21.805335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:01:21.805335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:01:21.805335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:01:21.805335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 528/1042] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 10 03:01:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:01:21.810293 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e136c55a-d5b4-4027-ad79-fe2c42534bc0 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:21.813807 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ee0128-30a0-46ae-a31d-5e50f28b145f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:21.814480 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee0128-30a0-46ae-a31d-5e50f28b145f None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:21.814763 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee0128-30a0-46ae-a31d-5e50f28b145f None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:21.815037 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee0128-30a0-46ae-a31d-5e50f28b145f None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:21.815718 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ee0128-30a0-46ae-a31d-5e50f28b145f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:21.817655 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ee0128-30a0-46ae-a31d-5e50f28b145f None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:21.832858 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 515/1043] 10.222.0.65 () {56 vars in 1087 bytes} [Tue May 10 03:01:21 2022] GET /identity/v3/services => generated 1957 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:01:21.913501 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e136c55a-d5b4-4027-ad79-fe2c42534bc0 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:21.948491 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d121558-b799-4e26-ada8-160ae52563e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:21.949169 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d121558-b799-4e26-ada8-160ae52563e3 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:21.949455 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d121558-b799-4e26-ada8-160ae52563e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:21.949732 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d121558-b799-4e26-ada8-160ae52563e3 None admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:21.950543 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d121558-b799-4e26-ada8-160ae52563e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:21.950856 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d121558-b799-4e26-ada8-160ae52563e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:21.952341 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d121558-b799-4e26-ada8-160ae52563e3 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:21.970634 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 529/1044] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 10 03:01:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:01:21.972338 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ee0128-30a0-46ae-a31d-5e50f28b145f None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:22.075506 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ee0128-30a0-46ae-a31d-5e50f28b145f None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:22.106842 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad55ac5-d944-4568-b21c-53aa7eaaac5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:22.107498 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad55ac5-d944-4568-b21c-53aa7eaaac5f None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:22.107789 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad55ac5-d944-4568-b21c-53aa7eaaac5f None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:22.108072 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad55ac5-d944-4568-b21c-53aa7eaaac5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:22.108896 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad55ac5-d944-4568-b21c-53aa7eaaac5f None admin] RBAC: Adding query filter params (role.id=6c4dad34321647f5a6822a530300110c, scope.project.id=513e6592cd83457b8ff461b0e5e1fd40, user.id=9b7ccdccba0b4f9e86817946f22dbe28) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:22.109204 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad55ac5-d944-4568-b21c-53aa7eaaac5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:22.110613 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad55ac5-d944-4568-b21c-53aa7eaaac5f None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:22.116654 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 516/1045] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 10 03:01:21 2022] GET /identity/v3/role_assignments?user.id=9b7ccdccba0b4f9e86817946f22dbe28&scope.project.id=513e6592cd83457b8ff461b0e5e1fd40&role.id=6c4dad34321647f5a6822a530300110c => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:01:23.669644 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f42c7a-4f27-4092-840d-baddf248476b None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:23.670155 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f42c7a-4f27-4092-840d-baddf248476b None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:23.670232 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f42c7a-4f27-4092-840d-baddf248476b None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:23.671708 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 530/1046] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:01:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:23.677216 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d66db-c04d-4be0-8de6-dca8a2b3f0ed None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:23.677601 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d66db-c04d-4be0-8de6-dca8a2b3f0ed None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:23.677769 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d66db-c04d-4be0-8de6-dca8a2b3f0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:23.694190 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-a10d66db-c04d-4be0-8de6-dca8a2b3f0ed None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:23.695385 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-a10d66db-c04d-4be0-8de6-dca8a2b3f0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:23.760442 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 517/1047] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:01:23 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:01:23.783783 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f42c7a-4f27-4092-840d-baddf248476b None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:23.885187 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f42c7a-4f27-4092-840d-baddf248476b None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:23.924040 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc6642-7c42-432f-9aa3-b453170b7fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:23.924836 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc6642-7c42-432f-9aa3-b453170b7fbb None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:23.925118 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc6642-7c42-432f-9aa3-b453170b7fbb None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:23.925393 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc6642-7c42-432f-9aa3-b453170b7fbb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:23.935703 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cc6642-7c42-432f-9aa3-b453170b7fbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:01:23.943729 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-e8cc6642-7c42-432f-9aa3-b453170b7fbb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:01:23.943729 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:23.943729 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:23.943729 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:23.943729 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:23.943729 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:23.943729 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:23.943729 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:23.943729 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:23.943729 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:23.943729 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:23.943729 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:23.943729 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:01:23.943729 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:01:23.943729 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:01:23.943729 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:01:23.944865 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:01:23.944865 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:01:23.944865 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:01:23.944865 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:01:23.944865 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:23.944865 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:23.944865 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:23.944865 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:23.944865 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:23.944865 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:23.944865 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:23.944865 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:01:23.944865 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:23.944865 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:23.944865 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:23.944865 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:23.950578 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:23.950578 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:23.950578 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:23.950578 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:23.950578 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:01:23.950578 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:01:23.950578 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:01:23.950578 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:01:23.950578 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:01:23.950578 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:01:23.950578 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:01:23.950578 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:01:23.950578 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 531/1048] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 10 03:01:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:23.952810 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d66db-c04d-4be0-8de6-dca8a2b3f0ed None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:24.048216 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d66db-c04d-4be0-8de6-dca8a2b3f0ed None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:24.080963 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c8b4e-7d1f-41a3-9e00-37840a88faab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:24.081643 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c8b4e-7d1f-41a3-9e00-37840a88faab None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:24.081973 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c8b4e-7d1f-41a3-9e00-37840a88faab None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:24.082756 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c8b4e-7d1f-41a3-9e00-37840a88faab None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:24.083502 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c8b4e-7d1f-41a3-9e00-37840a88faab None admin] RBAC: Adding query filter params (name=admin) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:24.083809 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c8b4e-7d1f-41a3-9e00-37840a88faab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:24.085221 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c8b4e-7d1f-41a3-9e00-37840a88faab None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:24.086840 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0fae3-4074-432d-b474-0539ee11a8ca None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:24.087128 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0fae3-4074-432d-b474-0539ee11a8ca None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:24.087413 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0fae3-4074-432d-b474-0539ee11a8ca None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:24.088922 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 532/1049] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:01:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:24.093868 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 518/1050] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 10 03:01:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:01:24.094014 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a986f5-720a-4d21-bc70-ddcadbfc80e9 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:24.094188 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a986f5-720a-4d21-bc70-ddcadbfc80e9 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:24.094468 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a986f5-720a-4d21-bc70-ddcadbfc80e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:24.099650 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c8b4e-7d1f-41a3-9e00-37840a88faab None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:24.114697 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-b5a986f5-720a-4d21-bc70-ddcadbfc80e9 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:24.115895 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-b5a986f5-720a-4d21-bc70-ddcadbfc80e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:24.183581 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 533/1051] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:01:24 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 03:01:24.202904 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c8b4e-7d1f-41a3-9e00-37840a88faab None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:24.206335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a986f5-720a-4d21-bc70-ddcadbfc80e9 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:24.237969 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d59ca5a-f870-46ae-b716-b5ee7e1f203a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:24.238871 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59ca5a-f870-46ae-b716-b5ee7e1f203a None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:24.239149 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59ca5a-f870-46ae-b716-b5ee7e1f203a None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:24.239425 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59ca5a-f870-46ae-b716-b5ee7e1f203a None admin] PATH_INFO: `/v3/users/21b6badb0e5f4b818151b27b07431c01` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:24.252835 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d59ca5a-f870-46ae-b716-b5ee7e1f203a None admin] RBAC: Authorizing `identity:get_user(user_id=21b6badb0e5f4b818151b27b07431c01)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:24.254825 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d59ca5a-f870-46ae-b716-b5ee7e1f203a None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:24.261473 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 519/1052] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 10 03:01:24 2022] GET /identity/v3/users/21b6badb0e5f4b818151b27b07431c01 => generated 285 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:01:24.262279 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d59ca5a-f870-46ae-b716-b5ee7e1f203a None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:24.303416 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a986f5-720a-4d21-bc70-ddcadbfc80e9 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:24.338591 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef01fb15-4acb-4f4a-a033-bd0d03d688ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:24.339381 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef01fb15-4acb-4f4a-a033-bd0d03d688ab None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:24.339662 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef01fb15-4acb-4f4a-a033-bd0d03d688ab None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:24.339935 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef01fb15-4acb-4f4a-a033-bd0d03d688ab None admin] PATH_INFO: `/v3/services/image` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:24.340624 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef01fb15-4acb-4f4a-a033-bd0d03d688ab None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:24.341999 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef01fb15-4acb-4f4a-a033-bd0d03d688ab None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:24.353285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-ef01fb15-4acb-4f4a-a033-bd0d03d688ab None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 10 03:01:24.353285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:24.353285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 03:01:24.353285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 03:01:24.353285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 03:01:24.353285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 03:01:24.353285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 03:01:24.353285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:01:24.353285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 03:01:24.353285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:01:24.353285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 03:01:24.353285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:01:24.353285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:24.353285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:24.353285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:24.353285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:24.353285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:24.354236 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:24.354236 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:24.354236 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:24.354236 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:24.354236 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:24.354236 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:24.354236 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 03:01:24.354236 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 03:01:24.354236 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 03:01:24.354236 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 03:01:24.354236 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:24.354236 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:24.354236 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:24.354236 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:24.354236 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:24.354236 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:24.355088 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:24.355088 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:01:24.355088 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:24.355088 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:24.355088 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:24.355088 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:24.355088 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:24.355088 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:24.355088 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:24.355088 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:24.355088 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 03:01:24.355088 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:01:24.355088 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 03:01:24.355088 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:01:24.355088 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 534/1053] 10.222.0.65 () {56 vars in 1105 bytes} [Tue May 10 03:01:24 2022] GET /identity/v3/services/image => generated 86 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:01:24.355888 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af57f310-1559-4197-b222-fd2946502acb None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:24.356120 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af57f310-1559-4197-b222-fd2946502acb None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:24.356606 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af57f310-1559-4197-b222-fd2946502acb None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:24.357785 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 535/1054] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:01:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:24.360755 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af57f310-1559-4197-b222-fd2946502acb None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:24.362478 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d59ca5a-f870-46ae-b716-b5ee7e1f203a None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:24.395338 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b7530e-e920-4dff-ab8b-0979f7197aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:24.395985 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7530e-e920-4dff-ab8b-0979f7197aa5 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:24.396290 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7530e-e920-4dff-ab8b-0979f7197aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:24.396561 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7530e-e920-4dff-ab8b-0979f7197aa5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:24.456766 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af57f310-1559-4197-b222-fd2946502acb None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:24.458936 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b7530e-e920-4dff-ab8b-0979f7197aa5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:24.460419 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b7530e-e920-4dff-ab8b-0979f7197aa5 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:24.489676 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd79ef58-079f-4852-bf07-cf3add5e807c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:24.490414 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd79ef58-079f-4852-bf07-cf3add5e807c None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:24.490699 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd79ef58-079f-4852-bf07-cf3add5e807c None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:24.491188 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd79ef58-079f-4852-bf07-cf3add5e807c None admin] PATH_INFO: `/v3/services` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:24.491979 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd79ef58-079f-4852-bf07-cf3add5e807c None admin] RBAC: Adding query filter params (name=image) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:24.492313 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd79ef58-079f-4852-bf07-cf3add5e807c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:24.493863 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd79ef58-079f-4852-bf07-cf3add5e807c None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:24.498707 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 536/1055] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:01:24 2022] GET /identity/v3/services?name=image => generated 122 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:24.499937 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355db566-95e0-499a-8fc4-e91ceca37447 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:24.500254 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355db566-95e0-499a-8fc4-e91ceca37447 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:24.500537 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355db566-95e0-499a-8fc4-e91ceca37447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:24.516523 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-355db566-95e0-499a-8fc4-e91ceca37447 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:24.517693 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-355db566-95e0-499a-8fc4-e91ceca37447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:24.562588 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 520/1056] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 10 03:01:24 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 10 03:01:24.563354 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b7530e-e920-4dff-ab8b-0979f7197aa5 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:24.580763 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 537/1057] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:01:24 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:01:24.596185 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355db566-95e0-499a-8fc4-e91ceca37447 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:24.658146 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b7530e-e920-4dff-ab8b-0979f7197aa5 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:24.672805 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355db566-95e0-499a-8fc4-e91ceca37447 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:24.690438 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd5bce-c8a0-4bf9-910a-80713cb61d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:24.691096 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd5bce-c8a0-4bf9-910a-80713cb61d60 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:24.691376 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd5bce-c8a0-4bf9-910a-80713cb61d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:24.691647 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd5bce-c8a0-4bf9-910a-80713cb61d60 None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:24.692377 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcd5bce-c8a0-4bf9-910a-80713cb61d60 None admin] RBAC: Adding query filter params (type=image) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:24.692679 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcd5bce-c8a0-4bf9-910a-80713cb61d60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:24.694059 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcd5bce-c8a0-4bf9-910a-80713cb61d60 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:24.698630 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 521/1058] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:01:24 2022] GET /identity/v3/services?type=image => generated 350 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:24.699383 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd5bce-c8a0-4bf9-910a-80713cb61d60 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:24.704825 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79796515-3010-4c03-90e1-48bc7c09b23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:24.705681 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79796515-3010-4c03-90e1-48bc7c09b23f None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:24.705958 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79796515-3010-4c03-90e1-48bc7c09b23f None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:24.706232 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79796515-3010-4c03-90e1-48bc7c09b23f None admin] PATH_INFO: `/v3/projects/8c1f5cc055d24d11be07fd2765515848` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:24.707428 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79796515-3010-4c03-90e1-48bc7c09b23f None admin] RBAC: Authorizing `identity:get_project(project_id=8c1f5cc055d24d11be07fd2765515848)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:24.708885 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79796515-3010-4c03-90e1-48bc7c09b23f None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:24.715347 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 538/1059] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 10 03:01:24 2022] GET /identity/v3/projects/8c1f5cc055d24d11be07fd2765515848 => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:24.715347 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79796515-3010-4c03-90e1-48bc7c09b23f None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:24.794476 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd5bce-c8a0-4bf9-910a-80713cb61d60 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:24.803019 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79796515-3010-4c03-90e1-48bc7c09b23f None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:24.828840 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a88832-0328-48f3-9c0b-f24a147154fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:24.829577 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a88832-0328-48f3-9c0b-f24a147154fb None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:24.829858 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a88832-0328-48f3-9c0b-f24a147154fb None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:24.830139 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a88832-0328-48f3-9c0b-f24a147154fb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:24.835468 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ee6a1-d363-476a-a71a-bfb32851668d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:24.836142 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ee6a1-d363-476a-a71a-bfb32851668d None admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:24.836427 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ee6a1-d363-476a-a71a-bfb32851668d None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:24.836703 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ee6a1-d363-476a-a71a-bfb32851668d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:24.837440 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788ee6a1-d363-476a-a71a-bfb32851668d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:24.838786 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788ee6a1-d363-476a-a71a-bfb32851668d None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:24.842758 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a88832-0328-48f3-9c0b-f24a147154fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:01:24.851418 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-e0a88832-0328-48f3-9c0b-f24a147154fb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 03:01:24.851418 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:24.851418 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:24.851418 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:24.851418 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:24.851418 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:24.851418 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:24.851418 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:24.851418 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:24.851418 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:24.851418 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:24.851418 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:24.851418 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:01:24.851418 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:01:24.851418 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:01:24.851418 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:01:24.852590 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:01:24.852590 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:01:24.852590 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:01:24.852590 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:01:24.852590 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:24.852590 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:24.852590 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:24.852590 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:24.852590 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:24.852590 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:24.852590 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:24.852590 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:01:24.852590 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:24.852590 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:24.852590 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:24.852590 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:24.853460 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:24.853460 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:24.853460 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:24.853460 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:24.853460 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:01:24.853460 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:01:24.853460 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:01:24.853460 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:01:24.853460 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:01:24.853460 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:01:24.853460 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 03:01:24.853460 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:01:24.853460 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 522/1060] 10.222.0.65 () {56 vars in 1120 bytes} [Tue May 10 03:01:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:24.854170 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a88832-0328-48f3-9c0b-f24a147154fb None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:24.947679 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a88832-0328-48f3-9c0b-f24a147154fb None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:24.979093 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112681b7-bdff-4e9b-9aa1-9b5e9db7a441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:24.979741 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112681b7-bdff-4e9b-9aa1-9b5e9db7a441 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:24.980045 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112681b7-bdff-4e9b-9aa1-9b5e9db7a441 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:24.980321 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112681b7-bdff-4e9b-9aa1-9b5e9db7a441 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:24.980525 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 539/1061] 10.222.0.65 () {60 vars in 1144 bytes} [Tue May 10 03:01:24 2022] POST /identity/v3/endpoints => generated 327 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:01:24.981144 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112681b7-bdff-4e9b-9aa1-9b5e9db7a441 None admin] RBAC: Adding query filter params (role.id=43105000610f402ca2486e7648018cca, scope.project.id=8c1f5cc055d24d11be07fd2765515848, user.id=21b6badb0e5f4b818151b27b07431c01) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:24.981455 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112681b7-bdff-4e9b-9aa1-9b5e9db7a441 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:24.981553 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ee6a1-d363-476a-a71a-bfb32851668d None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:24.982884 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112681b7-bdff-4e9b-9aa1-9b5e9db7a441 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:24.998820 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 523/1062] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 10 03:01:24 2022] GET /identity/v3/role_assignments?user.id=21b6badb0e5f4b818151b27b07431c01&scope.project.id=8c1f5cc055d24d11be07fd2765515848&role.id=43105000610f402ca2486e7648018cca => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:25.104610 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ee6a1-d363-476a-a71a-bfb32851668d None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:25.142577 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab1755-1ccc-4b98-9e38-7ff95a7bf93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:25.143267 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab1755-1ccc-4b98-9e38-7ff95a7bf93f None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:25.143549 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab1755-1ccc-4b98-9e38-7ff95a7bf93f None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:25.143821 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab1755-1ccc-4b98-9e38-7ff95a7bf93f None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:25.145176 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feab1755-1ccc-4b98-9e38-7ff95a7bf93f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:25.145482 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feab1755-1ccc-4b98-9e38-7ff95a7bf93f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:25.146889 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feab1755-1ccc-4b98-9e38-7ff95a7bf93f None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:25.161697 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 540/1063] 10.222.0.65 () {56 vars in 1115 bytes} [Tue May 10 03:01:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:25.163094 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112681b7-bdff-4e9b-9aa1-9b5e9db7a441 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:25.272375 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112681b7-bdff-4e9b-9aa1-9b5e9db7a441 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:25.305510 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3203a25-4c11-4fb5-946c-1fff21a0421f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:25.306306 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3203a25-4c11-4fb5-946c-1fff21a0421f None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:25.306585 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3203a25-4c11-4fb5-946c-1fff21a0421f None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:25.306860 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3203a25-4c11-4fb5-946c-1fff21a0421f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:25.317188 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3203a25-4c11-4fb5-946c-1fff21a0421f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:25.318652 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3203a25-4c11-4fb5-946c-1fff21a0421f None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:25.335587 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-a3203a25-4c11-4fb5-946c-1fff21a0421f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:25.335587 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:25.335587 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:25.335587 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:25.335587 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:25.335587 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:25.335587 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:25.335587 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:25.335587 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:25.335587 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:25.335587 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:25.335587 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:25.335587 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:25.335587 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:25.335587 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:25.336721 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:25.336721 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:25.336721 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:25.336721 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:25.336721 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:25.336721 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:25.336721 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:25.336721 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:25.336721 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:01:25.336721 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:25.336721 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:25.336721 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:25.336721 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:25.336721 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:25.336721 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:25.336721 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:25.336721 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:25.337614 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:25.337614 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:25.337614 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:25.337614 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:01:25.337614 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 524/1064] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:01:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:01:25.342709 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab1755-1ccc-4b98-9e38-7ff95a7bf93f None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:25.437572 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab1755-1ccc-4b98-9e38-7ff95a7bf93f None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:25.473988 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e159de-d65a-4b92-bfe7-ba5cbada2254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:25.474659 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e159de-d65a-4b92-bfe7-ba5cbada2254 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:25.474944 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e159de-d65a-4b92-bfe7-ba5cbada2254 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:25.475220 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e159de-d65a-4b92-bfe7-ba5cbada2254 None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:25.475945 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e159de-d65a-4b92-bfe7-ba5cbada2254 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:25.476280 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e159de-d65a-4b92-bfe7-ba5cbada2254 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:25.477659 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e159de-d65a-4b92-bfe7-ba5cbada2254 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:25.494499 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 541/1065] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:01:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:25.495447 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3203a25-4c11-4fb5-946c-1fff21a0421f None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:25.599819 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3203a25-4c11-4fb5-946c-1fff21a0421f None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:25.631882 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe25c33-8170-4995-8938-ec4e385adc20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:25.632705 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe25c33-8170-4995-8938-ec4e385adc20 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:25.632988 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe25c33-8170-4995-8938-ec4e385adc20 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:25.633263 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe25c33-8170-4995-8938-ec4e385adc20 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:25.640483 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe25c33-8170-4995-8938-ec4e385adc20 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:25.641917 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe25c33-8170-4995-8938-ec4e385adc20 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:25.656029 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-ffe25c33-8170-4995-8938-ec4e385adc20 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 03:01:25.656029 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:25.656029 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:25.656029 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:25.656029 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:25.656029 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:25.656029 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:25.656029 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:25.656029 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:25.656029 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:25.656029 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:25.656029 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:25.656029 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:01:25.656029 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:01:25.656029 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:01:25.656029 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:01:25.657268 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:25.657268 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:25.657268 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:01:25.657268 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:25.657268 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:01:25.657268 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:25.657268 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:25.657268 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:25.657268 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:25.657268 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:25.657268 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:25.657268 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:01:25.657268 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:25.657268 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:25.657268 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:25.657268 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:25.657268 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:25.657268 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:25.658281 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:25.658281 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:25.658281 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:01:25.658281 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:01:25.658281 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:01:25.658281 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:01:25.658281 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:01:25.658281 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:01:25.658281 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 03:01:25.658281 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:01:25.659409 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 525/1066] 10.222.0.65 () {56 vars in 1093 bytes} [Tue May 10 03:01:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:01:25.663284 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e159de-d65a-4b92-bfe7-ba5cbada2254 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:25.758109 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e159de-d65a-4b92-bfe7-ba5cbada2254 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:25.790440 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e56abe5-2a5c-4bd9-b5d0-345ff0d9e5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:25.791130 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56abe5-2a5c-4bd9-b5d0-345ff0d9e5ee None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:25.791397 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56abe5-2a5c-4bd9-b5d0-345ff0d9e5ee None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:25.791668 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56abe5-2a5c-4bd9-b5d0-345ff0d9e5ee None admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:25.792612 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e56abe5-2a5c-4bd9-b5d0-345ff0d9e5ee None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:25.792928 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e56abe5-2a5c-4bd9-b5d0-345ff0d9e5ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:25.794334 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e56abe5-2a5c-4bd9-b5d0-345ff0d9e5ee None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:25.811726 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 542/1067] 10.222.0.65 () {56 vars in 1133 bytes} [Tue May 10 03:01:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:01:25.817722 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe25c33-8170-4995-8938-ec4e385adc20 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:25.911669 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe25c33-8170-4995-8938-ec4e385adc20 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:25.943327 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6481a578-4b5d-4e5f-8f28-7deeaa44e94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:25.944130 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481a578-4b5d-4e5f-8f28-7deeaa44e94c None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:25.944417 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481a578-4b5d-4e5f-8f28-7deeaa44e94c None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:25.944691 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481a578-4b5d-4e5f-8f28-7deeaa44e94c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:25.954526 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6481a578-4b5d-4e5f-8f28-7deeaa44e94c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:25.955954 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6481a578-4b5d-4e5f-8f28-7deeaa44e94c None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:25.972241 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-6481a578-4b5d-4e5f-8f28-7deeaa44e94c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:25.972241 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:25.972241 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:25.972241 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:25.972241 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:25.972241 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:25.972241 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:25.972241 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:25.972241 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:25.972241 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:25.972241 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:25.972241 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:25.972241 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:25.972241 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:25.972241 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:25.973100 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:25.973100 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:25.973100 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:25.973100 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:25.973100 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:25.973100 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:25.973100 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:25.973100 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:25.973100 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:01:25.973100 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:25.973100 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:25.973100 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:25.973100 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:25.973100 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:25.973100 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:25.973100 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:25.973100 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:25.973977 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:25.973977 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:25.973977 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:25.973977 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:01:25.973977 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 526/1068] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:01:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:01:25.979924 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e56abe5-2a5c-4bd9-b5d0-345ff0d9e5ee None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:26.074171 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e56abe5-2a5c-4bd9-b5d0-345ff0d9e5ee None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:26.106182 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f33d7-5d15-4a8e-813a-c703df2742d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:26.106865 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f33d7-5d15-4a8e-813a-c703df2742d9 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:26.107148 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f33d7-5d15-4a8e-813a-c703df2742d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:26.107423 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f33d7-5d15-4a8e-813a-c703df2742d9 None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:26.108200 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f33d7-5d15-4a8e-813a-c703df2742d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:26.108509 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f33d7-5d15-4a8e-813a-c703df2742d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:26.109914 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f33d7-5d15-4a8e-813a-c703df2742d9 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:26.126670 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 543/1069] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:01:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:26.127897 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6481a578-4b5d-4e5f-8f28-7deeaa44e94c None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:26.226483 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6481a578-4b5d-4e5f-8f28-7deeaa44e94c None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:26.258873 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87440f6-e43d-4721-93a0-bebe02a8088f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:26.259661 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87440f6-e43d-4721-93a0-bebe02a8088f None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:26.259939 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87440f6-e43d-4721-93a0-bebe02a8088f None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:26.260239 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87440f6-e43d-4721-93a0-bebe02a8088f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:26.266654 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87440f6-e43d-4721-93a0-bebe02a8088f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:26.268109 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87440f6-e43d-4721-93a0-bebe02a8088f None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:26.281636 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-f87440f6-e43d-4721-93a0-bebe02a8088f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:01:26.281636 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:26.281636 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:26.281636 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:26.281636 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:26.281636 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:26.281636 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:26.281636 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:26.281636 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:26.281636 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:26.281636 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:26.281636 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:26.281636 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:01:26.281636 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:01:26.281636 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:01:26.282781 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:01:26.282781 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:26.282781 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:26.282781 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:26.282781 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:26.282781 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:26.282781 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:26.282781 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:26.282781 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:01:26.282781 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:26.282781 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:26.282781 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:26.282781 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:26.282781 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:26.282781 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:26.282781 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:26.282781 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:26.288975 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:01:26.288975 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:01:26.288975 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:01:26.288975 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:01:26.288975 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:01:26.288975 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:01:26.288975 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:01:26.288975 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:01:26.288975 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 527/1070] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 10 03:01:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:26.289457 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f33d7-5d15-4a8e-813a-c703df2742d9 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:26.383811 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f33d7-5d15-4a8e-813a-c703df2742d9 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:26.415019 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a3534-afb1-4966-85e3-b89760260e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:26.415667 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a3534-afb1-4966-85e3-b89760260e7a None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:26.415946 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a3534-afb1-4966-85e3-b89760260e7a None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:26.416244 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a3534-afb1-4966-85e3-b89760260e7a None admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:26.417016 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0a3534-afb1-4966-85e3-b89760260e7a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:26.417321 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0a3534-afb1-4966-85e3-b89760260e7a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:26.418724 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0a3534-afb1-4966-85e3-b89760260e7a None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:26.430656 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 544/1071] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 10 03:01:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:26.436262 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87440f6-e43d-4721-93a0-bebe02a8088f None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:26.539426 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87440f6-e43d-4721-93a0-bebe02a8088f None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:26.570669 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aba406-b3c6-400b-a1e5-df698320309e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:26.571563 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aba406-b3c6-400b-a1e5-df698320309e None admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:26.571841 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aba406-b3c6-400b-a1e5-df698320309e None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:26.572140 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aba406-b3c6-400b-a1e5-df698320309e None admin] PATH_INFO: `/v3/projects/513e6592cd83457b8ff461b0e5e1fd40/users/9b7ccdccba0b4f9e86817946f22dbe28/roles/6c4dad34321647f5a6822a530300110c` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:26.574302 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aba406-b3c6-400b-a1e5-df698320309e None admin] RBAC: Authorizing `identity:create_grant(project_id=513e6592cd83457b8ff461b0e5e1fd40, user_id=9b7ccdccba0b4f9e86817946f22dbe28, role_id=6c4dad34321647f5a6822a530300110c)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:26.575725 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aba406-b3c6-400b-a1e5-df698320309e None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:26.637171 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 528/1072] 10.222.0.65 () {58 vars in 1439 bytes} [Tue May 10 03:01:26 2022] PUT /identity/v3/projects/513e6592cd83457b8ff461b0e5e1fd40/users/9b7ccdccba0b4f9e86817946f22dbe28/roles/6c4dad34321647f5a6822a530300110c => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:01:27.227361 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c984c4-4428-4443-9e13-22342d1a43d1 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:27.227880 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c984c4-4428-4443-9e13-22342d1a43d1 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:27.227959 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c984c4-4428-4443-9e13-22342d1a43d1 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:27.229459 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 545/1073] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:01:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:27.234511 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2726d-042a-4cdf-be87-3f24b9873b8a None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:27.234902 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2726d-042a-4cdf-be87-3f24b9873b8a None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:27.235066 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2726d-042a-4cdf-be87-3f24b9873b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:27.251374 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-aae2726d-042a-4cdf-be87-3f24b9873b8a None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:27.252584 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-aae2726d-042a-4cdf-be87-3f24b9873b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:27.279691 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7028452-3e84-4215-ae47-0b7e32b2a7d0 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:27.279978 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7028452-3e84-4215-ae47-0b7e32b2a7d0 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:27.280289 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7028452-3e84-4215-ae47-0b7e32b2a7d0 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:27.281683 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 546/1074] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:01:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:27.286979 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d56c0-efce-48f5-9ef7-b2060cf1ae24 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:27.287263 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d56c0-efce-48f5-9ef7-b2060cf1ae24 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:27.288249 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d56c0-efce-48f5-9ef7-b2060cf1ae24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:27.305416 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-8c8d56c0-efce-48f5-9ef7-b2060cf1ae24 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:27.306597 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-8c8d56c0-efce-48f5-9ef7-b2060cf1ae24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:27.320928 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 529/1075] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:01:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:01:27.342207 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae2726d-042a-4cdf-be87-3f24b9873b8a None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:27.373187 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 547/1076] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:01:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 03:01:27.394967 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d56c0-efce-48f5-9ef7-b2060cf1ae24 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:27.437796 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae2726d-042a-4cdf-be87-3f24b9873b8a None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:27.477096 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392da94f-ff64-496b-8c15-afc47a589667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:27.477962 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392da94f-ff64-496b-8c15-afc47a589667 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:27.478191 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392da94f-ff64-496b-8c15-afc47a589667 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:27.478466 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392da94f-ff64-496b-8c15-afc47a589667 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:27.489206 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392da94f-ff64-496b-8c15-afc47a589667 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:01:27.491275 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d56c0-efce-48f5-9ef7-b2060cf1ae24 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:27.496726 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-392da94f-ff64-496b-8c15-afc47a589667 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:01:27.496726 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:27.496726 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:27.496726 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:27.496726 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:27.496726 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:27.496726 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:27.496726 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:27.496726 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:27.496726 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:27.496726 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:27.496726 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:27.496726 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:01:27.496726 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:01:27.496726 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:01:27.496726 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:01:27.497652 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:01:27.497652 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:01:27.497652 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:01:27.497652 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:01:27.497652 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:27.497652 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:27.497652 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:27.497652 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:27.497652 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:27.497652 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:27.497652 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:27.497652 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:01:27.497652 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:27.497652 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:27.497652 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:27.497652 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:27.498476 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:27.498476 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:27.498476 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:27.498476 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:27.498476 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:01:27.498476 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:01:27.498476 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:01:27.498476 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:01:27.498476 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:01:27.498476 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:01:27.498476 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:01:27.498476 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:01:27.500318 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 530/1077] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 10 03:01:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:01:27.503573 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392da94f-ff64-496b-8c15-afc47a589667 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:27.525445 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffabd25-8ebc-49a8-a3b2-e1549477ecb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:27.526090 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffabd25-8ebc-49a8-a3b2-e1549477ecb4 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:27.526372 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffabd25-8ebc-49a8-a3b2-e1549477ecb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:27.526646 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffabd25-8ebc-49a8-a3b2-e1549477ecb4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:27.603213 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffabd25-8ebc-49a8-a3b2-e1549477ecb4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:27.605746 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffabd25-8ebc-49a8-a3b2-e1549477ecb4 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:27.609031 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392da94f-ff64-496b-8c15-afc47a589667 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:27.641951 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e9d516-cf18-445c-8112-af86307d5d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:27.642618 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9d516-cf18-445c-8112-af86307d5d42 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:27.642897 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9d516-cf18-445c-8112-af86307d5d42 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:27.643180 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9d516-cf18-445c-8112-af86307d5d42 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:27.643925 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e9d516-cf18-445c-8112-af86307d5d42 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:27.644282 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e9d516-cf18-445c-8112-af86307d5d42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:27.645654 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e9d516-cf18-445c-8112-af86307d5d42 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:27.654231 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 531/1078] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 10 03:01:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:01:27.660880 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e9d516-cf18-445c-8112-af86307d5d42 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:27.708553 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 548/1079] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 10 03:01:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 10 03:01:27.709726 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffabd25-8ebc-49a8-a3b2-e1549477ecb4 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:27.759258 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e9d516-cf18-445c-8112-af86307d5d42 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:27.794870 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1979fb55-1d94-491f-b82a-217278531989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:27.795743 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979fb55-1d94-491f-b82a-217278531989 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:27.796043 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979fb55-1d94-491f-b82a-217278531989 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:27.796328 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979fb55-1d94-491f-b82a-217278531989 None admin] PATH_INFO: `/v3/users/21b6badb0e5f4b818151b27b07431c01` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:27.797533 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1979fb55-1d94-491f-b82a-217278531989 None admin] RBAC: Authorizing `identity:get_user(user_id=21b6badb0e5f4b818151b27b07431c01)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:27.799320 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1979fb55-1d94-491f-b82a-217278531989 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:27.801463 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 532/1080] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 10 03:01:27 2022] GET /identity/v3/users/21b6badb0e5f4b818151b27b07431c01 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:01:27.807388 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1979fb55-1d94-491f-b82a-217278531989 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:27.811477 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffabd25-8ebc-49a8-a3b2-e1549477ecb4 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:27.843643 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b42504-5a6e-4ee5-bac0-707f36061196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:27.844470 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b42504-5a6e-4ee5-bac0-707f36061196 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:27.844757 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b42504-5a6e-4ee5-bac0-707f36061196 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:27.845033 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b42504-5a6e-4ee5-bac0-707f36061196 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:27.855353 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b42504-5a6e-4ee5-bac0-707f36061196 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:27.856845 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b42504-5a6e-4ee5-bac0-707f36061196 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:27.875190 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-67b42504-5a6e-4ee5-bac0-707f36061196 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:27.875190 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:27.875190 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:27.875190 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:27.875190 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:27.875190 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:27.875190 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:27.875190 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:27.875190 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:27.875190 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:27.875190 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:27.875190 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:27.875190 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:27.875190 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:27.875190 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:27.876145 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:27.876145 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:27.876145 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:27.876145 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:27.876145 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:27.876145 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:27.876145 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:27.876145 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:27.876145 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:01:27.876145 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:27.876145 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:27.876145 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:27.876145 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:27.876145 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:27.876145 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:27.876145 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:27.876145 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:27.877258 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:27.877258 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:27.877258 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:27.877258 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:01:27.881246 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 549/1081] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:01:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:27.882120 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b42504-5a6e-4ee5-bac0-707f36061196 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:27.907397 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1979fb55-1d94-491f-b82a-217278531989 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:27.942432 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af3e963-3b9e-475d-a62a-9438180c1c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:27.943294 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3e963-3b9e-475d-a62a-9438180c1c61 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:27.943581 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3e963-3b9e-475d-a62a-9438180c1c61 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:27.943863 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3e963-3b9e-475d-a62a-9438180c1c61 None admin] PATH_INFO: `/v3/projects/8c1f5cc055d24d11be07fd2765515848` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:27.945082 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af3e963-3b9e-475d-a62a-9438180c1c61 None admin] RBAC: Authorizing `identity:get_project(project_id=8c1f5cc055d24d11be07fd2765515848)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:27.946520 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af3e963-3b9e-475d-a62a-9438180c1c61 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:27.948256 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 533/1082] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 10 03:01:27 2022] GET /identity/v3/projects/8c1f5cc055d24d11be07fd2765515848 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:27.953805 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af3e963-3b9e-475d-a62a-9438180c1c61 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:27.977133 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b42504-5a6e-4ee5-bac0-707f36061196 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:28.011440 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f99346-ff8d-4431-b76e-7d0203a29efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:28.012155 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f99346-ff8d-4431-b76e-7d0203a29efb None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:28.012450 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f99346-ff8d-4431-b76e-7d0203a29efb None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:28.012724 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f99346-ff8d-4431-b76e-7d0203a29efb None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:28.013439 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f99346-ff8d-4431-b76e-7d0203a29efb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:28.013743 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f99346-ff8d-4431-b76e-7d0203a29efb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:28.015092 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f99346-ff8d-4431-b76e-7d0203a29efb None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:28.036285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 550/1083] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:01:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:01:28.063568 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af3e963-3b9e-475d-a62a-9438180c1c61 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:28.099947 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af142313-54f5-486d-87f0-037ffa482f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:28.100879 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af142313-54f5-486d-87f0-037ffa482f17 None admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:28.101168 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af142313-54f5-486d-87f0-037ffa482f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:28.101445 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af142313-54f5-486d-87f0-037ffa482f17 None admin] PATH_INFO: `/v3/projects/8c1f5cc055d24d11be07fd2765515848/users/21b6badb0e5f4b818151b27b07431c01/roles/43105000610f402ca2486e7648018cca` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:28.103551 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af142313-54f5-486d-87f0-037ffa482f17 None admin] RBAC: Authorizing `identity:create_grant(project_id=8c1f5cc055d24d11be07fd2765515848, user_id=21b6badb0e5f4b818151b27b07431c01, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:28.105061 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af142313-54f5-486d-87f0-037ffa482f17 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:28.209481 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 534/1084] 10.222.0.65 () {58 vars in 1439 bytes} [Tue May 10 03:01:27 2022] PUT /identity/v3/projects/8c1f5cc055d24d11be07fd2765515848/users/21b6badb0e5f4b818151b27b07431c01/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:01:28.890408 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62acf5ca-081b-4d44-9e19-16e7b3bd8842 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:28.891020 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62acf5ca-081b-4d44-9e19-16e7b3bd8842 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:28.891020 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62acf5ca-081b-4d44-9e19-16e7b3bd8842 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:28.892369 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 551/1085] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:01:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:28.897684 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949fe9b-be24-4f53-ae08-bd7d22d87005 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:28.898092 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949fe9b-be24-4f53-ae08-bd7d22d87005 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:28.898367 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949fe9b-be24-4f53-ae08-bd7d22d87005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:28.914934 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-9949fe9b-be24-4f53-ae08-bd7d22d87005 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:28.916139 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-9949fe9b-be24-4f53-ae08-bd7d22d87005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:28.979352 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 535/1086] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:01:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:01:29.003452 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62acf5ca-081b-4d44-9e19-16e7b3bd8842 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:29.100388 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62acf5ca-081b-4d44-9e19-16e7b3bd8842 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:29.131830 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d231ad6-add9-49ae-9a94-ef8d5b56c689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:29.132644 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d231ad6-add9-49ae-9a94-ef8d5b56c689 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:29.132925 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d231ad6-add9-49ae-9a94-ef8d5b56c689 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:29.133196 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d231ad6-add9-49ae-9a94-ef8d5b56c689 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:29.142611 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d231ad6-add9-49ae-9a94-ef8d5b56c689 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:01:29.150598 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-7d231ad6-add9-49ae-9a94-ef8d5b56c689 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 03:01:29.150598 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:29.150598 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:29.150598 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:29.150598 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:29.150598 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:29.150598 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:29.150598 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:29.150598 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:29.150598 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:29.150598 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:29.150598 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:29.150598 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:01:29.150598 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:01:29.150598 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:01:29.150598 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:01:29.156518 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:01:29.156518 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:01:29.156518 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:01:29.156518 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:01:29.156518 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:29.156518 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:29.156518 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:29.156518 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:29.156518 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:29.156518 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:29.156518 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:29.156518 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:01:29.156518 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:29.156518 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:29.156518 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:29.156518 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:29.157966 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:29.157966 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:29.157966 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:29.157966 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:29.157966 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:01:29.157966 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:01:29.157966 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:01:29.157966 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:01:29.157966 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:01:29.157966 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:01:29.157966 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 03:01:29.157966 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:01:29.157966 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 552/1087] 10.222.0.65 () {56 vars in 1120 bytes} [Tue May 10 03:01:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:29.158886 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9949fe9b-be24-4f53-ae08-bd7d22d87005 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:29.259330 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9949fe9b-be24-4f53-ae08-bd7d22d87005 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:29.291312 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa33aca5-5c6d-42cc-bbdc-018f9725e08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:29.291975 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa33aca5-5c6d-42cc-bbdc-018f9725e08c None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:29.292280 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa33aca5-5c6d-42cc-bbdc-018f9725e08c None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:29.292551 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa33aca5-5c6d-42cc-bbdc-018f9725e08c None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:29.293291 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa33aca5-5c6d-42cc-bbdc-018f9725e08c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:29.293593 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa33aca5-5c6d-42cc-bbdc-018f9725e08c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:29.294946 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa33aca5-5c6d-42cc-bbdc-018f9725e08c None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:29.303652 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 536/1088] 10.222.0.65 () {56 vars in 1115 bytes} [Tue May 10 03:01:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:29.309293 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d231ad6-add9-49ae-9a94-ef8d5b56c689 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:29.403664 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d231ad6-add9-49ae-9a94-ef8d5b56c689 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:29.435995 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4bb76a-221a-463d-84e5-0ec713dc1173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:29.436804 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4bb76a-221a-463d-84e5-0ec713dc1173 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:29.437083 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4bb76a-221a-463d-84e5-0ec713dc1173 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:29.437356 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4bb76a-221a-463d-84e5-0ec713dc1173 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:29.447303 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4bb76a-221a-463d-84e5-0ec713dc1173 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:29.448771 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4bb76a-221a-463d-84e5-0ec713dc1173 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:29.465965 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-ef4bb76a-221a-463d-84e5-0ec713dc1173 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:29.465965 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:29.465965 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:29.465965 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:29.465965 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:29.465965 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:29.465965 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:29.465965 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:29.465965 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:29.465965 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:29.465965 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:29.465965 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:29.465965 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:29.465965 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:29.465965 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:29.467091 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:29.467091 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:29.467091 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:29.467091 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:29.467091 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:29.467091 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:29.467091 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:29.467091 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:29.467091 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:01:29.467091 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:29.467091 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:29.467091 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:29.467091 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:29.467091 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:29.467091 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:29.467091 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:29.467091 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:29.468395 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:29.468395 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:29.468395 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:29.468395 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:01:29.468395 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 553/1089] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:01:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:01:29.473979 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa33aca5-5c6d-42cc-bbdc-018f9725e08c None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:29.567344 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa33aca5-5c6d-42cc-bbdc-018f9725e08c None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:29.601095 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88197a3b-3b60-4e48-a2c5-23b3f44010c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:29.603240 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88197a3b-3b60-4e48-a2c5-23b3f44010c2 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:29.604303 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88197a3b-3b60-4e48-a2c5-23b3f44010c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:29.604885 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88197a3b-3b60-4e48-a2c5-23b3f44010c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:29.605622 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88197a3b-3b60-4e48-a2c5-23b3f44010c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:29.605929 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88197a3b-3b60-4e48-a2c5-23b3f44010c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:29.608219 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88197a3b-3b60-4e48-a2c5-23b3f44010c2 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:29.623467 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 537/1090] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:01:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:29.628995 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4bb76a-221a-463d-84e5-0ec713dc1173 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:29.725739 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4bb76a-221a-463d-84e5-0ec713dc1173 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:29.756548 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a6fc90-81ef-4e11-9f83-4c550596f811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:29.757325 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a6fc90-81ef-4e11-9f83-4c550596f811 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:29.757606 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a6fc90-81ef-4e11-9f83-4c550596f811 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:29.757876 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a6fc90-81ef-4e11-9f83-4c550596f811 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:29.764967 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a6fc90-81ef-4e11-9f83-4c550596f811 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:29.766392 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a6fc90-81ef-4e11-9f83-4c550596f811 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:29.780360 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-01a6fc90-81ef-4e11-9f83-4c550596f811 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 03:01:29.780360 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:29.780360 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:29.780360 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:29.780360 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:29.780360 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:29.780360 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:29.780360 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:29.780360 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:29.780360 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:29.780360 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:29.780360 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:29.780360 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:01:29.780360 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:01:29.780360 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:01:29.780360 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:01:29.781267 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:29.781267 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:29.781267 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:01:29.781267 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:29.781267 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:01:29.781267 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:01:29.781267 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:29.781267 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:29.781267 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:29.781267 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:29.781267 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:29.781267 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:01:29.781267 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:29.781267 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:29.781267 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:29.781267 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:29.781267 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:29.781267 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:29.782474 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:29.782474 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:29.782474 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:01:29.782474 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:01:29.782474 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:01:29.782474 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:01:29.782474 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:01:29.782474 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:01:29.782474 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 03:01:29.782474 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:01:29.782474 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 554/1091] 10.222.0.65 () {56 vars in 1093 bytes} [Tue May 10 03:01:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:01:29.788207 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88197a3b-3b60-4e48-a2c5-23b3f44010c2 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:29.881060 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88197a3b-3b60-4e48-a2c5-23b3f44010c2 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:29.915234 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3789be-5085-45af-ade1-c99517234355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:29.915904 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3789be-5085-45af-ade1-c99517234355 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:29.916213 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3789be-5085-45af-ade1-c99517234355 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:29.916489 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3789be-5085-45af-ade1-c99517234355 None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:29.917322 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3789be-5085-45af-ade1-c99517234355 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:29.917628 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3789be-5085-45af-ade1-c99517234355 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:29.919063 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3789be-5085-45af-ade1-c99517234355 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:29.935387 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 538/1092] 10.222.0.65 () {56 vars in 1133 bytes} [Tue May 10 03:01:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:29.940967 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a6fc90-81ef-4e11-9f83-4c550596f811 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:30.036955 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a6fc90-81ef-4e11-9f83-4c550596f811 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:30.068521 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f7b163-074c-437a-8935-5617adc6c476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:30.069162 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7b163-074c-437a-8935-5617adc6c476 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:30.069438 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7b163-074c-437a-8935-5617adc6c476 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:30.069707 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7b163-074c-437a-8935-5617adc6c476 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:30.132016 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f7b163-074c-437a-8935-5617adc6c476 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:30.133450 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f7b163-074c-437a-8935-5617adc6c476 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:30.223753 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 555/1093] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 10 03:01:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 10 03:01:30.229260 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3789be-5085-45af-ade1-c99517234355 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:30.327868 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3789be-5085-45af-ade1-c99517234355 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:30.359121 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba33e11-de77-49e5-bb1f-601288497533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:30.359902 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba33e11-de77-49e5-bb1f-601288497533 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:30.360213 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba33e11-de77-49e5-bb1f-601288497533 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:30.360487 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba33e11-de77-49e5-bb1f-601288497533 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:30.370412 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba33e11-de77-49e5-bb1f-601288497533 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:30.371852 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba33e11-de77-49e5-bb1f-601288497533 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:30.389053 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-5ba33e11-de77-49e5-bb1f-601288497533 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:30.389053 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:30.389053 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:30.389053 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:30.389053 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:30.389053 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:30.389053 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:30.389053 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:30.389053 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:30.389053 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:30.389053 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:30.389053 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:30.389053 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:01:30.389053 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:01:30.389053 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:01:30.390101 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:01:30.390101 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:30.390101 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:30.390101 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:30.390101 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:30.390101 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:30.390101 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:30.390101 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:30.390101 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:01:30.390101 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:30.390101 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:30.390101 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:30.390101 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:30.390101 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:30.390101 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:30.390101 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:30.390101 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:30.391008 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:01:30.391008 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:01:30.391008 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:01:30.391008 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:01:30.391008 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 539/1094] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:01:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:30.395899 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f7b163-074c-437a-8935-5617adc6c476 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:30.427874 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1aa3b-5435-42e4-af03-1b45bd3e0317 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:30.428197 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1aa3b-5435-42e4-af03-1b45bd3e0317 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:30.428473 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1aa3b-5435-42e4-af03-1b45bd3e0317 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:30.429816 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 540/1095] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:01:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:01:30.434699 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7fe47-8470-48ab-adc1-d51f2496e83f None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:30.434984 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7fe47-8470-48ab-adc1-d51f2496e83f None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:30.435264 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7fe47-8470-48ab-adc1-d51f2496e83f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:30.451907 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-e2d7fe47-8470-48ab-adc1-d51f2496e83f None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:30.453475 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-e2d7fe47-8470-48ab-adc1-d51f2496e83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:30.495238 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f7b163-074c-437a-8935-5617adc6c476 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:30.527747 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6853f68e-0434-402c-ab9f-b2de1e460c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:30.528434 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853f68e-0434-402c-ab9f-b2de1e460c4b None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:30.528717 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853f68e-0434-402c-ab9f-b2de1e460c4b None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:30.528992 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853f68e-0434-402c-ab9f-b2de1e460c4b None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:30.529705 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6853f68e-0434-402c-ab9f-b2de1e460c4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:30.530010 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6853f68e-0434-402c-ab9f-b2de1e460c4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:30.531356 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6853f68e-0434-402c-ab9f-b2de1e460c4b None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:30.533534 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 541/1096] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:01:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 03:01:30.547471 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 556/1097] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:01:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:30.548830 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d7fe47-8470-48ab-adc1-d51f2496e83f None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:30.556595 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6853f68e-0434-402c-ab9f-b2de1e460c4b None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:30.645915 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d7fe47-8470-48ab-adc1-d51f2496e83f None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:30.648295 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6853f68e-0434-402c-ab9f-b2de1e460c4b None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:30.678356 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e4969-155d-43e3-b949-c4912e06273b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:30.679143 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e4969-155d-43e3-b949-c4912e06273b None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:30.679428 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e4969-155d-43e3-b949-c4912e06273b None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:30.679699 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e4969-155d-43e3-b949-c4912e06273b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:30.679988 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb3d250-20f6-4078-b08a-c86b30299403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:30.680788 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3d250-20f6-4078-b08a-c86b30299403 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:30.681064 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3d250-20f6-4078-b08a-c86b30299403 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:30.681332 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3d250-20f6-4078-b08a-c86b30299403 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:30.686252 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8e4969-155d-43e3-b949-c4912e06273b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:30.687683 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8e4969-155d-43e3-b949-c4912e06273b None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:30.690781 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb3d250-20f6-4078-b08a-c86b30299403 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:01:30.698247 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-bcb3d250-20f6-4078-b08a-c86b30299403 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:01:30.698247 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:30.698247 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:30.698247 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:30.698247 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:30.698247 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:30.698247 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:30.698247 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:30.698247 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:30.698247 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:30.698247 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:30.698247 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:30.698247 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:01:30.698247 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:01:30.698247 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:01:30.698247 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:01:30.699360 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:01:30.699360 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:01:30.699360 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:01:30.699360 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:01:30.699360 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:30.699360 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:30.699360 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:30.699360 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:30.699360 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:30.699360 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:30.699360 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:30.699360 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:01:30.699360 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:30.699360 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:30.699360 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:30.699360 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:30.700696 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:30.700696 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:30.700696 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:30.700696 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:30.700696 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:01:30.700696 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:01:30.700696 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:01:30.700696 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:01:30.700696 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:01:30.700696 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:01:30.700696 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:01:30.700696 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:01:30.700696 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 557/1098] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 10 03:01:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 03:01:30.708841 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-0b8e4969-155d-43e3-b949-c4912e06273b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:01:30.708841 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:30.708841 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:30.708841 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:30.708841 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:30.708841 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:30.708841 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:30.708841 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:30.708841 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:30.708841 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:30.708841 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:30.708841 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:30.708841 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:01:30.708841 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:01:30.708841 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:01:30.709953 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:01:30.709953 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:30.709953 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:30.709953 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:30.709953 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:30.709953 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:30.709953 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:30.709953 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:30.709953 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:01:30.709953 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:30.709953 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:30.709953 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:30.709953 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:30.709953 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:30.709953 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:30.709953 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:30.709953 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:30.711223 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:01:30.711223 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:01:30.711223 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:01:30.711223 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:01:30.711223 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:01:30.711223 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:01:30.711223 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:01:30.711223 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:01:30.711223 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 542/1099] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 10 03:01:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:30.711849 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb3d250-20f6-4078-b08a-c86b30299403 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:30.711935 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e4969-155d-43e3-b949-c4912e06273b None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:30.799254 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb3d250-20f6-4078-b08a-c86b30299403 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:30.803497 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e4969-155d-43e3-b949-c4912e06273b None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:30.830479 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2aad49-2abb-456f-b0e1-df1dc515540c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:30.831140 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2aad49-2abb-456f-b0e1-df1dc515540c None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:30.831422 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2aad49-2abb-456f-b0e1-df1dc515540c None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:30.831695 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2aad49-2abb-456f-b0e1-df1dc515540c None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:30.832482 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2aad49-2abb-456f-b0e1-df1dc515540c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:30.832784 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2aad49-2abb-456f-b0e1-df1dc515540c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:30.834132 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2aad49-2abb-456f-b0e1-df1dc515540c None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:30.834900 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06736ba9-04ad-4012-9cfa-8abb0c7fdedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:30.835553 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06736ba9-04ad-4012-9cfa-8abb0c7fdedb None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:30.835987 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06736ba9-04ad-4012-9cfa-8abb0c7fdedb None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:30.836432 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06736ba9-04ad-4012-9cfa-8abb0c7fdedb None admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:30.837643 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06736ba9-04ad-4012-9cfa-8abb0c7fdedb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:30.838106 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06736ba9-04ad-4012-9cfa-8abb0c7fdedb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:30.840345 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06736ba9-04ad-4012-9cfa-8abb0c7fdedb None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:30.842105 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 558/1100] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 10 03:01:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:30.848243 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2aad49-2abb-456f-b0e1-df1dc515540c None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:30.858460 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 543/1101] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 10 03:01:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:01:30.864879 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06736ba9-04ad-4012-9cfa-8abb0c7fdedb None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:30.942605 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2aad49-2abb-456f-b0e1-df1dc515540c None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:30.957759 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06736ba9-04ad-4012-9cfa-8abb0c7fdedb None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:30.973828 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7641ac45-443c-4a6f-8166-cdb3b0961f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:30.974688 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641ac45-443c-4a6f-8166-cdb3b0961f47 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:30.974967 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641ac45-443c-4a6f-8166-cdb3b0961f47 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:30.975242 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641ac45-443c-4a6f-8166-cdb3b0961f47 None admin] PATH_INFO: `/v3/users/21b6badb0e5f4b818151b27b07431c01` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:30.976596 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7641ac45-443c-4a6f-8166-cdb3b0961f47 None admin] RBAC: Authorizing `identity:get_user(user_id=21b6badb0e5f4b818151b27b07431c01)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:30.978024 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7641ac45-443c-4a6f-8166-cdb3b0961f47 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:30.979641 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 559/1102] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 10 03:01:30 2022] GET /identity/v3/users/21b6badb0e5f4b818151b27b07431c01 => generated 285 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:01:30.985155 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7641ac45-443c-4a6f-8166-cdb3b0961f47 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:30.990464 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01738927-74f8-4d50-aeda-3170c2a7f3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:30.991111 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01738927-74f8-4d50-aeda-3170c2a7f3d9 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:30.991392 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01738927-74f8-4d50-aeda-3170c2a7f3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:30.991664 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01738927-74f8-4d50-aeda-3170c2a7f3d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:30.992513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01738927-74f8-4d50-aeda-3170c2a7f3d9 None admin] RBAC: Adding query filter params (role.id=6c4dad34321647f5a6822a530300110c, scope.project.id=513e6592cd83457b8ff461b0e5e1fd40, user.id=9b7ccdccba0b4f9e86817946f22dbe28) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:30.992823 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01738927-74f8-4d50-aeda-3170c2a7f3d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:30.994237 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01738927-74f8-4d50-aeda-3170c2a7f3d9 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:30.999842 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 544/1103] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 10 03:01:30 2022] GET /identity/v3/role_assignments?user.id=9b7ccdccba0b4f9e86817946f22dbe28&scope.project.id=513e6592cd83457b8ff461b0e5e1fd40&role.id=6c4dad34321647f5a6822a530300110c => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:01:31.085489 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7641ac45-443c-4a6f-8166-cdb3b0961f47 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:31.119248 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e26ab-3a1b-465d-acc3-b833cd76927b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:31.119900 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e26ab-3a1b-465d-acc3-b833cd76927b None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:31.120213 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e26ab-3a1b-465d-acc3-b833cd76927b None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:31.120486 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e26ab-3a1b-465d-acc3-b833cd76927b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:31.187659 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21e26ab-3a1b-465d-acc3-b833cd76927b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:31.189143 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21e26ab-3a1b-465d-acc3-b833cd76927b None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:31.283944 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 560/1104] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 10 03:01:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 10 03:01:31.290727 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01738927-74f8-4d50-aeda-3170c2a7f3d9 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:31.391471 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01738927-74f8-4d50-aeda-3170c2a7f3d9 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:31.425878 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c4b026-7d31-416c-a0f6-3aa312502f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:31.426746 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4b026-7d31-416c-a0f6-3aa312502f26 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:31.427028 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4b026-7d31-416c-a0f6-3aa312502f26 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:31.427741 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4b026-7d31-416c-a0f6-3aa312502f26 None admin] PATH_INFO: `/v3/projects/8c1f5cc055d24d11be07fd2765515848` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:31.428588 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c4b026-7d31-416c-a0f6-3aa312502f26 None admin] RBAC: Authorizing `identity:get_project(project_id=8c1f5cc055d24d11be07fd2765515848)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:31.430026 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c4b026-7d31-416c-a0f6-3aa312502f26 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:31.431873 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 545/1105] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 10 03:01:31 2022] GET /identity/v3/projects/8c1f5cc055d24d11be07fd2765515848 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:31.437778 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e26ab-3a1b-465d-acc3-b833cd76927b None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:31.536918 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e26ab-3a1b-465d-acc3-b833cd76927b None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:31.569214 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f5ec26-00d6-4966-bb49-f44db392f5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:31.569880 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5ec26-00d6-4966-bb49-f44db392f5b0 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:31.570166 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5ec26-00d6-4966-bb49-f44db392f5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:31.570444 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5ec26-00d6-4966-bb49-f44db392f5b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:31.571284 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f5ec26-00d6-4966-bb49-f44db392f5b0 None admin] RBAC: Adding query filter params (role.id=43105000610f402ca2486e7648018cca, scope.project.id=8c1f5cc055d24d11be07fd2765515848, user.id=21b6badb0e5f4b818151b27b07431c01) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:31.571598 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f5ec26-00d6-4966-bb49-f44db392f5b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:31.573170 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f5ec26-00d6-4966-bb49-f44db392f5b0 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:31.579325 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 561/1106] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 10 03:01:31 2022] GET /identity/v3/role_assignments?user.id=21b6badb0e5f4b818151b27b07431c01&scope.project.id=8c1f5cc055d24d11be07fd2765515848&role.id=43105000610f402ca2486e7648018cca => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:33.819096 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52300f-24d3-409b-8016-eaf3db189e02 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:33.819606 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52300f-24d3-409b-8016-eaf3db189e02 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:33.819606 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52300f-24d3-409b-8016-eaf3db189e02 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:33.820989 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 546/1107] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:01:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:33.826240 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b5f7d3-1e26-4886-990f-82f77d9b5f37 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:33.826616 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b5f7d3-1e26-4886-990f-82f77d9b5f37 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:33.826862 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b5f7d3-1e26-4886-990f-82f77d9b5f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:33.843169 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-d4b5f7d3-1e26-4886-990f-82f77d9b5f37 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:33.844395 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-d4b5f7d3-1e26-4886-990f-82f77d9b5f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:33.911159 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 562/1108] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:01:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:01:33.936139 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e52300f-24d3-409b-8016-eaf3db189e02 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:34.030764 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e52300f-24d3-409b-8016-eaf3db189e02 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:34.062781 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab547c-03fa-42a1-9c22-a5df9bec5bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:34.063559 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab547c-03fa-42a1-9c22-a5df9bec5bd5 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:34.063842 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab547c-03fa-42a1-9c22-a5df9bec5bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:34.064143 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab547c-03fa-42a1-9c22-a5df9bec5bd5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:34.065305 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbab547c-03fa-42a1-9c22-a5df9bec5bd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:34.066762 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbab547c-03fa-42a1-9c22-a5df9bec5bd5 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:34.068379 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 547/1109] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:01:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:34.074104 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b5f7d3-1e26-4886-990f-82f77d9b5f37 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:34.166321 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b5f7d3-1e26-4886-990f-82f77d9b5f37 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:34.198404 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c633d-cb83-4604-a210-e7f5ca18d16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:34.199075 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c633d-cb83-4604-a210-e7f5ca18d16b None admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:34.199359 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c633d-cb83-4604-a210-e7f5ca18d16b None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:34.199637 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c633d-cb83-4604-a210-e7f5ca18d16b None admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:34.200372 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4c633d-cb83-4604-a210-e7f5ca18d16b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:34.202197 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4c633d-cb83-4604-a210-e7f5ca18d16b None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:34.305279 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 563/1110] 10.222.0.65 () {60 vars in 1132 bytes} [Tue May 10 03:01:34 2022] POST /identity/v3/users => generated 286 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:01:36.512981 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c55b69-dbca-4200-b64e-60a3477a85ef None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:36.513511 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c55b69-dbca-4200-b64e-60a3477a85ef None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:36.513511 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c55b69-dbca-4200-b64e-60a3477a85ef None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:36.514876 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 548/1111] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:01:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:36.520381 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd964bcb-b2ff-4d69-a223-33ae67053068 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:36.520794 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd964bcb-b2ff-4d69-a223-33ae67053068 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:36.520945 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd964bcb-b2ff-4d69-a223-33ae67053068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:36.537935 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-bd964bcb-b2ff-4d69-a223-33ae67053068 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:36.539112 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-bd964bcb-b2ff-4d69-a223-33ae67053068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:36.600985 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 564/1112] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:01:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:01:36.623826 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c55b69-dbca-4200-b64e-60a3477a85ef None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:36.719105 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c55b69-dbca-4200-b64e-60a3477a85ef None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:36.751081 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517e14eb-6e80-4a40-98a0-b2879bf291ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:36.751914 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e14eb-6e80-4a40-98a0-b2879bf291ab None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:36.752221 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e14eb-6e80-4a40-98a0-b2879bf291ab None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:36.752497 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e14eb-6e80-4a40-98a0-b2879bf291ab None admin] PATH_INFO: `/v3/roles/b2cf4d51cc0b4532adcb7021d474177e` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:36.754478 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517e14eb-6e80-4a40-98a0-b2879bf291ab None admin] RBAC: Authorizing `identity:get_role(role_id=b2cf4d51cc0b4532adcb7021d474177e)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:36.755839 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517e14eb-6e80-4a40-98a0-b2879bf291ab None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:36.757205 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 549/1113] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 10 03:01:36 2022] GET /identity/v3/roles/b2cf4d51cc0b4532adcb7021d474177e => generated 223 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:36.762588 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd964bcb-b2ff-4d69-a223-33ae67053068 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:36.853206 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd964bcb-b2ff-4d69-a223-33ae67053068 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:36.884234 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed09f9-cd9b-46b2-95b8-51dd92471120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:36.885076 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed09f9-cd9b-46b2-95b8-51dd92471120 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:36.885355 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed09f9-cd9b-46b2-95b8-51dd92471120 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:36.885625 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed09f9-cd9b-46b2-95b8-51dd92471120 None admin] PATH_INFO: `/v3/users/049a1b876beb4769b65aa9f5662f1343` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:36.898450 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bed09f9-cd9b-46b2-95b8-51dd92471120 None admin] RBAC: Authorizing `identity:get_user(user_id=049a1b876beb4769b65aa9f5662f1343)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:36.899905 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bed09f9-cd9b-46b2-95b8-51dd92471120 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:36.901534 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 565/1114] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 10 03:01:36 2022] GET /identity/v3/users/049a1b876beb4769b65aa9f5662f1343 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:36.907363 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517e14eb-6e80-4a40-98a0-b2879bf291ab None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:37.000933 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517e14eb-6e80-4a40-98a0-b2879bf291ab None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:37.033671 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc97eeb-d4ea-4fb4-b577-ab9fb355c12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:37.034309 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc97eeb-d4ea-4fb4-b577-ab9fb355c12c None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:37.034620 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc97eeb-d4ea-4fb4-b577-ab9fb355c12c None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:37.034899 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc97eeb-d4ea-4fb4-b577-ab9fb355c12c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:37.097636 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc97eeb-d4ea-4fb4-b577-ab9fb355c12c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:37.099071 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc97eeb-d4ea-4fb4-b577-ab9fb355c12c None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:37.193551 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 550/1115] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 10 03:01:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 03:01:37.199447 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed09f9-cd9b-46b2-95b8-51dd92471120 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:37.292096 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed09f9-cd9b-46b2-95b8-51dd92471120 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:37.324309 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee95904e-d945-4d04-ac95-f2223d26b005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:37.325144 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95904e-d945-4d04-ac95-f2223d26b005 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:37.325425 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95904e-d945-4d04-ac95-f2223d26b005 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:37.325695 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95904e-d945-4d04-ac95-f2223d26b005 None admin] PATH_INFO: `/v3/projects/8c1f5cc055d24d11be07fd2765515848` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:37.326852 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee95904e-d945-4d04-ac95-f2223d26b005 None admin] RBAC: Authorizing `identity:get_project(project_id=8c1f5cc055d24d11be07fd2765515848)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:37.328316 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee95904e-d945-4d04-ac95-f2223d26b005 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:37.329980 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 566/1116] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 10 03:01:37 2022] GET /identity/v3/projects/8c1f5cc055d24d11be07fd2765515848 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:37.335987 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc97eeb-d4ea-4fb4-b577-ab9fb355c12c None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:37.431300 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc97eeb-d4ea-4fb4-b577-ab9fb355c12c None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:37.463174 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce0ea3b-e95b-4536-8b9b-1167424a7980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:37.463823 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce0ea3b-e95b-4536-8b9b-1167424a7980 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:37.464144 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce0ea3b-e95b-4536-8b9b-1167424a7980 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:37.464422 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce0ea3b-e95b-4536-8b9b-1167424a7980 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:37.465247 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce0ea3b-e95b-4536-8b9b-1167424a7980 None admin] RBAC: Adding query filter params (role.id=b2cf4d51cc0b4532adcb7021d474177e, scope.project.id=8c1f5cc055d24d11be07fd2765515848, user.id=049a1b876beb4769b65aa9f5662f1343) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:37.465557 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce0ea3b-e95b-4536-8b9b-1167424a7980 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:37.466983 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce0ea3b-e95b-4536-8b9b-1167424a7980 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:37.472759 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 551/1117] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 10 03:01:37 2022] GET /identity/v3/role_assignments?user.id=049a1b876beb4769b65aa9f5662f1343&scope.project.id=8c1f5cc055d24d11be07fd2765515848&role.id=b2cf4d51cc0b4532adcb7021d474177e => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:39.640115 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535897e-8dc6-452d-aa9b-1cda21d9431b None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:39.640633 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535897e-8dc6-452d-aa9b-1cda21d9431b None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:39.640722 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535897e-8dc6-452d-aa9b-1cda21d9431b None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:39.642009 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 567/1118] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:01:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:39.647873 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f457c2-d388-42f2-a9aa-036c5ac6ea22 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:39.648339 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f457c2-d388-42f2-a9aa-036c5ac6ea22 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:39.648476 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f457c2-d388-42f2-a9aa-036c5ac6ea22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:39.665534 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-00f457c2-d388-42f2-a9aa-036c5ac6ea22 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:39.666724 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-00f457c2-d388-42f2-a9aa-036c5ac6ea22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:39.729233 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 552/1119] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:01:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:01:39.751407 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1535897e-8dc6-452d-aa9b-1cda21d9431b None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:39.846351 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1535897e-8dc6-452d-aa9b-1cda21d9431b None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:39.877076 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31914937-fbb0-446a-af60-47454e869f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:39.877906 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31914937-fbb0-446a-af60-47454e869f2e None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:39.878707 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31914937-fbb0-446a-af60-47454e869f2e None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:39.878984 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31914937-fbb0-446a-af60-47454e869f2e None admin] PATH_INFO: `/v3/roles/b2cf4d51cc0b4532adcb7021d474177e` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:39.880457 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31914937-fbb0-446a-af60-47454e869f2e None admin] RBAC: Authorizing `identity:get_role(role_id=b2cf4d51cc0b4532adcb7021d474177e)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:39.881799 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31914937-fbb0-446a-af60-47454e869f2e None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:39.883133 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 568/1120] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 10 03:01:39 2022] GET /identity/v3/roles/b2cf4d51cc0b4532adcb7021d474177e => generated 223 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:39.888688 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f457c2-d388-42f2-a9aa-036c5ac6ea22 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:39.980834 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f457c2-d388-42f2-a9aa-036c5ac6ea22 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:40.012505 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a86ea74-9c88-4c68-b2b8-709577d181e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:40.013355 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86ea74-9c88-4c68-b2b8-709577d181e5 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:40.013641 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86ea74-9c88-4c68-b2b8-709577d181e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:40.013920 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86ea74-9c88-4c68-b2b8-709577d181e5 None admin] PATH_INFO: `/v3/users/049a1b876beb4769b65aa9f5662f1343` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:40.015095 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a86ea74-9c88-4c68-b2b8-709577d181e5 None admin] RBAC: Authorizing `identity:get_user(user_id=049a1b876beb4769b65aa9f5662f1343)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:40.016561 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a86ea74-9c88-4c68-b2b8-709577d181e5 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:40.018156 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 553/1121] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 10 03:01:39 2022] GET /identity/v3/users/049a1b876beb4769b65aa9f5662f1343 => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:40.024219 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31914937-fbb0-446a-af60-47454e869f2e None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:40.116753 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31914937-fbb0-446a-af60-47454e869f2e None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:40.148454 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ee099-3951-4ae8-9b45-18021031a347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:40.149291 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ee099-3951-4ae8-9b45-18021031a347 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:40.149571 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ee099-3951-4ae8-9b45-18021031a347 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:40.149840 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ee099-3951-4ae8-9b45-18021031a347 None admin] PATH_INFO: `/v3/projects/8c1f5cc055d24d11be07fd2765515848` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:40.151033 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748ee099-3951-4ae8-9b45-18021031a347 None admin] RBAC: Authorizing `identity:get_project(project_id=8c1f5cc055d24d11be07fd2765515848)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:40.152461 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748ee099-3951-4ae8-9b45-18021031a347 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:40.154115 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 569/1122] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 10 03:01:40 2022] GET /identity/v3/projects/8c1f5cc055d24d11be07fd2765515848 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:40.160087 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a86ea74-9c88-4c68-b2b8-709577d181e5 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:40.253200 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a86ea74-9c88-4c68-b2b8-709577d181e5 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:40.285510 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f16592-5f83-4413-9343-020acd4d5450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:40.286388 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f16592-5f83-4413-9343-020acd4d5450 None admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:40.286674 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f16592-5f83-4413-9343-020acd4d5450 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:40.286952 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f16592-5f83-4413-9343-020acd4d5450 None admin] PATH_INFO: `/v3/projects/8c1f5cc055d24d11be07fd2765515848/users/049a1b876beb4769b65aa9f5662f1343/roles/b2cf4d51cc0b4532adcb7021d474177e` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:40.289249 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f16592-5f83-4413-9343-020acd4d5450 None admin] RBAC: Authorizing `identity:create_grant(project_id=8c1f5cc055d24d11be07fd2765515848, user_id=049a1b876beb4769b65aa9f5662f1343, role_id=b2cf4d51cc0b4532adcb7021d474177e)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:40.290687 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f16592-5f83-4413-9343-020acd4d5450 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:40.355653 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 554/1123] 10.222.0.65 () {58 vars in 1439 bytes} [Tue May 10 03:01:40 2022] PUT /identity/v3/projects/8c1f5cc055d24d11be07fd2765515848/users/049a1b876beb4769b65aa9f5662f1343/roles/b2cf4d51cc0b4532adcb7021d474177e => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:01:42.518905 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedebf1e-0e77-47aa-8f27-c38c16c417da None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:42.519435 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedebf1e-0e77-47aa-8f27-c38c16c417da None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:42.519435 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedebf1e-0e77-47aa-8f27-c38c16c417da None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:42.521569 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 570/1124] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:01:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:42.527063 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b6382-7130-4cb9-bb69-a37c610592f2 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:42.527465 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b6382-7130-4cb9-bb69-a37c610592f2 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:42.527620 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b6382-7130-4cb9-bb69-a37c610592f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:42.544249 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-643b6382-7130-4cb9-bb69-a37c610592f2 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:42.545423 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-643b6382-7130-4cb9-bb69-a37c610592f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:42.608078 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 555/1125] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:01:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:01:42.631515 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedebf1e-0e77-47aa-8f27-c38c16c417da None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:42.726226 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedebf1e-0e77-47aa-8f27-c38c16c417da None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:42.758300 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c45a5f-a28f-44ef-8e14-26f4c49ddf14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:42.759137 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c45a5f-a28f-44ef-8e14-26f4c49ddf14 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:42.759421 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c45a5f-a28f-44ef-8e14-26f4c49ddf14 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:42.759701 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c45a5f-a28f-44ef-8e14-26f4c49ddf14 None admin] PATH_INFO: `/v3/roles/b2cf4d51cc0b4532adcb7021d474177e` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:42.761192 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c45a5f-a28f-44ef-8e14-26f4c49ddf14 None admin] RBAC: Authorizing `identity:get_role(role_id=b2cf4d51cc0b4532adcb7021d474177e)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:42.762561 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c45a5f-a28f-44ef-8e14-26f4c49ddf14 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:42.763904 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 571/1126] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 10 03:01:42 2022] GET /identity/v3/roles/b2cf4d51cc0b4532adcb7021d474177e => generated 223 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:42.769425 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b6382-7130-4cb9-bb69-a37c610592f2 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:42.861898 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b6382-7130-4cb9-bb69-a37c610592f2 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:42.894635 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb58765b-4e51-468f-97e3-5031e3cce285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:42.895478 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58765b-4e51-468f-97e3-5031e3cce285 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:42.895758 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58765b-4e51-468f-97e3-5031e3cce285 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:42.896049 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58765b-4e51-468f-97e3-5031e3cce285 None admin] PATH_INFO: `/v3/users/049a1b876beb4769b65aa9f5662f1343` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:42.897251 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb58765b-4e51-468f-97e3-5031e3cce285 None admin] RBAC: Authorizing `identity:get_user(user_id=049a1b876beb4769b65aa9f5662f1343)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:42.898670 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb58765b-4e51-468f-97e3-5031e3cce285 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:42.900295 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 556/1127] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 10 03:01:42 2022] GET /identity/v3/users/049a1b876beb4769b65aa9f5662f1343 => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:42.905724 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c45a5f-a28f-44ef-8e14-26f4c49ddf14 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:42.998891 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c45a5f-a28f-44ef-8e14-26f4c49ddf14 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:43.030170 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f27fc-301f-45a3-ad80-213a2321624d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:43.030794 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f27fc-301f-45a3-ad80-213a2321624d None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:43.031075 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f27fc-301f-45a3-ad80-213a2321624d None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:43.031350 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f27fc-301f-45a3-ad80-213a2321624d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:43.093207 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8f27fc-301f-45a3-ad80-213a2321624d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:43.094614 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8f27fc-301f-45a3-ad80-213a2321624d None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:43.184666 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 572/1128] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 10 03:01:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 03:01:43.190274 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb58765b-4e51-468f-97e3-5031e3cce285 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:43.283339 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb58765b-4e51-468f-97e3-5031e3cce285 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:43.315299 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a424000-0fd0-4cd4-8e13-6ab541adf93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:43.316206 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a424000-0fd0-4cd4-8e13-6ab541adf93c None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:43.316493 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a424000-0fd0-4cd4-8e13-6ab541adf93c None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:43.316765 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a424000-0fd0-4cd4-8e13-6ab541adf93c None admin] PATH_INFO: `/v3/projects/8c1f5cc055d24d11be07fd2765515848` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:43.317931 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a424000-0fd0-4cd4-8e13-6ab541adf93c None admin] RBAC: Authorizing `identity:get_project(project_id=8c1f5cc055d24d11be07fd2765515848)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:43.319351 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a424000-0fd0-4cd4-8e13-6ab541adf93c None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:43.321047 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 557/1129] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 10 03:01:43 2022] GET /identity/v3/projects/8c1f5cc055d24d11be07fd2765515848 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:43.327010 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f27fc-301f-45a3-ad80-213a2321624d None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:43.419244 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f27fc-301f-45a3-ad80-213a2321624d None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:43.451798 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20142cb-2f15-4fab-9b9d-575d7dd539d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:43.452469 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20142cb-2f15-4fab-9b9d-575d7dd539d6 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:43.452752 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20142cb-2f15-4fab-9b9d-575d7dd539d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:43.453357 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20142cb-2f15-4fab-9b9d-575d7dd539d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:43.453840 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20142cb-2f15-4fab-9b9d-575d7dd539d6 None admin] RBAC: Adding query filter params (role.id=b2cf4d51cc0b4532adcb7021d474177e, scope.project.id=8c1f5cc055d24d11be07fd2765515848, user.id=049a1b876beb4769b65aa9f5662f1343) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:43.454147 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20142cb-2f15-4fab-9b9d-575d7dd539d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:43.455565 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20142cb-2f15-4fab-9b9d-575d7dd539d6 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:43.462071 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 573/1130] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 10 03:01:43 2022] GET /identity/v3/role_assignments?user.id=049a1b876beb4769b65aa9f5662f1343&scope.project.id=8c1f5cc055d24d11be07fd2765515848&role.id=b2cf4d51cc0b4532adcb7021d474177e => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:01:45.663841 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806bd137-e288-4038-869a-32b99d4ab079 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:45.664402 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806bd137-e288-4038-869a-32b99d4ab079 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:45.664490 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806bd137-e288-4038-869a-32b99d4ab079 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:45.665776 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 558/1131] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:01:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:45.670879 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f04f39-bff7-4249-b45c-51848a6d4af8 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:45.671247 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f04f39-bff7-4249-b45c-51848a6d4af8 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:45.671434 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f04f39-bff7-4249-b45c-51848a6d4af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:45.687987 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-97f04f39-bff7-4249-b45c-51848a6d4af8 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:45.689176 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-97f04f39-bff7-4249-b45c-51848a6d4af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:45.755116 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 574/1132] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:01:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:01:45.777697 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806bd137-e288-4038-869a-32b99d4ab079 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:45.879896 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806bd137-e288-4038-869a-32b99d4ab079 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:45.911954 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3f26cf-c3c1-4030-af92-9c872f035a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:45.912766 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f26cf-c3c1-4030-af92-9c872f035a79 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:45.913050 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f26cf-c3c1-4030-af92-9c872f035a79 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:45.913324 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f26cf-c3c1-4030-af92-9c872f035a79 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:45.914486 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3f26cf-c3c1-4030-af92-9c872f035a79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:45.915908 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3f26cf-c3c1-4030-af92-9c872f035a79 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:45.917538 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 559/1133] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:01:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:45.923320 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f04f39-bff7-4249-b45c-51848a6d4af8 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:46.015468 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f04f39-bff7-4249-b45c-51848a6d4af8 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:46.048342 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b627e69f-096c-4bd4-b88c-14b3ad57e5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:46.048987 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627e69f-096c-4bd4-b88c-14b3ad57e5e9 None admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:46.049272 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627e69f-096c-4bd4-b88c-14b3ad57e5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:46.049548 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627e69f-096c-4bd4-b88c-14b3ad57e5e9 None admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:46.050334 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b627e69f-096c-4bd4-b88c-14b3ad57e5e9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:46.051747 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b627e69f-096c-4bd4-b88c-14b3ad57e5e9 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:46.139219 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 575/1134] 10.222.0.65 () {60 vars in 1141 bytes} [Tue May 10 03:01:45 2022] POST /identity/v3/projects => generated 311 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:01:48.365807 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1693ddba-8df1-4669-8c01-3978ac94ea43 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:48.366337 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1693ddba-8df1-4669-8c01-3978ac94ea43 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:48.366337 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1693ddba-8df1-4669-8c01-3978ac94ea43 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:48.367702 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 560/1135] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:01:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:48.372837 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4337c5d-a41b-4119-a77e-3a154ca79ed8 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:48.373227 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4337c5d-a41b-4119-a77e-3a154ca79ed8 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:48.373396 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4337c5d-a41b-4119-a77e-3a154ca79ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:48.390762 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-f4337c5d-a41b-4119-a77e-3a154ca79ed8 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:48.391938 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-f4337c5d-a41b-4119-a77e-3a154ca79ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:48.455449 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 576/1136] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:01:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:01:48.479493 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1693ddba-8df1-4669-8c01-3978ac94ea43 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:48.574947 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1693ddba-8df1-4669-8c01-3978ac94ea43 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:48.607224 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3932ca87-f521-4c00-988e-4d2eb7911986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:48.608026 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932ca87-f521-4c00-988e-4d2eb7911986 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:48.608311 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932ca87-f521-4c00-988e-4d2eb7911986 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:48.608586 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932ca87-f521-4c00-988e-4d2eb7911986 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:48.609749 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3932ca87-f521-4c00-988e-4d2eb7911986 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:48.611178 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3932ca87-f521-4c00-988e-4d2eb7911986 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:48.613363 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 561/1137] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:01:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:48.619080 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4337c5d-a41b-4119-a77e-3a154ca79ed8 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:48.710692 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4337c5d-a41b-4119-a77e-3a154ca79ed8 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:48.742917 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c4c101-915f-4e4e-b815-3a23abec1cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:48.743572 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c4c101-915f-4e4e-b815-3a23abec1cbf None admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:48.743861 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c4c101-915f-4e4e-b815-3a23abec1cbf None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:48.744169 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c4c101-915f-4e4e-b815-3a23abec1cbf None admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:48.744871 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c4c101-915f-4e4e-b815-3a23abec1cbf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:48.746272 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c4c101-915f-4e4e-b815-3a23abec1cbf None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:48.840943 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 577/1138] 10.222.0.65 () {60 vars in 1132 bytes} [Tue May 10 03:01:48 2022] POST /identity/v3/users => generated 286 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:01:51.083767 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0403ec-b10d-45b4-adf1-18bbdb86b4ff None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:51.084326 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0403ec-b10d-45b4-adf1-18bbdb86b4ff None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:51.084417 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0403ec-b10d-45b4-adf1-18bbdb86b4ff None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:51.085705 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 562/1139] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:01:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:51.090888 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828df55f-ec48-47c2-9c3f-92badfb07502 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:51.091288 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828df55f-ec48-47c2-9c3f-92badfb07502 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:51.091446 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828df55f-ec48-47c2-9c3f-92badfb07502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:51.107886 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-828df55f-ec48-47c2-9c3f-92badfb07502 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:51.109074 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-828df55f-ec48-47c2-9c3f-92badfb07502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:51.170483 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 578/1140] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:01:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:01:51.193083 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0403ec-b10d-45b4-adf1-18bbdb86b4ff None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:51.288652 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0403ec-b10d-45b4-adf1-18bbdb86b4ff None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:51.319942 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7857f7d-da1c-4e57-a2ba-efd800627c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:51.320738 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7857f7d-da1c-4e57-a2ba-efd800627c7f None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:51.321018 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7857f7d-da1c-4e57-a2ba-efd800627c7f None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:51.321287 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7857f7d-da1c-4e57-a2ba-efd800627c7f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:51.331403 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7857f7d-da1c-4e57-a2ba-efd800627c7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:01:51.338973 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-e7857f7d-da1c-4e57-a2ba-efd800627c7f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:01:51.338973 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:51.338973 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:51.338973 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:51.338973 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:51.338973 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:51.338973 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:51.338973 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:51.338973 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:51.338973 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:51.338973 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:51.338973 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:51.338973 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:01:51.338973 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:01:51.338973 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:01:51.338973 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:01:51.340111 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:01:51.340111 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:01:51.340111 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:01:51.340111 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:01:51.340111 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:51.340111 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:51.340111 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:51.340111 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:51.340111 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:51.340111 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:51.340111 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:51.340111 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:01:51.340111 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:51.340111 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:51.340111 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:51.340111 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:51.341139 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:51.341139 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:51.341139 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:51.341139 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:51.341139 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:01:51.341139 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:01:51.341139 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:01:51.341139 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:01:51.341139 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:01:51.341139 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:01:51.341139 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:01:51.341139 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:01:51.341139 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 563/1141] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 10 03:01:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:51.345943 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828df55f-ec48-47c2-9c3f-92badfb07502 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:51.435715 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828df55f-ec48-47c2-9c3f-92badfb07502 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:51.467564 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fe9c12-ea1e-4cc9-892c-e91095062bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:51.468256 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe9c12-ea1e-4cc9-892c-e91095062bb4 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:51.468545 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe9c12-ea1e-4cc9-892c-e91095062bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:51.468823 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe9c12-ea1e-4cc9-892c-e91095062bb4 None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:51.469571 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fe9c12-ea1e-4cc9-892c-e91095062bb4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:51.469877 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fe9c12-ea1e-4cc9-892c-e91095062bb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:51.471228 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fe9c12-ea1e-4cc9-892c-e91095062bb4 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:51.479602 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 579/1142] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 10 03:01:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:01:51.485210 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7857f7d-da1c-4e57-a2ba-efd800627c7f None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:51.579563 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7857f7d-da1c-4e57-a2ba-efd800627c7f None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:51.611324 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf8547d-371a-40b7-84d3-3d568f0e00d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:51.612186 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8547d-371a-40b7-84d3-3d568f0e00d2 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:51.612473 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8547d-371a-40b7-84d3-3d568f0e00d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:51.612750 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8547d-371a-40b7-84d3-3d568f0e00d2 None admin] PATH_INFO: `/v3/users/1e579a21829b4d92b4af9d930fdfea00` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:51.625038 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf8547d-371a-40b7-84d3-3d568f0e00d2 None admin] RBAC: Authorizing `identity:get_user(user_id=1e579a21829b4d92b4af9d930fdfea00)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:51.626468 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf8547d-371a-40b7-84d3-3d568f0e00d2 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:51.628499 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 564/1143] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 10 03:01:51 2022] GET /identity/v3/users/1e579a21829b4d92b4af9d930fdfea00 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:51.634093 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fe9c12-ea1e-4cc9-892c-e91095062bb4 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:51.731567 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fe9c12-ea1e-4cc9-892c-e91095062bb4 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:51.765897 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1733085a-9227-40dd-b4ef-37fcaff65ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:51.766535 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1733085a-9227-40dd-b4ef-37fcaff65ba2 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:51.766820 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1733085a-9227-40dd-b4ef-37fcaff65ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:51.767098 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1733085a-9227-40dd-b4ef-37fcaff65ba2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:51.829527 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1733085a-9227-40dd-b4ef-37fcaff65ba2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:51.831563 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1733085a-9227-40dd-b4ef-37fcaff65ba2 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:51.922640 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 580/1144] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 10 03:01:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 10 03:01:51.928660 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf8547d-371a-40b7-84d3-3d568f0e00d2 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:52.023518 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf8547d-371a-40b7-84d3-3d568f0e00d2 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:52.055760 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692850df-d34a-43e8-9f78-0a78832c7ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:52.056625 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692850df-d34a-43e8-9f78-0a78832c7ff0 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:52.056909 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692850df-d34a-43e8-9f78-0a78832c7ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:52.057184 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692850df-d34a-43e8-9f78-0a78832c7ff0 None admin] PATH_INFO: `/v3/projects/327c34b4f0e346eea4bc065267b831ce` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:52.058350 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692850df-d34a-43e8-9f78-0a78832c7ff0 None admin] RBAC: Authorizing `identity:get_project(project_id=327c34b4f0e346eea4bc065267b831ce)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:52.059763 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692850df-d34a-43e8-9f78-0a78832c7ff0 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:52.061461 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 565/1145] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 10 03:01:51 2022] GET /identity/v3/projects/327c34b4f0e346eea4bc065267b831ce => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:52.067860 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1733085a-9227-40dd-b4ef-37fcaff65ba2 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:52.159809 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1733085a-9227-40dd-b4ef-37fcaff65ba2 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:52.192214 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b3ffe4-971c-4c55-afd5-0c99383d500d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:52.192793 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3ffe4-971c-4c55-afd5-0c99383d500d None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:52.193078 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3ffe4-971c-4c55-afd5-0c99383d500d None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:52.193357 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3ffe4-971c-4c55-afd5-0c99383d500d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:52.194185 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b3ffe4-971c-4c55-afd5-0c99383d500d None admin] RBAC: Adding query filter params (role.id=43105000610f402ca2486e7648018cca, scope.project.id=327c34b4f0e346eea4bc065267b831ce, user.id=1e579a21829b4d92b4af9d930fdfea00) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:52.194498 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b3ffe4-971c-4c55-afd5-0c99383d500d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:52.195885 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b3ffe4-971c-4c55-afd5-0c99383d500d None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:52.201031 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 581/1146] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 10 03:01:52 2022] GET /identity/v3/role_assignments?user.id=1e579a21829b4d92b4af9d930fdfea00&scope.project.id=327c34b4f0e346eea4bc065267b831ce&role.id=43105000610f402ca2486e7648018cca => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:01:54.366019 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86983d2-5848-4130-877c-2631e24b110b None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:54.366545 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86983d2-5848-4130-877c-2631e24b110b None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:54.366545 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86983d2-5848-4130-877c-2631e24b110b None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:54.367912 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 566/1147] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:01:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:54.373136 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b29e69-ab86-4a03-90e3-86b37f903061 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:54.373648 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b29e69-ab86-4a03-90e3-86b37f903061 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:54.373749 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b29e69-ab86-4a03-90e3-86b37f903061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:54.389794 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-32b29e69-ab86-4a03-90e3-86b37f903061 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:54.390966 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-32b29e69-ab86-4a03-90e3-86b37f903061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:54.455066 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 582/1148] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:01:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 03:01:54.476664 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86983d2-5848-4130-877c-2631e24b110b None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:54.572259 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86983d2-5848-4130-877c-2631e24b110b None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:54.603159 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b0e9a2-0169-4d10-947d-cbcaaf317558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:54.603956 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0e9a2-0169-4d10-947d-cbcaaf317558 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:54.604264 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0e9a2-0169-4d10-947d-cbcaaf317558 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:54.604539 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0e9a2-0169-4d10-947d-cbcaaf317558 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:54.614577 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b0e9a2-0169-4d10-947d-cbcaaf317558 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:01:54.622090 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-88b0e9a2-0169-4d10-947d-cbcaaf317558 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:01:54.622090 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:54.622090 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:54.622090 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:54.622090 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:54.622090 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:54.622090 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:54.622090 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:54.622090 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:54.622090 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:54.622090 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:54.622090 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:54.622090 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:01:54.622090 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:01:54.622090 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:01:54.622090 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:01:54.623168 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:01:54.623168 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:01:54.623168 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:01:54.623168 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:01:54.623168 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:54.623168 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:54.623168 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:54.623168 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:54.623168 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:54.623168 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:54.623168 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:54.623168 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:01:54.623168 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:54.623168 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:54.623168 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:54.623168 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:54.624223 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:54.624223 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:54.624223 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:54.624223 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:54.624223 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:01:54.624223 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:01:54.624223 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:01:54.624223 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:01:54.624223 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:01:54.624223 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:01:54.624223 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:01:54.624223 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:01:54.624223 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 567/1149] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 10 03:01:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:54.629576 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b29e69-ab86-4a03-90e3-86b37f903061 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:54.722782 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b29e69-ab86-4a03-90e3-86b37f903061 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:54.754210 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dbe276-2368-4798-8869-d2f83538d19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:54.754862 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dbe276-2368-4798-8869-d2f83538d19b None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:54.755144 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dbe276-2368-4798-8869-d2f83538d19b None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:54.755418 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dbe276-2368-4798-8869-d2f83538d19b None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:54.756185 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dbe276-2368-4798-8869-d2f83538d19b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:54.756489 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dbe276-2368-4798-8869-d2f83538d19b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:54.757839 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dbe276-2368-4798-8869-d2f83538d19b None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:54.765401 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 583/1150] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 10 03:01:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:54.771295 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b0e9a2-0169-4d10-947d-cbcaaf317558 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:54.865081 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b0e9a2-0169-4d10-947d-cbcaaf317558 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:54.895588 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb7ae4b-5952-4c24-a462-c4ba4d745b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:54.896400 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb7ae4b-5952-4c24-a462-c4ba4d745b32 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:54.896684 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb7ae4b-5952-4c24-a462-c4ba4d745b32 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:54.896958 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb7ae4b-5952-4c24-a462-c4ba4d745b32 None admin] PATH_INFO: `/v3/users/1e579a21829b4d92b4af9d930fdfea00` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:54.898149 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb7ae4b-5952-4c24-a462-c4ba4d745b32 None admin] RBAC: Authorizing `identity:get_user(user_id=1e579a21829b4d92b4af9d930fdfea00)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:54.899570 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb7ae4b-5952-4c24-a462-c4ba4d745b32 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:54.901186 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 568/1151] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 10 03:01:54 2022] GET /identity/v3/users/1e579a21829b4d92b4af9d930fdfea00 => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:54.906590 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dbe276-2368-4798-8869-d2f83538d19b None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:55.000076 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dbe276-2368-4798-8869-d2f83538d19b None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:55.031138 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4956361-079b-4a5d-8fe3-d8a325f14b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:55.032256 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4956361-079b-4a5d-8fe3-d8a325f14b08 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:55.032542 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4956361-079b-4a5d-8fe3-d8a325f14b08 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:55.032815 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4956361-079b-4a5d-8fe3-d8a325f14b08 None admin] PATH_INFO: `/v3/projects/327c34b4f0e346eea4bc065267b831ce` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:55.034711 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4956361-079b-4a5d-8fe3-d8a325f14b08 None admin] RBAC: Authorizing `identity:get_project(project_id=327c34b4f0e346eea4bc065267b831ce)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:55.036152 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4956361-079b-4a5d-8fe3-d8a325f14b08 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:55.037813 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 584/1152] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 10 03:01:54 2022] GET /identity/v3/projects/327c34b4f0e346eea4bc065267b831ce => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:55.043352 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb7ae4b-5952-4c24-a462-c4ba4d745b32 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:55.134835 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb7ae4b-5952-4c24-a462-c4ba4d745b32 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:55.166833 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49dce0c-0276-423b-85ad-1cbc7ca89f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:55.167643 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49dce0c-0276-423b-85ad-1cbc7ca89f9c None admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:55.167924 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49dce0c-0276-423b-85ad-1cbc7ca89f9c None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:55.168226 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49dce0c-0276-423b-85ad-1cbc7ca89f9c None admin] PATH_INFO: `/v3/projects/327c34b4f0e346eea4bc065267b831ce/users/1e579a21829b4d92b4af9d930fdfea00/roles/43105000610f402ca2486e7648018cca` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:55.170162 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49dce0c-0276-423b-85ad-1cbc7ca89f9c None admin] RBAC: Authorizing `identity:create_grant(project_id=327c34b4f0e346eea4bc065267b831ce, user_id=1e579a21829b4d92b4af9d930fdfea00, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:55.171580 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49dce0c-0276-423b-85ad-1cbc7ca89f9c None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:55.287590 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 569/1153] 10.222.0.65 () {58 vars in 1439 bytes} [Tue May 10 03:01:55 2022] PUT /identity/v3/projects/327c34b4f0e346eea4bc065267b831ce/users/1e579a21829b4d92b4af9d930fdfea00/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:01:57.519092 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa97689-330d-450a-ac8b-793eaa0e9988 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:57.519614 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa97689-330d-450a-ac8b-793eaa0e9988 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:57.519700 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa97689-330d-450a-ac8b-793eaa0e9988 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:57.521041 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 585/1154] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:01:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:01:57.526157 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f76b6-beaa-4236-9393-12c23edeb4ce None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:57.526555 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f76b6-beaa-4236-9393-12c23edeb4ce None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:57.526712 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f76b6-beaa-4236-9393-12c23edeb4ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:57.543456 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-cb8f76b6-beaa-4236-9393-12c23edeb4ce None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:01:57.544686 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-cb8f76b6-beaa-4236-9393-12c23edeb4ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:01:57.607936 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 570/1155] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:01:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 03:01:57.631581 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa97689-330d-450a-ac8b-793eaa0e9988 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:57.727173 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa97689-330d-450a-ac8b-793eaa0e9988 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:57.760077 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56bf25a-f4de-43d2-a141-92e6080654d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:57.760845 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56bf25a-f4de-43d2-a141-92e6080654d0 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:57.761125 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56bf25a-f4de-43d2-a141-92e6080654d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:57.761396 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56bf25a-f4de-43d2-a141-92e6080654d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:57.771825 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56bf25a-f4de-43d2-a141-92e6080654d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:01:57.779325 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-e56bf25a-f4de-43d2-a141-92e6080654d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:01:57.779325 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:01:57.779325 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:01:57.779325 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:01:57.779325 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:01:57.779325 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:01:57.779325 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:01:57.779325 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:01:57.779325 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:01:57.779325 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:01:57.779325 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:01:57.779325 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:01:57.779325 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:01:57.779325 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:01:57.779325 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:01:57.779325 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:01:57.780682 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:01:57.780682 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:01:57.780682 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:01:57.780682 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:01:57.780682 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:01:57.780682 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:01:57.780682 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:01:57.780682 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:01:57.780682 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:01:57.780682 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:01:57.780682 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:01:57.780682 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:01:57.780682 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:01:57.780682 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:01:57.780682 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:01:57.780682 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:01:57.782582 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:01:57.782582 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:01:57.782582 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:01:57.782582 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:01:57.782582 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:01:57.782582 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:01:57.782582 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:01:57.782582 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:01:57.782582 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:01:57.782582 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:01:57.782582 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:01:57.782582 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:01:57.782582 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 586/1156] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 10 03:01:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:01:57.787610 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f76b6-beaa-4236-9393-12c23edeb4ce None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:57.882443 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f76b6-beaa-4236-9393-12c23edeb4ce None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:57.914553 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d860c8d1-9241-4964-9b80-c0ec9d0c0cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:57.915215 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d860c8d1-9241-4964-9b80-c0ec9d0c0cad None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:57.915501 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d860c8d1-9241-4964-9b80-c0ec9d0c0cad None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:57.915778 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d860c8d1-9241-4964-9b80-c0ec9d0c0cad None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:57.916551 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d860c8d1-9241-4964-9b80-c0ec9d0c0cad None admin] RBAC: Adding query filter params (name=admin) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:57.916860 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d860c8d1-9241-4964-9b80-c0ec9d0c0cad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:57.918221 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d860c8d1-9241-4964-9b80-c0ec9d0c0cad None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:57.926495 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 571/1157] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 10 03:01:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:01:57.932226 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56bf25a-f4de-43d2-a141-92e6080654d0 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:58.024795 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56bf25a-f4de-43d2-a141-92e6080654d0 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:58.055670 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8de689-918b-46b6-91cb-7390a7b566b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:58.056538 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8de689-918b-46b6-91cb-7390a7b566b0 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:58.056816 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8de689-918b-46b6-91cb-7390a7b566b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:58.057086 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8de689-918b-46b6-91cb-7390a7b566b0 None admin] PATH_INFO: `/v3/users/1e579a21829b4d92b4af9d930fdfea00` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:58.058242 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8de689-918b-46b6-91cb-7390a7b566b0 None admin] RBAC: Authorizing `identity:get_user(user_id=1e579a21829b4d92b4af9d930fdfea00)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:58.059647 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8de689-918b-46b6-91cb-7390a7b566b0 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:58.061253 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 587/1158] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 10 03:01:57 2022] GET /identity/v3/users/1e579a21829b4d92b4af9d930fdfea00 => generated 286 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:01:58.066819 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d860c8d1-9241-4964-9b80-c0ec9d0c0cad None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:58.162252 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d860c8d1-9241-4964-9b80-c0ec9d0c0cad None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:58.193042 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be561f7-89e9-47ee-89e1-61829bd451ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:58.193674 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be561f7-89e9-47ee-89e1-61829bd451ef None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:58.193957 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be561f7-89e9-47ee-89e1-61829bd451ef None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:58.194235 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be561f7-89e9-47ee-89e1-61829bd451ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:58.257112 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be561f7-89e9-47ee-89e1-61829bd451ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:58.258542 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be561f7-89e9-47ee-89e1-61829bd451ef None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:58.351130 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 572/1159] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 10 03:01:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 10 03:01:58.356856 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8de689-918b-46b6-91cb-7390a7b566b0 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:58.448840 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8de689-918b-46b6-91cb-7390a7b566b0 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:58.480399 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83952276-74a0-4c28-8c1c-4b5a79cc37f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:58.481242 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83952276-74a0-4c28-8c1c-4b5a79cc37f7 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:58.481521 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83952276-74a0-4c28-8c1c-4b5a79cc37f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:58.481792 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83952276-74a0-4c28-8c1c-4b5a79cc37f7 None admin] PATH_INFO: `/v3/projects/327c34b4f0e346eea4bc065267b831ce` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:58.482944 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83952276-74a0-4c28-8c1c-4b5a79cc37f7 None admin] RBAC: Authorizing `identity:get_project(project_id=327c34b4f0e346eea4bc065267b831ce)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:58.484367 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83952276-74a0-4c28-8c1c-4b5a79cc37f7 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:58.486034 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 588/1160] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 10 03:01:58 2022] GET /identity/v3/projects/327c34b4f0e346eea4bc065267b831ce => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:01:58.491988 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be561f7-89e9-47ee-89e1-61829bd451ef None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:01:58.586002 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be561f7-89e9-47ee-89e1-61829bd451ef None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:01:58.617907 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a9ba9-b5db-45cd-951e-383de5f6798d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:01:58.618494 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a9ba9-b5db-45cd-951e-383de5f6798d None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:01:58.618778 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a9ba9-b5db-45cd-951e-383de5f6798d None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:01:58.619058 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a9ba9-b5db-45cd-951e-383de5f6798d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:01:58.619884 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a9ba9-b5db-45cd-951e-383de5f6798d None admin] RBAC: Adding query filter params (role.id=43105000610f402ca2486e7648018cca, scope.project.id=327c34b4f0e346eea4bc065267b831ce, user.id=1e579a21829b4d92b4af9d930fdfea00) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:01:58.620228 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a9ba9-b5db-45cd-951e-383de5f6798d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:01:58.621746 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a9ba9-b5db-45cd-951e-383de5f6798d None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:01:58.627288 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 573/1161] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 10 03:01:58 2022] GET /identity/v3/role_assignments?user.id=1e579a21829b4d92b4af9d930fdfea00&scope.project.id=327c34b4f0e346eea4bc065267b831ce&role.id=43105000610f402ca2486e7648018cca => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:02:00.818861 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe9b88-a02e-4321-9693-d8985ef774c0 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:00.819415 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe9b88-a02e-4321-9693-d8985ef774c0 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:00.819415 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe9b88-a02e-4321-9693-d8985ef774c0 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:00.820702 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 589/1162] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:02:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:02:00.825792 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294ec4f-e122-43b3-8eff-5c98a9594710 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:00.826180 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294ec4f-e122-43b3-8eff-5c98a9594710 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:00.826349 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294ec4f-e122-43b3-8eff-5c98a9594710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:00.843092 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-9294ec4f-e122-43b3-8eff-5c98a9594710 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:02:00.844301 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-9294ec4f-e122-43b3-8eff-5c98a9594710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:02:00.906427 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 574/1163] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:02:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:02:00.929323 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fe9b88-a02e-4321-9693-d8985ef774c0 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:01.024394 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fe9b88-a02e-4321-9693-d8985ef774c0 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:01.056219 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34886344-482e-4c09-83e8-180e14119628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:01.056853 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34886344-482e-4c09-83e8-180e14119628 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:01.057138 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34886344-482e-4c09-83e8-180e14119628 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:01.057418 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34886344-482e-4c09-83e8-180e14119628 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:01.119370 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34886344-482e-4c09-83e8-180e14119628 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:01.120759 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34886344-482e-4c09-83e8-180e14119628 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:01.217483 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 590/1164] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 10 03:02:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 03:02:01.223455 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9294ec4f-e122-43b3-8eff-5c98a9594710 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:01.316532 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9294ec4f-e122-43b3-8eff-5c98a9594710 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:01.347588 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9efd6a6-723e-41fb-b59d-4a9ed7adbcfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:01.348401 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9efd6a6-723e-41fb-b59d-4a9ed7adbcfe None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:01.348683 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9efd6a6-723e-41fb-b59d-4a9ed7adbcfe None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:01.348957 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9efd6a6-723e-41fb-b59d-4a9ed7adbcfe None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:01.355300 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9efd6a6-723e-41fb-b59d-4a9ed7adbcfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:01.356749 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9efd6a6-723e-41fb-b59d-4a9ed7adbcfe None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:01.370959 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-e9efd6a6-723e-41fb-b59d-4a9ed7adbcfe None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 10 03:02:01.370959 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:02:01.370959 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 10 03:02:01.370959 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 10 03:02:01.370959 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:02:01.370959 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:02:01.370959 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:02:01.370959 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:02:01.370959 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 10 03:02:01.370959 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:02:01.370959 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 03:02:01.370959 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:02:01.370959 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:02:01.370959 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:02:01.370959 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:02:01.370959 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:02:01.370959 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:02:01.372266 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:02:01.372266 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:02:01.372266 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:02:01.372266 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:02:01.372266 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:02:01.372266 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:02:01.372266 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:02:01.372266 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:02:01.372266 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:02:01.372266 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:02:01.372266 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:02:01.372266 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:02:01.372266 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:02:01.372266 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:02:01.372266 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:02:01.372266 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:02:01.373516 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:02:01.373516 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:02:01.373516 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:02:01.373516 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:02:01.373516 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:02:01.373516 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:02:01.373516 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:02:01.373516 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:02:01.373516 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:02:01.373516 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:02:01.373516 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 10 03:02:01.373516 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:02:01.373516 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 10 03:02:01.373516 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:02:01.373516 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 575/1165] 10.222.0.65 () {56 vars in 1117 bytes} [Tue May 10 03:02:01 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:02:01.378496 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34886344-482e-4c09-83e8-180e14119628 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:01.471314 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34886344-482e-4c09-83e8-180e14119628 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:01.503938 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb667d-18b1-4b4b-be2f-2542948a6882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:01.504621 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb667d-18b1-4b4b-be2f-2542948a6882 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:01.504906 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb667d-18b1-4b4b-be2f-2542948a6882 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:01.505181 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb667d-18b1-4b4b-be2f-2542948a6882 None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:01.505897 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fb667d-18b1-4b4b-be2f-2542948a6882 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:02:01.506202 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fb667d-18b1-4b4b-be2f-2542948a6882 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:01.507565 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fb667d-18b1-4b4b-be2f-2542948a6882 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:01.514399 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 591/1166] 10.222.0.65 () {56 vars in 1115 bytes} [Tue May 10 03:02:01 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:02:03.720596 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae20bf-34d4-4343-8b8f-a461b9fcfae4 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:03.721110 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae20bf-34d4-4343-8b8f-a461b9fcfae4 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:03.721110 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae20bf-34d4-4343-8b8f-a461b9fcfae4 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:03.722950 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 576/1167] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:02:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:02:03.728130 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77b7c8-20b6-4004-8731-81b6daa3c684 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:03.728513 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77b7c8-20b6-4004-8731-81b6daa3c684 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:03.728685 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77b7c8-20b6-4004-8731-81b6daa3c684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:03.745911 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-ee77b7c8-20b6-4004-8731-81b6daa3c684 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:02:03.747076 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-ee77b7c8-20b6-4004-8731-81b6daa3c684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:02:03.819217 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 592/1168] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:02:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:02:03.841385 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ae20bf-34d4-4343-8b8f-a461b9fcfae4 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:03.937462 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ae20bf-34d4-4343-8b8f-a461b9fcfae4 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:03.967624 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ce14f4-8446-46f6-9da7-81d4c76d40d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:03.968287 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce14f4-8446-46f6-9da7-81d4c76d40d8 None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:03.968573 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce14f4-8446-46f6-9da7-81d4c76d40d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:03.968842 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce14f4-8446-46f6-9da7-81d4c76d40d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:03.969560 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ce14f4-8446-46f6-9da7-81d4c76d40d8 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:03.970948 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ce14f4-8446-46f6-9da7-81d4c76d40d8 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:04.030649 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 577/1169] 10.222.0.65 () {60 vars in 1138 bytes} [Tue May 10 03:02:03 2022] POST /identity/v3/domains => generated 267 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:02:06.247282 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf3e16-0220-4f7c-9c4a-0133d05e4f84 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:06.247833 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf3e16-0220-4f7c-9c4a-0133d05e4f84 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:06.247833 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf3e16-0220-4f7c-9c4a-0133d05e4f84 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:06.249295 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 593/1170] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:02:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:02:06.255048 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb5833-bc0c-4cde-a34f-727b1fe7b746 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:06.255439 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb5833-bc0c-4cde-a34f-727b1fe7b746 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:06.255604 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb5833-bc0c-4cde-a34f-727b1fe7b746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:06.272492 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-9fdb5833-bc0c-4cde-a34f-727b1fe7b746 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:02:06.273666 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-9fdb5833-bc0c-4cde-a34f-727b1fe7b746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:02:06.335708 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 578/1171] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:02:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:02:06.358679 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf3e16-0220-4f7c-9c4a-0133d05e4f84 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:06.453759 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf3e16-0220-4f7c-9c4a-0133d05e4f84 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:06.485196 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d51215-73fe-44c4-8406-c0856783ea2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:06.486045 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d51215-73fe-44c4-8406-c0856783ea2c None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:06.486328 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d51215-73fe-44c4-8406-c0856783ea2c None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:06.486604 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d51215-73fe-44c4-8406-c0856783ea2c None admin] PATH_INFO: `/v3/domains/ec13ae05523d436db7ace082a78fd346` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:06.496984 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d51215-73fe-44c4-8406-c0856783ea2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=ec13ae05523d436db7ace082a78fd346)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:06.498473 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d51215-73fe-44c4-8406-c0856783ea2c None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:06.500055 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 594/1172] 10.222.0.65 () {56 vars in 1183 bytes} [Tue May 10 03:02:06 2022] GET /identity/v3/domains/ec13ae05523d436db7ace082a78fd346 => generated 267 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:02:06.506340 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb5833-bc0c-4cde-a34f-727b1fe7b746 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:06.598221 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb5833-bc0c-4cde-a34f-727b1fe7b746 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:06.630239 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d96c297-6d62-46e5-9bec-3b57275252df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:06.630884 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96c297-6d62-46e5-9bec-3b57275252df None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:06.631167 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96c297-6d62-46e5-9bec-3b57275252df None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:06.631441 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96c297-6d62-46e5-9bec-3b57275252df None admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:06.632171 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d96c297-6d62-46e5-9bec-3b57275252df None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:06.633592 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d96c297-6d62-46e5-9bec-3b57275252df None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:06.732809 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 579/1173] 10.222.0.65 () {60 vars in 1141 bytes} [Tue May 10 03:02:06 2022] POST /identity/v3/projects => generated 361 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:02:08.963185 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05489731-49c2-4aee-804d-20ea8c1b0760 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:08.963713 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05489731-49c2-4aee-804d-20ea8c1b0760 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:08.963713 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05489731-49c2-4aee-804d-20ea8c1b0760 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:08.965147 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 595/1174] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:02:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:02:08.970734 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af56150-d9d3-40ea-b1e3-09c45de93708 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:08.971668 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af56150-d9d3-40ea-b1e3-09c45de93708 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:08.971803 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af56150-d9d3-40ea-b1e3-09c45de93708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:08.988749 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-1af56150-d9d3-40ea-b1e3-09c45de93708 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:02:08.989935 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-1af56150-d9d3-40ea-b1e3-09c45de93708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:02:09.054017 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 580/1175] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:02:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:02:09.078885 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05489731-49c2-4aee-804d-20ea8c1b0760 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:09.173919 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05489731-49c2-4aee-804d-20ea8c1b0760 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:09.206010 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3246e77d-fa49-4d95-b450-97beeef2c918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:09.206853 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3246e77d-fa49-4d95-b450-97beeef2c918 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:09.207137 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3246e77d-fa49-4d95-b450-97beeef2c918 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:09.207409 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3246e77d-fa49-4d95-b450-97beeef2c918 None admin] PATH_INFO: `/v3/domains/ec13ae05523d436db7ace082a78fd346` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:09.208604 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3246e77d-fa49-4d95-b450-97beeef2c918 None admin] RBAC: Authorizing `identity:get_domain(domain_id=ec13ae05523d436db7ace082a78fd346)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:09.210014 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3246e77d-fa49-4d95-b450-97beeef2c918 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:09.211602 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 596/1176] 10.222.0.65 () {56 vars in 1183 bytes} [Tue May 10 03:02:09 2022] GET /identity/v3/domains/ec13ae05523d436db7ace082a78fd346 => generated 267 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:02:09.217460 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af56150-d9d3-40ea-b1e3-09c45de93708 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:09.312429 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af56150-d9d3-40ea-b1e3-09c45de93708 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:09.344314 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c861a-2137-47e4-9be7-510ec0c930fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:09.344971 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c861a-2137-47e4-9be7-510ec0c930fa None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:09.345258 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c861a-2137-47e4-9be7-510ec0c930fa None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:09.345536 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c861a-2137-47e4-9be7-510ec0c930fa None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:09.346264 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076c861a-2137-47e4-9be7-510ec0c930fa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:09.347691 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076c861a-2137-47e4-9be7-510ec0c930fa None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:09.423551 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 581/1177] 10.222.0.65 () {60 vars in 1132 bytes} [Tue May 10 03:02:09 2022] POST /identity/v3/users => generated 311 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:02:11.640058 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648ba94-3206-4cc1-a6ca-179982d74cb7 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:11.640576 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648ba94-3206-4cc1-a6ca-179982d74cb7 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:11.640668 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648ba94-3206-4cc1-a6ca-179982d74cb7 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:11.641948 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 597/1178] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:02:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:02:11.647251 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea894ec0-666b-4bfa-b856-39f7c661579a None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:11.647639 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea894ec0-666b-4bfa-b856-39f7c661579a None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:11.647813 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea894ec0-666b-4bfa-b856-39f7c661579a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:11.665251 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-ea894ec0-666b-4bfa-b856-39f7c661579a None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:02:11.666427 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-ea894ec0-666b-4bfa-b856-39f7c661579a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:02:11.728186 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 582/1179] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:02:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:02:11.750679 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3648ba94-3206-4cc1-a6ca-179982d74cb7 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:11.847298 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3648ba94-3206-4cc1-a6ca-179982d74cb7 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:11.880133 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d29bdfc-905c-4823-8dc1-5f36f2b3f1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:11.880921 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29bdfc-905c-4823-8dc1-5f36f2b3f1c3 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:11.881204 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29bdfc-905c-4823-8dc1-5f36f2b3f1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:11.881479 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29bdfc-905c-4823-8dc1-5f36f2b3f1c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:11.890975 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d29bdfc-905c-4823-8dc1-5f36f2b3f1c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:02:11.898540 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-1d29bdfc-905c-4823-8dc1-5f36f2b3f1c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:02:11.898540 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:02:11.898540 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:02:11.898540 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:02:11.898540 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:02:11.898540 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:02:11.898540 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:02:11.898540 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:02:11.898540 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:02:11.898540 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:02:11.898540 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:02:11.898540 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:02:11.898540 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:02:11.898540 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:02:11.898540 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:02:11.898540 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:02:11.899644 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:02:11.899644 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:02:11.899644 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:02:11.899644 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:02:11.899644 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:02:11.899644 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:02:11.899644 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:02:11.899644 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:02:11.899644 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:02:11.899644 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:02:11.899644 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:02:11.899644 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:02:11.899644 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:02:11.899644 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:02:11.899644 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:02:11.899644 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:02:11.900714 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:02:11.900714 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:02:11.900714 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:02:11.900714 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:02:11.900714 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:02:11.900714 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:02:11.900714 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:02:11.900714 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:02:11.900714 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:02:11.900714 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:02:11.900714 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:02:11.900714 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:02:11.900714 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 598/1180] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 10 03:02:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:02:11.905808 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea894ec0-666b-4bfa-b856-39f7c661579a None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:12.003982 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea894ec0-666b-4bfa-b856-39f7c661579a None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:12.031148 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234c3db-9c7f-4642-9532-714cb030688b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:12.032749 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234c3db-9c7f-4642-9532-714cb030688b None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:12.032749 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234c3db-9c7f-4642-9532-714cb030688b None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:12.032749 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234c3db-9c7f-4642-9532-714cb030688b None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:12.033369 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1234c3db-9c7f-4642-9532-714cb030688b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:02:12.033680 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1234c3db-9c7f-4642-9532-714cb030688b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:12.035582 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1234c3db-9c7f-4642-9532-714cb030688b None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:12.043229 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 583/1181] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 10 03:02:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:02:12.049051 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d29bdfc-905c-4823-8dc1-5f36f2b3f1c3 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:12.174177 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d29bdfc-905c-4823-8dc1-5f36f2b3f1c3 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:12.205656 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0903a633-a8fa-4195-adf2-9f388dbd34df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:12.206509 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903a633-a8fa-4195-adf2-9f388dbd34df None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:12.206797 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903a633-a8fa-4195-adf2-9f388dbd34df None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:12.207069 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903a633-a8fa-4195-adf2-9f388dbd34df None admin] PATH_INFO: `/v3/users/8b8d5dbfe1a941f4ad833a055a2edcb3` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:12.219348 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0903a633-a8fa-4195-adf2-9f388dbd34df None admin] RBAC: Authorizing `identity:get_user(user_id=8b8d5dbfe1a941f4ad833a055a2edcb3)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:12.220813 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0903a633-a8fa-4195-adf2-9f388dbd34df None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:12.222946 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 599/1182] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 10 03:02:12 2022] GET /identity/v3/users/8b8d5dbfe1a941f4ad833a055a2edcb3 => generated 311 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:02:12.228511 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234c3db-9c7f-4642-9532-714cb030688b None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:12.322406 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234c3db-9c7f-4642-9532-714cb030688b None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:12.354259 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a9bd30-aa8b-4740-a298-584fe8c2b6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:12.354892 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9bd30-aa8b-4740-a298-584fe8c2b6b2 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:12.355175 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9bd30-aa8b-4740-a298-584fe8c2b6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:12.355449 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9bd30-aa8b-4740-a298-584fe8c2b6b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:12.418853 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a9bd30-aa8b-4740-a298-584fe8c2b6b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:12.420316 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a9bd30-aa8b-4740-a298-584fe8c2b6b2 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:12.511596 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 584/1183] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 10 03:02:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 03:02:12.517350 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0903a633-a8fa-4195-adf2-9f388dbd34df None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:12.615265 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0903a633-a8fa-4195-adf2-9f388dbd34df None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:12.647128 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0eb54c-c2ce-4929-a8ac-34ce574d5838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:12.647976 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0eb54c-c2ce-4929-a8ac-34ce574d5838 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:12.648292 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0eb54c-c2ce-4929-a8ac-34ce574d5838 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:12.648570 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0eb54c-c2ce-4929-a8ac-34ce574d5838 None admin] PATH_INFO: `/v3/projects/8df6589997294ddca3f4f9a5efc01a31` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:12.649742 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0eb54c-c2ce-4929-a8ac-34ce574d5838 None admin] RBAC: Authorizing `identity:get_project(project_id=8df6589997294ddca3f4f9a5efc01a31)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:12.651155 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0eb54c-c2ce-4929-a8ac-34ce574d5838 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:12.652864 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 600/1184] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 10 03:02:12 2022] GET /identity/v3/projects/8df6589997294ddca3f4f9a5efc01a31 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:02:12.659090 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a9bd30-aa8b-4740-a298-584fe8c2b6b2 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:12.751412 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a9bd30-aa8b-4740-a298-584fe8c2b6b2 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:12.784132 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e63fb-22ce-4e6f-9945-0f413797b61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:12.784773 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e63fb-22ce-4e6f-9945-0f413797b61b None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:12.785059 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e63fb-22ce-4e6f-9945-0f413797b61b None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:12.785339 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e63fb-22ce-4e6f-9945-0f413797b61b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:12.786162 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56e63fb-22ce-4e6f-9945-0f413797b61b None admin] RBAC: Adding query filter params (role.id=43105000610f402ca2486e7648018cca, scope.project.id=8df6589997294ddca3f4f9a5efc01a31, user.id=8b8d5dbfe1a941f4ad833a055a2edcb3) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:02:12.786477 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56e63fb-22ce-4e6f-9945-0f413797b61b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:12.787902 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56e63fb-22ce-4e6f-9945-0f413797b61b None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:12.793110 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 585/1185] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 10 03:02:12 2022] GET /identity/v3/role_assignments?user.id=8b8d5dbfe1a941f4ad833a055a2edcb3&scope.project.id=8df6589997294ddca3f4f9a5efc01a31&role.id=43105000610f402ca2486e7648018cca => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:02:14.953695 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f7ca8-fc73-4a5b-9bc7-cc49ecf79bca None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:14.954211 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f7ca8-fc73-4a5b-9bc7-cc49ecf79bca None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:14.954301 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f7ca8-fc73-4a5b-9bc7-cc49ecf79bca None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:14.955585 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 601/1186] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:02:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:02:14.961213 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e25c749-af73-4734-9f2b-eca83394adc8 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:14.961642 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e25c749-af73-4734-9f2b-eca83394adc8 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:14.961776 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e25c749-af73-4734-9f2b-eca83394adc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:14.978018 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-8e25c749-af73-4734-9f2b-eca83394adc8 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:02:14.979206 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-8e25c749-af73-4734-9f2b-eca83394adc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:02:15.042838 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 586/1187] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:02:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:02:15.065883 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25f7ca8-fc73-4a5b-9bc7-cc49ecf79bca None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:15.160314 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25f7ca8-fc73-4a5b-9bc7-cc49ecf79bca None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:15.191584 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b3e974-01b9-4464-992f-e7f37ee8b0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:15.192398 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3e974-01b9-4464-992f-e7f37ee8b0ce None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:15.192683 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3e974-01b9-4464-992f-e7f37ee8b0ce None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:15.192957 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3e974-01b9-4464-992f-e7f37ee8b0ce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:15.202472 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b3e974-01b9-4464-992f-e7f37ee8b0ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:02:15.210664 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-c5b3e974-01b9-4464-992f-e7f37ee8b0ce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:02:15.210664 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:02:15.210664 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:02:15.210664 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:02:15.210664 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:02:15.210664 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:02:15.210664 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:02:15.210664 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:02:15.210664 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:02:15.210664 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:02:15.210664 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:02:15.210664 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:02:15.210664 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:02:15.210664 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:02:15.210664 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:02:15.210664 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:02:15.211731 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:02:15.211731 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:02:15.211731 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:02:15.211731 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:02:15.211731 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:02:15.211731 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:02:15.211731 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:02:15.211731 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:02:15.211731 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:02:15.211731 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:02:15.211731 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:02:15.211731 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:02:15.211731 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:02:15.211731 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:02:15.211731 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:02:15.211731 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:02:15.212793 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:02:15.212793 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:02:15.212793 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:02:15.212793 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:02:15.212793 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:02:15.212793 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:02:15.212793 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:02:15.212793 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:02:15.212793 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:02:15.212793 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:02:15.212793 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:02:15.212793 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:02:15.212793 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 602/1188] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 10 03:02:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:02:15.217580 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e25c749-af73-4734-9f2b-eca83394adc8 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:15.316831 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e25c749-af73-4734-9f2b-eca83394adc8 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:15.348357 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e9420-f6ca-4c50-b734-449b05de892d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:15.349016 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e9420-f6ca-4c50-b734-449b05de892d None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:15.349301 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e9420-f6ca-4c50-b734-449b05de892d None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:15.349577 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e9420-f6ca-4c50-b734-449b05de892d None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:15.350318 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2e9420-f6ca-4c50-b734-449b05de892d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:02:15.350625 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2e9420-f6ca-4c50-b734-449b05de892d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:15.351985 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2e9420-f6ca-4c50-b734-449b05de892d None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:15.359648 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 587/1189] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 10 03:02:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:02:15.366098 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b3e974-01b9-4464-992f-e7f37ee8b0ce None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:15.460393 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b3e974-01b9-4464-992f-e7f37ee8b0ce None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:15.492049 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d88bba-7e31-46ac-aa33-11fd4d5ea876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:15.492858 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d88bba-7e31-46ac-aa33-11fd4d5ea876 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:15.493143 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d88bba-7e31-46ac-aa33-11fd4d5ea876 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:15.493419 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d88bba-7e31-46ac-aa33-11fd4d5ea876 None admin] PATH_INFO: `/v3/users/8b8d5dbfe1a941f4ad833a055a2edcb3` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:15.494600 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d88bba-7e31-46ac-aa33-11fd4d5ea876 None admin] RBAC: Authorizing `identity:get_user(user_id=8b8d5dbfe1a941f4ad833a055a2edcb3)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:15.496035 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d88bba-7e31-46ac-aa33-11fd4d5ea876 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:15.497648 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 603/1190] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 10 03:02:15 2022] GET /identity/v3/users/8b8d5dbfe1a941f4ad833a055a2edcb3 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:02:15.503873 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e9420-f6ca-4c50-b734-449b05de892d None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:15.600135 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e9420-f6ca-4c50-b734-449b05de892d None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:15.631842 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161ab69-e764-4749-a9c2-7a8f8cd59e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:15.632713 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161ab69-e764-4749-a9c2-7a8f8cd59e6c None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:15.632997 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161ab69-e764-4749-a9c2-7a8f8cd59e6c None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:15.633272 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161ab69-e764-4749-a9c2-7a8f8cd59e6c None admin] PATH_INFO: `/v3/projects/8df6589997294ddca3f4f9a5efc01a31` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:15.634451 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9161ab69-e764-4749-a9c2-7a8f8cd59e6c None admin] RBAC: Authorizing `identity:get_project(project_id=8df6589997294ddca3f4f9a5efc01a31)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:15.635884 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9161ab69-e764-4749-a9c2-7a8f8cd59e6c None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:15.637599 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 588/1191] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 10 03:02:15 2022] GET /identity/v3/projects/8df6589997294ddca3f4f9a5efc01a31 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:02:15.643507 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d88bba-7e31-46ac-aa33-11fd4d5ea876 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:15.738081 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d88bba-7e31-46ac-aa33-11fd4d5ea876 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:15.768627 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd1b57-28af-4d58-9d4f-9f03fd454fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:15.769436 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd1b57-28af-4d58-9d4f-9f03fd454fb0 None admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:15.769721 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd1b57-28af-4d58-9d4f-9f03fd454fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:15.769996 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd1b57-28af-4d58-9d4f-9f03fd454fb0 None admin] PATH_INFO: `/v3/projects/8df6589997294ddca3f4f9a5efc01a31/users/8b8d5dbfe1a941f4ad833a055a2edcb3/roles/43105000610f402ca2486e7648018cca` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:15.771933 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cd1b57-28af-4d58-9d4f-9f03fd454fb0 None admin] RBAC: Authorizing `identity:create_grant(project_id=8df6589997294ddca3f4f9a5efc01a31, user_id=8b8d5dbfe1a941f4ad833a055a2edcb3, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:15.773374 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cd1b57-28af-4d58-9d4f-9f03fd454fb0 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:15.880496 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 604/1192] 10.222.0.65 () {58 vars in 1439 bytes} [Tue May 10 03:02:15 2022] PUT /identity/v3/projects/8df6589997294ddca3f4f9a5efc01a31/users/8b8d5dbfe1a941f4ad833a055a2edcb3/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:02:18.066436 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438ef69-9e64-4a80-a82b-0598a41be87d None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:18.066962 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438ef69-9e64-4a80-a82b-0598a41be87d None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:18.067081 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438ef69-9e64-4a80-a82b-0598a41be87d None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:18.068388 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 589/1193] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:02:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:02:18.073647 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86575bcc-c722-4ae1-9db1-1935d8c46afc None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:18.074013 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86575bcc-c722-4ae1-9db1-1935d8c46afc None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:18.074209 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86575bcc-c722-4ae1-9db1-1935d8c46afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:18.091065 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-86575bcc-c722-4ae1-9db1-1935d8c46afc None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:02:18.092309 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-86575bcc-c722-4ae1-9db1-1935d8c46afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:02:18.154747 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 605/1194] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:02:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:02:18.177468 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1438ef69-9e64-4a80-a82b-0598a41be87d None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:18.279415 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1438ef69-9e64-4a80-a82b-0598a41be87d None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:18.311146 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8073e8f-c430-4e27-b179-1377e62fff80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:18.311931 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8073e8f-c430-4e27-b179-1377e62fff80 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:18.312246 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8073e8f-c430-4e27-b179-1377e62fff80 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:18.312527 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8073e8f-c430-4e27-b179-1377e62fff80 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:18.323191 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8073e8f-c430-4e27-b179-1377e62fff80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:02:18.330666 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-d8073e8f-c430-4e27-b179-1377e62fff80 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:02:18.330666 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:02:18.330666 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:02:18.330666 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:02:18.330666 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:02:18.330666 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:02:18.330666 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:02:18.330666 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:02:18.330666 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:02:18.330666 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:02:18.330666 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:02:18.330666 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:02:18.330666 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:02:18.330666 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:02:18.330666 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:02:18.330666 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:02:18.331747 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:02:18.331747 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:02:18.331747 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:02:18.331747 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:02:18.331747 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:02:18.331747 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:02:18.331747 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:02:18.331747 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:02:18.331747 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:02:18.331747 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:02:18.331747 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:02:18.331747 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:02:18.331747 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:02:18.331747 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:02:18.331747 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:02:18.331747 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:02:18.332652 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:02:18.332652 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:02:18.332652 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:02:18.332652 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:02:18.332652 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:02:18.332652 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:02:18.332652 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:02:18.332652 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:02:18.332652 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:02:18.332652 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:02:18.332652 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:02:18.332652 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:02:18.332652 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 590/1195] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 10 03:02:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:02:18.337935 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86575bcc-c722-4ae1-9db1-1935d8c46afc None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:18.429482 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86575bcc-c722-4ae1-9db1-1935d8c46afc None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:18.461015 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d58fa5-bd68-432d-870e-f77bbd7b6ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:18.461678 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d58fa5-bd68-432d-870e-f77bbd7b6ab4 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:18.461959 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d58fa5-bd68-432d-870e-f77bbd7b6ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:18.462233 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d58fa5-bd68-432d-870e-f77bbd7b6ab4 None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:18.462974 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d58fa5-bd68-432d-870e-f77bbd7b6ab4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:02:18.463278 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d58fa5-bd68-432d-870e-f77bbd7b6ab4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:18.464727 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d58fa5-bd68-432d-870e-f77bbd7b6ab4 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:18.472613 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 606/1196] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 10 03:02:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:02:18.478277 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8073e8f-c430-4e27-b179-1377e62fff80 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:18.573162 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8073e8f-c430-4e27-b179-1377e62fff80 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:18.611313 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d676bd2-f0d7-4c07-bdcc-a0df4cabe194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:18.612658 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d676bd2-f0d7-4c07-bdcc-a0df4cabe194 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:18.612939 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d676bd2-f0d7-4c07-bdcc-a0df4cabe194 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:18.613210 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d676bd2-f0d7-4c07-bdcc-a0df4cabe194 None admin] PATH_INFO: `/v3/users/8b8d5dbfe1a941f4ad833a055a2edcb3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:18.614408 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d676bd2-f0d7-4c07-bdcc-a0df4cabe194 None admin] RBAC: Authorizing `identity:get_user(user_id=8b8d5dbfe1a941f4ad833a055a2edcb3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:18.615863 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d676bd2-f0d7-4c07-bdcc-a0df4cabe194 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:18.617631 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 591/1197] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 10 03:02:18 2022] GET /identity/v3/users/8b8d5dbfe1a941f4ad833a055a2edcb3 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:02:18.625259 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d58fa5-bd68-432d-870e-f77bbd7b6ab4 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:18.719888 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d58fa5-bd68-432d-870e-f77bbd7b6ab4 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:18.751559 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef4b18-2684-4421-80fa-faf79e8259ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:18.752218 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef4b18-2684-4421-80fa-faf79e8259ac None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:18.752528 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef4b18-2684-4421-80fa-faf79e8259ac None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:18.752801 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef4b18-2684-4421-80fa-faf79e8259ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:18.814309 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bef4b18-2684-4421-80fa-faf79e8259ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:18.815751 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bef4b18-2684-4421-80fa-faf79e8259ac None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:18.905344 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 607/1198] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 10 03:02:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 03:02:18.912745 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d676bd2-f0d7-4c07-bdcc-a0df4cabe194 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:19.006186 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d676bd2-f0d7-4c07-bdcc-a0df4cabe194 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:19.038988 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a1976-3162-4f39-974c-b9628a7d4cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:19.039827 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a1976-3162-4f39-974c-b9628a7d4cb8 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:19.040207 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a1976-3162-4f39-974c-b9628a7d4cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:19.040483 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a1976-3162-4f39-974c-b9628a7d4cb8 None admin] PATH_INFO: `/v3/projects/8df6589997294ddca3f4f9a5efc01a31` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:19.041638 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37a1976-3162-4f39-974c-b9628a7d4cb8 None admin] RBAC: Authorizing `identity:get_project(project_id=8df6589997294ddca3f4f9a5efc01a31)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:19.043056 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37a1976-3162-4f39-974c-b9628a7d4cb8 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:19.044753 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 592/1199] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 10 03:02:18 2022] GET /identity/v3/projects/8df6589997294ddca3f4f9a5efc01a31 => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:02:19.050866 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef4b18-2684-4421-80fa-faf79e8259ac None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:02:19.141861 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef4b18-2684-4421-80fa-faf79e8259ac None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:02:19.174435 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa85ad24-932a-48cb-b51e-5c54d58e5c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:02:19.175017 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85ad24-932a-48cb-b51e-5c54d58e5c3d None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:02:19.175302 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85ad24-932a-48cb-b51e-5c54d58e5c3d None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:02:19.175580 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85ad24-932a-48cb-b51e-5c54d58e5c3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:02:19.176432 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa85ad24-932a-48cb-b51e-5c54d58e5c3d None admin] RBAC: Adding query filter params (role.id=43105000610f402ca2486e7648018cca, scope.project.id=8df6589997294ddca3f4f9a5efc01a31, user.id=8b8d5dbfe1a941f4ad833a055a2edcb3) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:02:19.176774 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa85ad24-932a-48cb-b51e-5c54d58e5c3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:02:19.178184 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa85ad24-932a-48cb-b51e-5c54d58e5c3d None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:02:19.183734 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 608/1200] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 10 03:02:19 2022] GET /identity/v3/role_assignments?user.id=8b8d5dbfe1a941f4ad833a055a2edcb3&scope.project.id=8df6589997294ddca3f4f9a5efc01a31&role.id=43105000610f402ca2486e7648018cca => generated 608 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:03:34.721058 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7970c-1b01-4d61-8823-4320b6095f15 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:34.721650 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7970c-1b01-4d61-8823-4320b6095f15 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:34.721650 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7970c-1b01-4d61-8823-4320b6095f15 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:34.722906 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 593/1201] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:03:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:03:34.728152 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260d695-3ad8-41af-a630-f4402a6c327b None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:34.728588 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260d695-3ad8-41af-a630-f4402a6c327b None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:34.728737 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260d695-3ad8-41af-a630-f4402a6c327b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:34.745550 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-0260d695-3ad8-41af-a630-f4402a6c327b None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:03:34.746716 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-0260d695-3ad8-41af-a630-f4402a6c327b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:03:34.809625 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 609/1202] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:03:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 03:03:34.834115 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe7970c-1b01-4d61-8823-4320b6095f15 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:34.929702 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe7970c-1b01-4d61-8823-4320b6095f15 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:34.961372 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ae59f-6333-4d45-abd9-56df2c3e9ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:34.962150 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ae59f-6333-4d45-abd9-56df2c3e9ce3 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:34.962432 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ae59f-6333-4d45-abd9-56df2c3e9ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:34.962705 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ae59f-6333-4d45-abd9-56df2c3e9ce3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:34.972788 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745ae59f-6333-4d45-abd9-56df2c3e9ce3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:03:34.974169 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745ae59f-6333-4d45-abd9-56df2c3e9ce3 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:03:34.990721 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-745ae59f-6333-4d45-abd9-56df2c3e9ce3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:03:34.990721 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:03:34.990721 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:03:34.990721 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:03:34.990721 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:03:34.990721 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:03:34.990721 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:03:34.990721 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:03:34.990721 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:03:34.990721 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:03:34.990721 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:03:34.990721 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:03:34.990721 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:03:34.990721 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:03:34.990721 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:03:34.991809 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:03:34.991809 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:03:34.991809 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:03:34.991809 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:03:34.991809 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:03:34.991809 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:03:34.991809 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:03:34.991809 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:03:34.991809 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:03:34.991809 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:03:34.991809 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:03:34.991809 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:03:34.991809 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:03:34.991809 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:03:34.991809 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:03:34.991809 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:03:34.991809 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:03:34.993049 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:03:34.993049 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:03:34.993049 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:03:34.993049 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:03:34.993049 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 594/1203] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:03:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:03:34.997945 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0260d695-3ad8-41af-a630-f4402a6c327b None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:35.090376 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0260d695-3ad8-41af-a630-f4402a6c327b None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:35.122715 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc648747-4a2f-463b-86d8-4690666d5796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:35.123377 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc648747-4a2f-463b-86d8-4690666d5796 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:35.123660 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc648747-4a2f-463b-86d8-4690666d5796 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:35.123933 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc648747-4a2f-463b-86d8-4690666d5796 None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:35.128721 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc648747-4a2f-463b-86d8-4690666d5796 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:03:35.128721 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc648747-4a2f-463b-86d8-4690666d5796 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:03:35.128721 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc648747-4a2f-463b-86d8-4690666d5796 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:03:35.137697 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 610/1204] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:03:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:03:35.143895 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ae59f-6333-4d45-abd9-56df2c3e9ce3 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:35.240453 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ae59f-6333-4d45-abd9-56df2c3e9ce3 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:35.272603 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48d9bd1-d143-4823-8e65-4d2bcc265601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:35.278776 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d9bd1-d143-4823-8e65-4d2bcc265601 None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:35.278776 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d9bd1-d143-4823-8e65-4d2bcc265601 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:35.278776 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d9bd1-d143-4823-8e65-4d2bcc265601 None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:35.278776 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48d9bd1-d143-4823-8e65-4d2bcc265601 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:03:35.278776 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48d9bd1-d143-4823-8e65-4d2bcc265601 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:03:35.376541 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 595/1205] 10.222.0.65 () {60 vars in 1132 bytes} [Tue May 10 03:03:35 2022] POST /identity/v3/users => generated 251 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:03:37.651409 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ec4f0-5e05-450a-a936-d7a7b9556f35 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:37.651966 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ec4f0-5e05-450a-a936-d7a7b9556f35 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:37.651966 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ec4f0-5e05-450a-a936-d7a7b9556f35 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:37.653394 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 611/1206] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:03:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:03:37.658898 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df89f2-c729-48fa-bbeb-2f0e4ff15658 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:37.659329 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df89f2-c729-48fa-bbeb-2f0e4ff15658 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:37.659488 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df89f2-c729-48fa-bbeb-2f0e4ff15658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:37.677288 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-c5df89f2-c729-48fa-bbeb-2f0e4ff15658 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:03:37.678511 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-c5df89f2-c729-48fa-bbeb-2f0e4ff15658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:03:37.751910 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 596/1207] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:03:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 03:03:37.774564 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ec4f0-5e05-450a-a936-d7a7b9556f35 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:37.871164 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ec4f0-5e05-450a-a936-d7a7b9556f35 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:37.903110 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b03e6-1c60-4c88-a258-d2834a3f4fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:37.903892 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b03e6-1c60-4c88-a258-d2834a3f4fe7 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:37.904207 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b03e6-1c60-4c88-a258-d2834a3f4fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:37.904487 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b03e6-1c60-4c88-a258-d2834a3f4fe7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:37.914734 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025b03e6-1c60-4c88-a258-d2834a3f4fe7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:03:37.924455 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-025b03e6-1c60-4c88-a258-d2834a3f4fe7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 03:03:37.924455 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:03:37.924455 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:03:37.924455 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:03:37.924455 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:03:37.924455 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:03:37.924455 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:03:37.924455 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:03:37.924455 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:03:37.924455 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:03:37.924455 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:03:37.924455 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:03:37.924455 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:03:37.924455 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:03:37.924455 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:03:37.924455 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:03:37.925625 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:03:37.925625 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:03:37.925625 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:03:37.925625 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:03:37.925625 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:03:37.925625 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:03:37.925625 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:03:37.925625 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:03:37.925625 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:03:37.925625 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:03:37.925625 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:03:37.925625 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:03:37.925625 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:03:37.925625 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:03:37.925625 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:03:37.925625 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:03:37.926690 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:03:37.926690 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:03:37.926690 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:03:37.926690 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:03:37.926690 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:03:37.926690 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:03:37.926690 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:03:37.926690 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:03:37.926690 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:03:37.926690 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:03:37.926690 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 03:03:37.926690 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:03:37.926690 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 612/1208] 10.222.0.65 () {56 vars in 1102 bytes} [Tue May 10 03:03:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:03:37.930072 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5df89f2-c729-48fa-bbeb-2f0e4ff15658 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:38.026556 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5df89f2-c729-48fa-bbeb-2f0e4ff15658 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:38.059256 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89174d33-486d-44a1-923b-053cb0519a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:38.059983 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89174d33-486d-44a1-923b-053cb0519a8c None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:38.060289 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89174d33-486d-44a1-923b-053cb0519a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:38.060566 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89174d33-486d-44a1-923b-053cb0519a8c None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:38.061301 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89174d33-486d-44a1-923b-053cb0519a8c None admin] RBAC: Adding query filter params (name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:03:38.061603 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89174d33-486d-44a1-923b-053cb0519a8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:03:38.063552 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89174d33-486d-44a1-923b-053cb0519a8c None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:03:38.071505 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 597/1209] 10.222.0.65 () {56 vars in 1103 bytes} [Tue May 10 03:03:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:03:38.077300 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b03e6-1c60-4c88-a258-d2834a3f4fe7 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:38.171937 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b03e6-1c60-4c88-a258-d2834a3f4fe7 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:38.203468 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d4d33-f2bf-4ce6-9a64-06059aca8794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:38.204281 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d4d33-f2bf-4ce6-9a64-06059aca8794 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:38.204566 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d4d33-f2bf-4ce6-9a64-06059aca8794 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:38.204841 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d4d33-f2bf-4ce6-9a64-06059aca8794 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:38.214843 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9d4d33-f2bf-4ce6-9a64-06059aca8794 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:03:38.216309 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9d4d33-f2bf-4ce6-9a64-06059aca8794 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:03:38.233067 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-0e9d4d33-f2bf-4ce6-9a64-06059aca8794 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:03:38.233067 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:03:38.233067 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:03:38.233067 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:03:38.233067 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:03:38.233067 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:03:38.233067 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:03:38.233067 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:03:38.233067 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:03:38.233067 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:03:38.233067 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:03:38.233067 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:03:38.233067 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:03:38.233067 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:03:38.233067 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:03:38.234753 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:03:38.234753 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:03:38.234753 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:03:38.234753 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:03:38.234753 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:03:38.234753 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:03:38.234753 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:03:38.234753 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:03:38.234753 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:03:38.234753 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:03:38.234753 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:03:38.234753 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:03:38.234753 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:03:38.234753 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:03:38.234753 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:03:38.234753 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:03:38.234753 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:03:38.235954 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:03:38.235954 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:03:38.235954 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:03:38.235954 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:03:38.235954 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 613/1210] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:03:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:03:38.240587 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89174d33-486d-44a1-923b-053cb0519a8c None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:38.339595 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89174d33-486d-44a1-923b-053cb0519a8c None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:38.372104 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4d22d3-ea9a-48d3-b610-04803a2a284d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:38.372761 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d22d3-ea9a-48d3-b610-04803a2a284d None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:38.373048 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d22d3-ea9a-48d3-b610-04803a2a284d None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:38.373330 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d22d3-ea9a-48d3-b610-04803a2a284d None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:38.374046 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4d22d3-ea9a-48d3-b610-04803a2a284d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:03:38.374354 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4d22d3-ea9a-48d3-b610-04803a2a284d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:03:38.376259 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4d22d3-ea9a-48d3-b610-04803a2a284d None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:03:38.387834 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 598/1211] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:03:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:03:38.393770 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d4d33-f2bf-4ce6-9a64-06059aca8794 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:38.493474 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d4d33-f2bf-4ce6-9a64-06059aca8794 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:38.526261 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f904b110-0b7b-44aa-93fb-c4c3fd8b40b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:38.527060 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904b110-0b7b-44aa-93fb-c4c3fd8b40b8 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:38.527346 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904b110-0b7b-44aa-93fb-c4c3fd8b40b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:38.527625 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904b110-0b7b-44aa-93fb-c4c3fd8b40b8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:38.535312 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f904b110-0b7b-44aa-93fb-c4c3fd8b40b8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:03:38.536768 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f904b110-0b7b-44aa-93fb-c4c3fd8b40b8 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:03:38.551494 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-f904b110-0b7b-44aa-93fb-c4c3fd8b40b8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 03:03:38.551494 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:03:38.551494 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:03:38.551494 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:03:38.551494 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:03:38.551494 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:03:38.551494 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:03:38.551494 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:03:38.551494 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:03:38.551494 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:03:38.551494 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:03:38.551494 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:03:38.551494 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:03:38.551494 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:03:38.551494 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:03:38.551494 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:03:38.552666 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:03:38.552666 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:03:38.552666 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:03:38.552666 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:03:38.552666 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:03:38.552666 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:03:38.552666 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:03:38.552666 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:03:38.552666 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:03:38.552666 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:03:38.552666 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:03:38.552666 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:03:38.552666 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:03:38.552666 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:03:38.552666 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:03:38.552666 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:03:38.552666 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:03:38.552666 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:03:38.554005 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:03:38.554005 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:03:38.554005 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:03:38.554005 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:03:38.554005 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:03:38.554005 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:03:38.554005 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:03:38.554005 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:03:38.554005 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 03:03:38.554005 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:03:38.554005 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 614/1212] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:03:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:03:38.558495 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4d22d3-ea9a-48d3-b610-04803a2a284d None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:38.651142 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4d22d3-ea9a-48d3-b610-04803a2a284d None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:38.683051 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60794b9-f1ca-48ae-9d48-6de0cc936fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:38.683725 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60794b9-f1ca-48ae-9d48-6de0cc936fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:38.684020 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60794b9-f1ca-48ae-9d48-6de0cc936fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:38.684301 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60794b9-f1ca-48ae-9d48-6de0cc936fb7 None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:38.685121 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60794b9-f1ca-48ae-9d48-6de0cc936fb7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:03:38.685430 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60794b9-f1ca-48ae-9d48-6de0cc936fb7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:03:38.686846 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60794b9-f1ca-48ae-9d48-6de0cc936fb7 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:03:38.703926 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 599/1213] 10.222.0.65 () {56 vars in 1143 bytes} [Tue May 10 03:03:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:03:38.709651 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f904b110-0b7b-44aa-93fb-c4c3fd8b40b8 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:38.804124 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f904b110-0b7b-44aa-93fb-c4c3fd8b40b8 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:38.835651 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e0b368-4888-42e3-be1a-14922bacb3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:38.836321 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e0b368-4888-42e3-be1a-14922bacb3fe None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:38.836607 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e0b368-4888-42e3-be1a-14922bacb3fe None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:38.836886 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e0b368-4888-42e3-be1a-14922bacb3fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:38.900703 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e0b368-4888-42e3-be1a-14922bacb3fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:03:38.902212 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e0b368-4888-42e3-be1a-14922bacb3fe None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:03:38.994804 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 615/1214] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 10 03:03:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 03:03:39.000730 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60794b9-f1ca-48ae-9d48-6de0cc936fb7 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:39.097891 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60794b9-f1ca-48ae-9d48-6de0cc936fb7 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:39.130692 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0999cce6-7ef8-49b4-aa13-fc54c146d255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:39.131489 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999cce6-7ef8-49b4-aa13-fc54c146d255 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:39.131773 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999cce6-7ef8-49b4-aa13-fc54c146d255 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:39.132079 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999cce6-7ef8-49b4-aa13-fc54c146d255 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:39.141834 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0999cce6-7ef8-49b4-aa13-fc54c146d255 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:03:39.143272 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0999cce6-7ef8-49b4-aa13-fc54c146d255 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:03:39.160908 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-0999cce6-7ef8-49b4-aa13-fc54c146d255 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:03:39.160908 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:03:39.160908 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:03:39.160908 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:03:39.160908 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:03:39.160908 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:03:39.160908 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:03:39.160908 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:03:39.160908 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:03:39.160908 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:03:39.160908 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:03:39.160908 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:03:39.160908 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:03:39.160908 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:03:39.160908 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:03:39.161968 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:03:39.161968 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:03:39.161968 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:03:39.161968 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:03:39.161968 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:03:39.161968 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:03:39.161968 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:03:39.161968 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:03:39.161968 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:03:39.161968 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:03:39.161968 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:03:39.161968 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:03:39.161968 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:03:39.161968 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:03:39.161968 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:03:39.161968 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:03:39.161968 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:03:39.163087 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:03:39.163087 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:03:39.163087 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:03:39.163087 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:03:39.163087 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 600/1215] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:03:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:03:39.167628 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e0b368-4888-42e3-be1a-14922bacb3fe None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:39.260478 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e0b368-4888-42e3-be1a-14922bacb3fe None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:39.293908 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d49742-7277-4f6b-a55b-5c114be6aab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:39.294613 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d49742-7277-4f6b-a55b-5c114be6aab9 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:39.294897 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d49742-7277-4f6b-a55b-5c114be6aab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:39.295175 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d49742-7277-4f6b-a55b-5c114be6aab9 None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:39.295903 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d49742-7277-4f6b-a55b-5c114be6aab9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:03:39.296246 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d49742-7277-4f6b-a55b-5c114be6aab9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:03:39.297610 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d49742-7277-4f6b-a55b-5c114be6aab9 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:03:39.308485 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 616/1216] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:03:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:03:39.314224 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0999cce6-7ef8-49b4-aa13-fc54c146d255 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:39.409965 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0999cce6-7ef8-49b4-aa13-fc54c146d255 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:39.442066 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c186167-bf5b-4064-a6a6-3976e766b21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:39.442795 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c186167-bf5b-4064-a6a6-3976e766b21f None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:39.443075 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c186167-bf5b-4064-a6a6-3976e766b21f None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:39.443353 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c186167-bf5b-4064-a6a6-3976e766b21f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:39.449776 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c186167-bf5b-4064-a6a6-3976e766b21f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:03:39.451230 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c186167-bf5b-4064-a6a6-3976e766b21f None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:03:39.465466 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-4c186167-bf5b-4064-a6a6-3976e766b21f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:03:39.465466 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:03:39.465466 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:03:39.465466 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:03:39.465466 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:03:39.465466 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:03:39.465466 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:03:39.465466 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:03:39.465466 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:03:39.465466 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:03:39.465466 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:03:39.465466 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:03:39.465466 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:03:39.465466 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:03:39.465466 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:03:39.472181 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:03:39.472181 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:03:39.472181 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:03:39.472181 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:03:39.472181 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:03:39.472181 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:03:39.472181 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:03:39.472181 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:03:39.472181 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:03:39.472181 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:03:39.472181 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:03:39.472181 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:03:39.472181 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:03:39.472181 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:03:39.472181 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:03:39.472181 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:03:39.472181 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:03:39.473284 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:03:39.473284 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:03:39.473284 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:03:39.473284 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:03:39.473284 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:03:39.473284 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:03:39.473284 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:03:39.473284 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:03:39.473284 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 601/1217] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 10 03:03:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:03:39.473898 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d49742-7277-4f6b-a55b-5c114be6aab9 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:39.568012 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d49742-7277-4f6b-a55b-5c114be6aab9 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:39.604977 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6723845-6a29-4114-b4b5-765218ce7209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:39.605635 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6723845-6a29-4114-b4b5-765218ce7209 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:39.605919 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6723845-6a29-4114-b4b5-765218ce7209 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:39.606195 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6723845-6a29-4114-b4b5-765218ce7209 None admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:39.606989 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6723845-6a29-4114-b4b5-765218ce7209 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:03:39.607298 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6723845-6a29-4114-b4b5-765218ce7209 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:03:39.608867 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6723845-6a29-4114-b4b5-765218ce7209 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:03:39.620428 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 617/1218] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 10 03:03:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:03:39.627169 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c186167-bf5b-4064-a6a6-3976e766b21f None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:39.721962 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c186167-bf5b-4064-a6a6-3976e766b21f None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:39.753473 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc4bf69-aaf5-46f0-aac6-19d24c56980f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:39.754119 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4bf69-aaf5-46f0-aac6-19d24c56980f None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:39.754403 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4bf69-aaf5-46f0-aac6-19d24c56980f None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:39.754681 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4bf69-aaf5-46f0-aac6-19d24c56980f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:39.755506 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc4bf69-aaf5-46f0-aac6-19d24c56980f None admin] RBAC: Adding query filter params (role.id=9a5640186d0940658e691be68ccf9205, scope.project.id=513e6592cd83457b8ff461b0e5e1fd40, user.id=f646147bdad8476ba0ab9da5d9c50b55) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:03:39.755819 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc4bf69-aaf5-46f0-aac6-19d24c56980f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:03:39.757285 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc4bf69-aaf5-46f0-aac6-19d24c56980f None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:03:39.762754 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 602/1219] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 10 03:03:39 2022] GET /identity/v3/role_assignments?user.id=f646147bdad8476ba0ab9da5d9c50b55&scope.project.id=513e6592cd83457b8ff461b0e5e1fd40&role.id=9a5640186d0940658e691be68ccf9205 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:03:41.940705 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece9341-093a-424c-8917-2f3b18db6361 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:41.941263 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece9341-093a-424c-8917-2f3b18db6361 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:41.941263 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece9341-093a-424c-8917-2f3b18db6361 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:41.942903 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 618/1220] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:03:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:03:41.948084 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6fdee-f186-447f-a6f0-cad044b11f7f None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:41.948531 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6fdee-f186-447f-a6f0-cad044b11f7f None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:41.956415 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6fdee-f186-447f-a6f0-cad044b11f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:41.965082 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-a5e6fdee-f186-447f-a6f0-cad044b11f7f None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:03:41.966260 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-a5e6fdee-f186-447f-a6f0-cad044b11f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:03:42.029437 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 603/1221] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:03:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:03:42.052888 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece9341-093a-424c-8917-2f3b18db6361 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:42.148898 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece9341-093a-424c-8917-2f3b18db6361 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:42.181275 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9105371-14cd-4a49-8c5b-cc1063bd10bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:42.182060 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9105371-14cd-4a49-8c5b-cc1063bd10bf None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:42.182344 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9105371-14cd-4a49-8c5b-cc1063bd10bf None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:42.182620 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9105371-14cd-4a49-8c5b-cc1063bd10bf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:42.192931 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9105371-14cd-4a49-8c5b-cc1063bd10bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:03:42.200505 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-d9105371-14cd-4a49-8c5b-cc1063bd10bf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 03:03:42.200505 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:03:42.200505 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:03:42.200505 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:03:42.200505 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:03:42.200505 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:03:42.200505 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:03:42.200505 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:03:42.200505 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:03:42.200505 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:03:42.200505 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:03:42.200505 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:03:42.200505 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:03:42.200505 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:03:42.200505 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:03:42.200505 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:03:42.205210 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:03:42.205210 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:03:42.205210 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:03:42.205210 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:03:42.205210 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:03:42.205210 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:03:42.205210 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:03:42.205210 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:03:42.205210 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:03:42.205210 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:03:42.205210 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:03:42.205210 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:03:42.205210 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:03:42.205210 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:03:42.205210 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:03:42.205210 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:03:42.206222 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:03:42.206222 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:03:42.206222 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:03:42.206222 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:03:42.206222 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:03:42.206222 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:03:42.206222 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:03:42.206222 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:03:42.206222 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:03:42.206222 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:03:42.206222 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 03:03:42.206222 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:03:42.206222 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 619/1222] 10.222.0.65 () {56 vars in 1102 bytes} [Tue May 10 03:03:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:03:42.208360 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6fdee-f186-447f-a6f0-cad044b11f7f None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:42.302153 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6fdee-f186-447f-a6f0-cad044b11f7f None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:42.334853 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13769f9a-4bf0-4ac0-8f68-f705287f119d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:42.335529 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13769f9a-4bf0-4ac0-8f68-f705287f119d None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:42.335812 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13769f9a-4bf0-4ac0-8f68-f705287f119d None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:42.336123 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13769f9a-4bf0-4ac0-8f68-f705287f119d None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:42.336873 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13769f9a-4bf0-4ac0-8f68-f705287f119d None admin] RBAC: Adding query filter params (name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:03:42.337179 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13769f9a-4bf0-4ac0-8f68-f705287f119d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:03:42.338628 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13769f9a-4bf0-4ac0-8f68-f705287f119d None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:03:42.347249 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 604/1223] 10.222.0.65 () {56 vars in 1103 bytes} [Tue May 10 03:03:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:03:42.353147 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9105371-14cd-4a49-8c5b-cc1063bd10bf None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:42.448313 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9105371-14cd-4a49-8c5b-cc1063bd10bf None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:42.480292 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973b4bfe-2c8b-47a4-8174-6ef7c083e7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:42.481066 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b4bfe-2c8b-47a4-8174-6ef7c083e7de None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:42.481351 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b4bfe-2c8b-47a4-8174-6ef7c083e7de None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:42.481630 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b4bfe-2c8b-47a4-8174-6ef7c083e7de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:42.492229 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973b4bfe-2c8b-47a4-8174-6ef7c083e7de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:03:42.493671 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973b4bfe-2c8b-47a4-8174-6ef7c083e7de None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:03:42.512264 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-973b4bfe-2c8b-47a4-8174-6ef7c083e7de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:03:42.512264 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:03:42.512264 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:03:42.512264 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:03:42.512264 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:03:42.512264 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:03:42.512264 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:03:42.512264 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:03:42.512264 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:03:42.512264 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:03:42.512264 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:03:42.512264 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:03:42.512264 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:03:42.512264 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:03:42.512264 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:03:42.513932 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:03:42.513932 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:03:42.513932 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:03:42.513932 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:03:42.513932 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:03:42.513932 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:03:42.513932 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:03:42.513932 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:03:42.513932 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:03:42.513932 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:03:42.513932 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:03:42.513932 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:03:42.513932 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:03:42.513932 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:03:42.513932 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:03:42.513932 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:03:42.513932 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:03:42.515668 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:03:42.515668 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:03:42.515668 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:03:42.515668 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:03:42.515668 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 620/1224] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:03:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:03:42.519301 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13769f9a-4bf0-4ac0-8f68-f705287f119d None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:42.616312 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13769f9a-4bf0-4ac0-8f68-f705287f119d None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:42.648181 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ae252f-6154-409d-84c6-446e522354f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:42.648836 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae252f-6154-409d-84c6-446e522354f1 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:42.649123 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae252f-6154-409d-84c6-446e522354f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:42.649430 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae252f-6154-409d-84c6-446e522354f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:42.650142 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ae252f-6154-409d-84c6-446e522354f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:03:42.650449 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ae252f-6154-409d-84c6-446e522354f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:03:42.651812 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ae252f-6154-409d-84c6-446e522354f1 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:03:42.664146 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 605/1225] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:03:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:03:42.669815 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973b4bfe-2c8b-47a4-8174-6ef7c083e7de None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:42.764346 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973b4bfe-2c8b-47a4-8174-6ef7c083e7de None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:42.797235 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb616766-afbf-460b-bdf1-9f3a21204fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:42.798034 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb616766-afbf-460b-bdf1-9f3a21204fc2 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:42.798322 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb616766-afbf-460b-bdf1-9f3a21204fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:42.798598 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb616766-afbf-460b-bdf1-9f3a21204fc2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:42.805539 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb616766-afbf-460b-bdf1-9f3a21204fc2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:03:42.806983 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb616766-afbf-460b-bdf1-9f3a21204fc2 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:03:42.821218 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-fb616766-afbf-460b-bdf1-9f3a21204fc2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 03:03:42.821218 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:03:42.821218 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:03:42.821218 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:03:42.821218 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:03:42.821218 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:03:42.821218 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:03:42.821218 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:03:42.821218 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:03:42.821218 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:03:42.821218 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:03:42.821218 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:03:42.821218 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:03:42.821218 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:03:42.821218 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:03:42.821218 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:03:42.822283 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:03:42.822283 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:03:42.822283 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:03:42.822283 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:03:42.822283 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:03:42.822283 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:03:42.822283 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:03:42.822283 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:03:42.822283 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:03:42.822283 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:03:42.822283 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:03:42.822283 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:03:42.822283 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:03:42.822283 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:03:42.822283 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:03:42.822283 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:03:42.822283 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:03:42.822283 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:03:42.823232 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:03:42.823232 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:03:42.823232 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:03:42.823232 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:03:42.823232 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:03:42.823232 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:03:42.823232 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:03:42.823232 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:03:42.823232 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 03:03:42.823232 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:03:42.823232 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 621/1226] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:03:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:03:42.828744 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ae252f-6154-409d-84c6-446e522354f1 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:42.925805 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ae252f-6154-409d-84c6-446e522354f1 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:42.958702 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324a3976-a8cc-4385-8559-c09f331d4b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:42.959367 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a3976-a8cc-4385-8559-c09f331d4b05 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:42.959655 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a3976-a8cc-4385-8559-c09f331d4b05 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:42.959932 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a3976-a8cc-4385-8559-c09f331d4b05 None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:42.960792 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324a3976-a8cc-4385-8559-c09f331d4b05 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:03:42.961103 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324a3976-a8cc-4385-8559-c09f331d4b05 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:03:42.962521 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324a3976-a8cc-4385-8559-c09f331d4b05 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:03:42.978740 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 606/1227] 10.222.0.65 () {56 vars in 1143 bytes} [Tue May 10 03:03:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:03:42.984803 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb616766-afbf-460b-bdf1-9f3a21204fc2 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:43.079006 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb616766-afbf-460b-bdf1-9f3a21204fc2 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:43.111382 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83299367-bf37-41de-b5df-6306d073a0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:43.112182 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83299367-bf37-41de-b5df-6306d073a0d4 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:43.112465 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83299367-bf37-41de-b5df-6306d073a0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:43.112740 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83299367-bf37-41de-b5df-6306d073a0d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:43.122314 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83299367-bf37-41de-b5df-6306d073a0d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:03:43.123775 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83299367-bf37-41de-b5df-6306d073a0d4 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:03:43.140446 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-83299367-bf37-41de-b5df-6306d073a0d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:03:43.140446 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:03:43.140446 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:03:43.140446 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:03:43.140446 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:03:43.140446 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:03:43.140446 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:03:43.140446 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:03:43.140446 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:03:43.140446 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:03:43.140446 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:03:43.140446 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:03:43.140446 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:03:43.140446 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:03:43.140446 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:03:43.141543 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:03:43.141543 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:03:43.141543 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:03:43.141543 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:03:43.141543 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:03:43.141543 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:03:43.141543 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:03:43.141543 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:03:43.141543 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:03:43.141543 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:03:43.141543 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:03:43.141543 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:03:43.141543 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:03:43.141543 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:03:43.141543 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:03:43.141543 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:03:43.141543 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:03:43.142660 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:03:43.142660 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:03:43.142660 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:03:43.142660 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:03:43.142660 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 622/1228] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:03:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:03:43.147289 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324a3976-a8cc-4385-8559-c09f331d4b05 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:43.242975 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324a3976-a8cc-4385-8559-c09f331d4b05 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:43.275274 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f238f3-ebcf-4503-b2b1-76b492f164ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:43.275924 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f238f3-ebcf-4503-b2b1-76b492f164ac None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:43.276238 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f238f3-ebcf-4503-b2b1-76b492f164ac None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:43.276516 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f238f3-ebcf-4503-b2b1-76b492f164ac None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:43.277228 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f238f3-ebcf-4503-b2b1-76b492f164ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:03:43.277535 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f238f3-ebcf-4503-b2b1-76b492f164ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:03:43.278892 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f238f3-ebcf-4503-b2b1-76b492f164ac None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:03:43.290367 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 607/1229] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:03:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:03:43.295837 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83299367-bf37-41de-b5df-6306d073a0d4 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:43.394999 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83299367-bf37-41de-b5df-6306d073a0d4 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:43.427907 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed5b6d-27a6-4e92-ab77-13c4a3f00767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:43.429081 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed5b6d-27a6-4e92-ab77-13c4a3f00767 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:43.429081 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed5b6d-27a6-4e92-ab77-13c4a3f00767 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:43.429270 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed5b6d-27a6-4e92-ab77-13c4a3f00767 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:43.435643 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeed5b6d-27a6-4e92-ab77-13c4a3f00767 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:03:43.437204 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeed5b6d-27a6-4e92-ab77-13c4a3f00767 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:03:43.450400 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-aeed5b6d-27a6-4e92-ab77-13c4a3f00767 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:03:43.450400 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:03:43.450400 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:03:43.450400 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:03:43.450400 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:03:43.450400 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:03:43.450400 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:03:43.450400 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:03:43.450400 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:03:43.450400 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:03:43.450400 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:03:43.450400 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:03:43.450400 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:03:43.450400 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:03:43.450400 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:03:43.451545 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:03:43.451545 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:03:43.451545 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:03:43.451545 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:03:43.451545 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:03:43.451545 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:03:43.451545 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:03:43.451545 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:03:43.451545 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:03:43.451545 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:03:43.451545 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:03:43.451545 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:03:43.451545 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:03:43.451545 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:03:43.451545 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:03:43.451545 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:03:43.451545 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:03:43.458072 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:03:43.458072 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:03:43.458072 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:03:43.458072 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:03:43.458072 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:03:43.458072 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:03:43.458072 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:03:43.458072 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:03:43.458072 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 623/1230] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 10 03:03:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:03:43.459240 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f238f3-ebcf-4503-b2b1-76b492f164ac None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:43.553985 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f238f3-ebcf-4503-b2b1-76b492f164ac None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:43.586516 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9036f4c1-2851-48d9-b082-b7b26f4081aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:43.587174 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9036f4c1-2851-48d9-b082-b7b26f4081aa None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:43.587461 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9036f4c1-2851-48d9-b082-b7b26f4081aa None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:43.587737 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9036f4c1-2851-48d9-b082-b7b26f4081aa None admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:43.588549 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9036f4c1-2851-48d9-b082-b7b26f4081aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:03:43.588861 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9036f4c1-2851-48d9-b082-b7b26f4081aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:03:43.590286 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9036f4c1-2851-48d9-b082-b7b26f4081aa None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:03:43.602492 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 608/1231] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 10 03:03:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:03:43.608514 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed5b6d-27a6-4e92-ab77-13c4a3f00767 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:43.703580 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed5b6d-27a6-4e92-ab77-13c4a3f00767 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:43.745704 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a759d7-f25e-4201-a6e9-760d016ce42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:43.746832 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a759d7-f25e-4201-a6e9-760d016ce42d None admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:43.747282 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a759d7-f25e-4201-a6e9-760d016ce42d None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:43.747648 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a759d7-f25e-4201-a6e9-760d016ce42d None admin] PATH_INFO: `/v3/projects/513e6592cd83457b8ff461b0e5e1fd40/users/f646147bdad8476ba0ab9da5d9c50b55/roles/9a5640186d0940658e691be68ccf9205` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:43.768614 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a759d7-f25e-4201-a6e9-760d016ce42d None admin] RBAC: Authorizing `identity:create_grant(project_id=513e6592cd83457b8ff461b0e5e1fd40, user_id=f646147bdad8476ba0ab9da5d9c50b55, role_id=9a5640186d0940658e691be68ccf9205)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:03:43.770061 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a759d7-f25e-4201-a6e9-760d016ce42d None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:03:43.847322 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 624/1232] 10.222.0.65 () {58 vars in 1439 bytes} [Tue May 10 03:03:43 2022] PUT /identity/v3/projects/513e6592cd83457b8ff461b0e5e1fd40/users/f646147bdad8476ba0ab9da5d9c50b55/roles/9a5640186d0940658e691be68ccf9205 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:03:46.014590 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa27443-bd45-42c8-a191-7128cc39a16c None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:46.015140 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa27443-bd45-42c8-a191-7128cc39a16c None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:46.015230 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa27443-bd45-42c8-a191-7128cc39a16c None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:46.016616 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 609/1233] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:03:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:03:46.021794 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9779b5-4d96-4853-9620-3671afac68da None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:46.022194 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9779b5-4d96-4853-9620-3671afac68da None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:46.022355 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9779b5-4d96-4853-9620-3671afac68da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:46.039176 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-fc9779b5-4d96-4853-9620-3671afac68da None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:03:46.040394 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-fc9779b5-4d96-4853-9620-3671afac68da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:03:46.104772 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 625/1234] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:03:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:03:46.127881 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa27443-bd45-42c8-a191-7128cc39a16c None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:46.223683 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa27443-bd45-42c8-a191-7128cc39a16c None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:46.257247 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8212e1-9123-478b-b0a1-323d14d3eab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:46.258034 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8212e1-9123-478b-b0a1-323d14d3eab9 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:46.258317 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8212e1-9123-478b-b0a1-323d14d3eab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:46.258593 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8212e1-9123-478b-b0a1-323d14d3eab9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:46.271275 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8212e1-9123-478b-b0a1-323d14d3eab9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:03:46.276178 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-ba8212e1-9123-478b-b0a1-323d14d3eab9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 03:03:46.276178 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:03:46.276178 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:03:46.276178 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:03:46.276178 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:03:46.276178 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:03:46.276178 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:03:46.276178 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:03:46.276178 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:03:46.276178 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:03:46.276178 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:03:46.276178 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:03:46.276178 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:03:46.276178 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:03:46.276178 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:03:46.276178 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:03:46.277280 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:03:46.277280 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:03:46.277280 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:03:46.277280 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:03:46.277280 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:03:46.277280 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:03:46.277280 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:03:46.277280 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:03:46.277280 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:03:46.277280 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:03:46.277280 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:03:46.277280 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:03:46.277280 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:03:46.277280 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:03:46.277280 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:03:46.277280 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:03:46.278163 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:03:46.278163 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:03:46.278163 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:03:46.278163 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:03:46.278163 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:03:46.278163 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:03:46.278163 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:03:46.278163 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:03:46.278163 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:03:46.278163 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:03:46.278163 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 03:03:46.278163 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:03:46.278163 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 610/1235] 10.222.0.65 () {56 vars in 1102 bytes} [Tue May 10 03:03:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:03:46.283869 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9779b5-4d96-4853-9620-3671afac68da None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:46.380342 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9779b5-4d96-4853-9620-3671afac68da None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:46.414323 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc2a12-0a17-4094-9257-2c3437cae843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:46.414985 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc2a12-0a17-4094-9257-2c3437cae843 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:46.415268 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc2a12-0a17-4094-9257-2c3437cae843 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:46.415543 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc2a12-0a17-4094-9257-2c3437cae843 None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:46.416314 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc2a12-0a17-4094-9257-2c3437cae843 None admin] RBAC: Adding query filter params (name=service) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:03:46.416618 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc2a12-0a17-4094-9257-2c3437cae843 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:03:46.418021 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc2a12-0a17-4094-9257-2c3437cae843 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:03:46.426185 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 626/1236] 10.222.0.65 () {56 vars in 1103 bytes} [Tue May 10 03:03:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:03:46.431937 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8212e1-9123-478b-b0a1-323d14d3eab9 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:46.528231 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8212e1-9123-478b-b0a1-323d14d3eab9 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:46.561456 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7814344-758d-4fbe-85bc-f485aea6fc99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:46.562835 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7814344-758d-4fbe-85bc-f485aea6fc99 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:46.563121 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7814344-758d-4fbe-85bc-f485aea6fc99 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:46.563401 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7814344-758d-4fbe-85bc-f485aea6fc99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:46.573792 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7814344-758d-4fbe-85bc-f485aea6fc99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:03:46.575279 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7814344-758d-4fbe-85bc-f485aea6fc99 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:03:46.591743 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-c7814344-758d-4fbe-85bc-f485aea6fc99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:03:46.591743 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:03:46.591743 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:03:46.591743 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:03:46.591743 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:03:46.591743 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:03:46.591743 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:03:46.591743 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:03:46.591743 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:03:46.591743 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:03:46.591743 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:03:46.591743 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:03:46.591743 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:03:46.591743 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:03:46.591743 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:03:46.596238 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:03:46.596238 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:03:46.596238 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:03:46.596238 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:03:46.596238 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:03:46.596238 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:03:46.596238 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:03:46.596238 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:03:46.596238 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:03:46.596238 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:03:46.596238 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:03:46.596238 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:03:46.596238 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:03:46.596238 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:03:46.596238 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:03:46.596238 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:03:46.596238 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:03:46.597370 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:03:46.597370 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:03:46.597370 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:03:46.597370 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:03:46.597370 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 611/1237] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:03:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:03:46.598832 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc2a12-0a17-4094-9257-2c3437cae843 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:46.692227 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc2a12-0a17-4094-9257-2c3437cae843 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:46.724820 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e75551-d1ff-47d7-a323-98a8a40deceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:46.726982 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e75551-d1ff-47d7-a323-98a8a40deceb None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:46.726982 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e75551-d1ff-47d7-a323-98a8a40deceb None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:46.726982 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e75551-d1ff-47d7-a323-98a8a40deceb None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:46.726982 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e75551-d1ff-47d7-a323-98a8a40deceb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:03:46.727366 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e75551-d1ff-47d7-a323-98a8a40deceb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:03:46.728457 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e75551-d1ff-47d7-a323-98a8a40deceb None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:03:46.740330 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 627/1238] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:03:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:03:46.746004 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7814344-758d-4fbe-85bc-f485aea6fc99 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:46.847370 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7814344-758d-4fbe-85bc-f485aea6fc99 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:46.880359 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04fe018-8f7b-4229-bb74-2718d71f46c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:46.881170 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04fe018-8f7b-4229-bb74-2718d71f46c4 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:46.881454 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04fe018-8f7b-4229-bb74-2718d71f46c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:46.881732 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04fe018-8f7b-4229-bb74-2718d71f46c4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:46.889078 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04fe018-8f7b-4229-bb74-2718d71f46c4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:03:46.890552 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04fe018-8f7b-4229-bb74-2718d71f46c4 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:03:46.904582 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-e04fe018-8f7b-4229-bb74-2718d71f46c4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 03:03:46.904582 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:03:46.904582 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:03:46.904582 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:03:46.904582 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:03:46.904582 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:03:46.904582 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:03:46.904582 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:03:46.904582 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:03:46.904582 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:03:46.904582 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:03:46.904582 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:03:46.904582 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:03:46.904582 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:03:46.904582 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:03:46.904582 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:03:46.906131 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:03:46.906131 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:03:46.906131 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:03:46.906131 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:03:46.906131 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:03:46.906131 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:03:46.906131 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:03:46.906131 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:03:46.906131 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:03:46.906131 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:03:46.906131 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:03:46.906131 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:03:46.906131 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:03:46.906131 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:03:46.906131 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:03:46.906131 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:03:46.906131 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:03:46.906131 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:03:46.907416 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:03:46.907416 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:03:46.907416 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:03:46.907416 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:03:46.907416 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:03:46.907416 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:03:46.907416 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:03:46.907416 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:03:46.907416 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 03:03:46.907416 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:03:46.907416 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 612/1239] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:03:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:03:46.912124 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e75551-d1ff-47d7-a323-98a8a40deceb None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:47.010359 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e75551-d1ff-47d7-a323-98a8a40deceb None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:47.043894 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a5192-16c0-47fb-a74c-079e1ba45959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:47.044591 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a5192-16c0-47fb-a74c-079e1ba45959 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:47.044874 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a5192-16c0-47fb-a74c-079e1ba45959 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:47.045148 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a5192-16c0-47fb-a74c-079e1ba45959 None admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:47.046607 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8a5192-16c0-47fb-a74c-079e1ba45959 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:03:47.046918 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8a5192-16c0-47fb-a74c-079e1ba45959 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:03:47.048359 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8a5192-16c0-47fb-a74c-079e1ba45959 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:03:47.064666 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 628/1240] 10.222.0.65 () {56 vars in 1143 bytes} [Tue May 10 03:03:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:03:47.070410 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04fe018-8f7b-4229-bb74-2718d71f46c4 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:47.167631 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04fe018-8f7b-4229-bb74-2718d71f46c4 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:47.199305 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9744d1-c8d5-444b-8374-602042b1cc20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:47.199943 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9744d1-c8d5-444b-8374-602042b1cc20 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:47.200252 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9744d1-c8d5-444b-8374-602042b1cc20 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:47.200531 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9744d1-c8d5-444b-8374-602042b1cc20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:47.264120 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9744d1-c8d5-444b-8374-602042b1cc20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:03:47.266082 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9744d1-c8d5-444b-8374-602042b1cc20 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:03:47.359251 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 613/1241] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 10 03:03:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 03:03:47.364982 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a5192-16c0-47fb-a74c-079e1ba45959 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:47.458707 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a5192-16c0-47fb-a74c-079e1ba45959 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:47.490777 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb133ff8-dfe8-4d9b-875b-08c0466d183e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:47.491544 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb133ff8-dfe8-4d9b-875b-08c0466d183e None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:47.491820 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb133ff8-dfe8-4d9b-875b-08c0466d183e None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:47.492120 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb133ff8-dfe8-4d9b-875b-08c0466d183e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:47.502036 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb133ff8-dfe8-4d9b-875b-08c0466d183e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:03:47.504756 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb133ff8-dfe8-4d9b-875b-08c0466d183e None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:03:47.520562 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-eb133ff8-dfe8-4d9b-875b-08c0466d183e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:03:47.520562 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:03:47.520562 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:03:47.520562 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:03:47.520562 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:03:47.520562 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:03:47.520562 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:03:47.520562 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:03:47.520562 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:03:47.520562 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:03:47.520562 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:03:47.520562 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:03:47.520562 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:03:47.520562 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:03:47.520562 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:03:47.521625 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:03:47.521625 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:03:47.521625 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:03:47.521625 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:03:47.521625 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:03:47.521625 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:03:47.521625 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:03:47.521625 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:03:47.521625 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:03:47.521625 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:03:47.521625 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:03:47.521625 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:03:47.521625 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:03:47.521625 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:03:47.521625 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:03:47.521625 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:03:47.521625 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:03:47.522724 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:03:47.522724 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:03:47.522724 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:03:47.522724 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:03:47.522724 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 629/1242] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:03:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:03:47.527379 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9744d1-c8d5-444b-8374-602042b1cc20 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:47.621537 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9744d1-c8d5-444b-8374-602042b1cc20 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:47.654891 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da112439-6c72-4fd9-acaa-19ba28156f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:47.655813 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da112439-6c72-4fd9-acaa-19ba28156f64 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:47.656129 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da112439-6c72-4fd9-acaa-19ba28156f64 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:47.656408 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da112439-6c72-4fd9-acaa-19ba28156f64 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:47.657121 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da112439-6c72-4fd9-acaa-19ba28156f64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:03:47.657431 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da112439-6c72-4fd9-acaa-19ba28156f64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:03:47.658799 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da112439-6c72-4fd9-acaa-19ba28156f64 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:03:47.669510 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 614/1243] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:03:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:03:47.675268 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb133ff8-dfe8-4d9b-875b-08c0466d183e None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:47.771146 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb133ff8-dfe8-4d9b-875b-08c0466d183e None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:47.803079 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abf71b0-efeb-4e9c-aa12-1a9842660548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:47.803872 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf71b0-efeb-4e9c-aa12-1a9842660548 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:47.804173 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf71b0-efeb-4e9c-aa12-1a9842660548 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:47.804454 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf71b0-efeb-4e9c-aa12-1a9842660548 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:47.811106 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abf71b0-efeb-4e9c-aa12-1a9842660548 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:03:47.813183 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abf71b0-efeb-4e9c-aa12-1a9842660548 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:03:47.826673 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-1abf71b0-efeb-4e9c-aa12-1a9842660548 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:03:47.826673 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:03:47.826673 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:03:47.826673 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:03:47.826673 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:03:47.826673 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:03:47.826673 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:03:47.826673 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:03:47.826673 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:03:47.826673 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:03:47.826673 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:03:47.826673 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:03:47.826673 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:03:47.826673 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:03:47.826673 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:03:47.828285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:03:47.828285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:03:47.828285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:03:47.828285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:03:47.828285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:03:47.828285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:03:47.828285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:03:47.828285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:03:47.828285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:03:47.828285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:03:47.828285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:03:47.828285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:03:47.828285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:03:47.828285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:03:47.828285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:03:47.828285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:03:47.828285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:03:47.836587 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:03:47.836587 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:03:47.836587 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:03:47.836587 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:03:47.836587 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:03:47.836587 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:03:47.836587 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:03:47.836587 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:03:47.836587 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 630/1244] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 10 03:03:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:03:47.837254 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da112439-6c72-4fd9-acaa-19ba28156f64 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:47.928869 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da112439-6c72-4fd9-acaa-19ba28156f64 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:47.961091 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd189d-ad79-4267-ad94-0a6d0530f039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:47.961743 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd189d-ad79-4267-ad94-0a6d0530f039 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:47.962032 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd189d-ad79-4267-ad94-0a6d0530f039 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:47.962308 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd189d-ad79-4267-ad94-0a6d0530f039 None admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:47.963082 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dd189d-ad79-4267-ad94-0a6d0530f039 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:03:47.963394 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dd189d-ad79-4267-ad94-0a6d0530f039 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:03:47.964852 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dd189d-ad79-4267-ad94-0a6d0530f039 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:03:47.976283 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 615/1245] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 10 03:03:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:03:47.982491 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abf71b0-efeb-4e9c-aa12-1a9842660548 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:48.082918 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abf71b0-efeb-4e9c-aa12-1a9842660548 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:48.114327 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0983776b-156e-4df1-a9b9-e434296882d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:48.114979 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983776b-156e-4df1-a9b9-e434296882d4 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:48.115263 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983776b-156e-4df1-a9b9-e434296882d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:48.115542 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983776b-156e-4df1-a9b9-e434296882d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:48.116403 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0983776b-156e-4df1-a9b9-e434296882d4 None admin] RBAC: Adding query filter params (role.id=9a5640186d0940658e691be68ccf9205, scope.project.id=513e6592cd83457b8ff461b0e5e1fd40, user.id=f646147bdad8476ba0ab9da5d9c50b55) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:03:48.116717 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0983776b-156e-4df1-a9b9-e434296882d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:03:48.118128 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0983776b-156e-4df1-a9b9-e434296882d4 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:03:48.123684 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 631/1246] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 10 03:03:47 2022] GET /identity/v3/role_assignments?user.id=f646147bdad8476ba0ab9da5d9c50b55&scope.project.id=513e6592cd83457b8ff461b0e5e1fd40&role.id=9a5640186d0940658e691be68ccf9205 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:03:50.372023 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2876869-4ac3-49e8-a33b-013573883d35 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:50.372576 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2876869-4ac3-49e8-a33b-013573883d35 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:50.372576 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2876869-4ac3-49e8-a33b-013573883d35 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:50.373946 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 616/1247] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:03:50.383858 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9f50e-f9b6-423f-b079-33f5600bee40 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:50.384422 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9f50e-f9b6-423f-b079-33f5600bee40 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:50.384926 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9f50e-f9b6-423f-b079-33f5600bee40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:50.404738 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-3bb9f50e-f9b6-423f-b079-33f5600bee40 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:03:50.406647 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-3bb9f50e-f9b6-423f-b079-33f5600bee40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:03:50.469817 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 632/1248] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:03:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:03:50.493792 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2876869-4ac3-49e8-a33b-013573883d35 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:50.594796 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2876869-4ac3-49e8-a33b-013573883d35 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:50.627009 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d453b7-beea-4eb5-83a5-1a314fbff6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:50.627741 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d453b7-beea-4eb5-83a5-1a314fbff6df None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:50.628045 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d453b7-beea-4eb5-83a5-1a314fbff6df None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:50.628326 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d453b7-beea-4eb5-83a5-1a314fbff6df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:50.638066 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d453b7-beea-4eb5-83a5-1a314fbff6df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:03:50.646227 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-f6d453b7-beea-4eb5-83a5-1a314fbff6df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:03:50.646227 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:03:50.646227 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:03:50.646227 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:03:50.646227 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:03:50.646227 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:03:50.646227 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:03:50.646227 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:03:50.646227 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:03:50.646227 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:03:50.646227 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:03:50.646227 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:03:50.646227 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:03:50.646227 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:03:50.646227 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:03:50.646227 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:03:50.653203 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:03:50.653203 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:03:50.653203 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:03:50.653203 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:03:50.653203 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:03:50.653203 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:03:50.653203 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:03:50.653203 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:03:50.653203 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:03:50.653203 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:03:50.653203 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:03:50.653203 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:03:50.653203 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:03:50.653203 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:03:50.653203 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:03:50.653203 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:03:50.654046 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:03:50.654046 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:03:50.654046 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:03:50.654046 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:03:50.654046 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:03:50.654046 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:03:50.654046 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:03:50.654046 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:03:50.654046 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:03:50.654046 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:03:50.654046 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:03:50.654046 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:03:50.654046 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 617/1249] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 10 03:03:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:03:50.654900 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb9f50e-f9b6-423f-b079-33f5600bee40 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:50.753020 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb9f50e-f9b6-423f-b079-33f5600bee40 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:50.786642 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76655480-c3af-46c5-8217-a990a4276dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:50.787306 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76655480-c3af-46c5-8217-a990a4276dd1 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:50.787589 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76655480-c3af-46c5-8217-a990a4276dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:50.787863 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76655480-c3af-46c5-8217-a990a4276dd1 None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:50.788645 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76655480-c3af-46c5-8217-a990a4276dd1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:03:50.788947 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76655480-c3af-46c5-8217-a990a4276dd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:03:50.790300 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76655480-c3af-46c5-8217-a990a4276dd1 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:03:50.798289 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 633/1250] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 10 03:03:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:03:50.803981 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d453b7-beea-4eb5-83a5-1a314fbff6df None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:50.899817 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d453b7-beea-4eb5-83a5-1a314fbff6df None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:50.932141 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3136e955-6c50-4609-9ab4-e55e16e7d62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:50.932923 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136e955-6c50-4609-9ab4-e55e16e7d62b None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:50.933202 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136e955-6c50-4609-9ab4-e55e16e7d62b None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:50.933473 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136e955-6c50-4609-9ab4-e55e16e7d62b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:50.944281 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3136e955-6c50-4609-9ab4-e55e16e7d62b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:03:50.945757 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3136e955-6c50-4609-9ab4-e55e16e7d62b None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:03:50.962644 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-3136e955-6c50-4609-9ab4-e55e16e7d62b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:03:50.962644 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:03:50.962644 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:03:50.962644 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:03:50.962644 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:03:50.962644 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:03:50.962644 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:03:50.962644 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:03:50.962644 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:03:50.962644 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:03:50.962644 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:03:50.962644 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:03:50.962644 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:03:50.962644 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:03:50.962644 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:03:50.963723 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:03:50.963723 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:03:50.963723 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:03:50.963723 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:03:50.963723 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:03:50.963723 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:03:50.963723 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:03:50.963723 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:03:50.963723 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:03:50.963723 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:03:50.963723 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:03:50.963723 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:03:50.963723 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:03:50.963723 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:03:50.963723 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:03:50.963723 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:03:50.963723 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:03:50.965043 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:03:50.965043 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:03:50.965043 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:03:50.965043 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:03:50.965043 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 618/1251] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:03:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:03:50.969607 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76655480-c3af-46c5-8217-a990a4276dd1 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:51.064889 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76655480-c3af-46c5-8217-a990a4276dd1 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:51.101618 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4795f6d-4a4d-4463-bfea-d9157f616932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:51.102292 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4795f6d-4a4d-4463-bfea-d9157f616932 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:51.102578 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4795f6d-4a4d-4463-bfea-d9157f616932 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:51.102854 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4795f6d-4a4d-4463-bfea-d9157f616932 None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:51.103588 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4795f6d-4a4d-4463-bfea-d9157f616932 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:03:51.103897 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4795f6d-4a4d-4463-bfea-d9157f616932 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:03:51.105288 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4795f6d-4a4d-4463-bfea-d9157f616932 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:03:51.117232 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 634/1252] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:03:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:03:51.123259 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3136e955-6c50-4609-9ab4-e55e16e7d62b None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:51.221638 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3136e955-6c50-4609-9ab4-e55e16e7d62b None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:51.253458 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f6e1ee-fc95-4251-bdbc-65b11d37f10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:51.254238 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6e1ee-fc95-4251-bdbc-65b11d37f10a None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:51.254520 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6e1ee-fc95-4251-bdbc-65b11d37f10a None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:51.254793 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6e1ee-fc95-4251-bdbc-65b11d37f10a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:51.261986 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f6e1ee-fc95-4251-bdbc-65b11d37f10a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:03:51.263422 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f6e1ee-fc95-4251-bdbc-65b11d37f10a None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:03:51.278152 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-e6f6e1ee-fc95-4251-bdbc-65b11d37f10a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 03:03:51.278152 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:03:51.278152 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:03:51.278152 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:03:51.278152 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:03:51.278152 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:03:51.278152 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:03:51.278152 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:03:51.278152 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:03:51.278152 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:03:51.278152 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:03:51.278152 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:03:51.278152 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:03:51.278152 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:03:51.278152 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:03:51.278152 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:03:51.279239 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:03:51.279239 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:03:51.279239 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:03:51.279239 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:03:51.279239 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:03:51.279239 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:03:51.279239 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:03:51.279239 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:03:51.279239 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:03:51.279239 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:03:51.279239 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:03:51.279239 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:03:51.279239 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:03:51.279239 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:03:51.279239 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:03:51.279239 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:03:51.279239 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:03:51.279239 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:03:51.280344 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:03:51.280344 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:03:51.280344 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:03:51.280344 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:03:51.280344 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:03:51.280344 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:03:51.280344 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:03:51.280344 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:03:51.280344 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 03:03:51.280344 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:03:51.280344 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 619/1253] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:03:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:03:51.285525 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4795f6d-4a4d-4463-bfea-d9157f616932 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:51.378931 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4795f6d-4a4d-4463-bfea-d9157f616932 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:51.411995 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e05bf-2960-4be4-a056-c490fcc8c42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:51.412691 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e05bf-2960-4be4-a056-c490fcc8c42c None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:51.412972 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e05bf-2960-4be4-a056-c490fcc8c42c None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:51.413247 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e05bf-2960-4be4-a056-c490fcc8c42c None admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:51.414083 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e05bf-2960-4be4-a056-c490fcc8c42c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:03:51.414391 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e05bf-2960-4be4-a056-c490fcc8c42c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:03:51.415833 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e05bf-2960-4be4-a056-c490fcc8c42c None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:03:51.442330 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 635/1254] 10.222.0.65 () {56 vars in 1143 bytes} [Tue May 10 03:03:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:03:51.448024 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f6e1ee-fc95-4251-bdbc-65b11d37f10a None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:51.547588 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f6e1ee-fc95-4251-bdbc-65b11d37f10a None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:51.579585 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f65d8a5-3edc-4832-96ab-12a7358a1767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:51.580205 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f65d8a5-3edc-4832-96ab-12a7358a1767 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:51.580494 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f65d8a5-3edc-4832-96ab-12a7358a1767 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:51.580769 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f65d8a5-3edc-4832-96ab-12a7358a1767 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:51.644284 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f65d8a5-3edc-4832-96ab-12a7358a1767 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:03:51.645735 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f65d8a5-3edc-4832-96ab-12a7358a1767 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:03:51.739056 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 620/1255] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 10 03:03:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 03:03:51.744937 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e05bf-2960-4be4-a056-c490fcc8c42c None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:51.839756 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e05bf-2960-4be4-a056-c490fcc8c42c None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:51.872567 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d35a3d2-45c8-4de8-8491-d798613359e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:51.873388 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35a3d2-45c8-4de8-8491-d798613359e9 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:51.873673 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35a3d2-45c8-4de8-8491-d798613359e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:51.873949 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35a3d2-45c8-4de8-8491-d798613359e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:51.883710 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d35a3d2-45c8-4de8-8491-d798613359e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:03:51.885171 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d35a3d2-45c8-4de8-8491-d798613359e9 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:03:51.901891 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-2d35a3d2-45c8-4de8-8491-d798613359e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:03:51.901891 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:03:51.901891 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:03:51.901891 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:03:51.901891 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:03:51.901891 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:03:51.901891 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:03:51.901891 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:03:51.901891 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:03:51.901891 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:03:51.901891 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:03:51.901891 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:03:51.901891 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:03:51.901891 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:03:51.901891 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:03:51.903039 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:03:51.903039 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:03:51.903039 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:03:51.903039 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:03:51.903039 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:03:51.903039 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:03:51.903039 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:03:51.903039 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:03:51.903039 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:03:51.903039 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:03:51.903039 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:03:51.903039 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:03:51.903039 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:03:51.903039 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:03:51.903039 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:03:51.903039 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:03:51.903039 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:03:51.908993 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:03:51.908993 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:03:51.908993 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:03:51.908993 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:03:51.908993 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 636/1256] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:03:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:03:51.909620 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f65d8a5-3edc-4832-96ab-12a7358a1767 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:52.005165 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f65d8a5-3edc-4832-96ab-12a7358a1767 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:52.038902 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a13286-6090-420a-b2ee-0e4eb7e5e970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:52.039558 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a13286-6090-420a-b2ee-0e4eb7e5e970 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:52.039843 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a13286-6090-420a-b2ee-0e4eb7e5e970 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:52.040155 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a13286-6090-420a-b2ee-0e4eb7e5e970 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:52.040877 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a13286-6090-420a-b2ee-0e4eb7e5e970 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:03:52.041228 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a13286-6090-420a-b2ee-0e4eb7e5e970 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:03:52.046708 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a13286-6090-420a-b2ee-0e4eb7e5e970 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:03:52.061680 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 621/1257] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:03:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:03:52.067241 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d35a3d2-45c8-4de8-8491-d798613359e9 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:52.163335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d35a3d2-45c8-4de8-8491-d798613359e9 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:52.195908 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed6924-ff89-4822-8deb-8f8e8764948d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:52.196722 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed6924-ff89-4822-8deb-8f8e8764948d None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:52.197007 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed6924-ff89-4822-8deb-8f8e8764948d None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:52.197283 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed6924-ff89-4822-8deb-8f8e8764948d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:52.204860 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eed6924-ff89-4822-8deb-8f8e8764948d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:03:52.207244 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eed6924-ff89-4822-8deb-8f8e8764948d None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:03:52.220688 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-2eed6924-ff89-4822-8deb-8f8e8764948d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:03:52.220688 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:03:52.220688 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:03:52.220688 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:03:52.220688 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:03:52.220688 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:03:52.220688 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:03:52.220688 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:03:52.220688 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:03:52.220688 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:03:52.220688 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:03:52.220688 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:03:52.220688 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:03:52.220688 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:03:52.220688 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:03:52.221754 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:03:52.221754 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:03:52.221754 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:03:52.221754 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:03:52.221754 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:03:52.221754 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:03:52.221754 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:03:52.221754 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:03:52.221754 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:03:52.221754 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:03:52.221754 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:03:52.221754 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:03:52.221754 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:03:52.221754 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:03:52.221754 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:03:52.221754 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:03:52.221754 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:03:52.222851 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:03:52.222851 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:03:52.222851 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:03:52.222851 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:03:52.222851 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:03:52.222851 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:03:52.222851 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:03:52.222851 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:03:52.222851 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 637/1258] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 10 03:03:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:03:52.227724 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a13286-6090-420a-b2ee-0e4eb7e5e970 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:52.323299 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a13286-6090-420a-b2ee-0e4eb7e5e970 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:52.355906 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f33ce2-362c-4285-8f58-20dc40d0109a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:52.356676 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f33ce2-362c-4285-8f58-20dc40d0109a None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:52.356962 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f33ce2-362c-4285-8f58-20dc40d0109a None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:52.357238 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f33ce2-362c-4285-8f58-20dc40d0109a None admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:52.358021 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f33ce2-362c-4285-8f58-20dc40d0109a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:03:52.358327 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f33ce2-362c-4285-8f58-20dc40d0109a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:03:52.359756 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f33ce2-362c-4285-8f58-20dc40d0109a None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:03:52.371623 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 622/1259] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 10 03:03:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:03:52.377677 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed6924-ff89-4822-8deb-8f8e8764948d None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:52.477560 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed6924-ff89-4822-8deb-8f8e8764948d None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:52.509874 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7f5b84-1077-4340-b44d-a73be83d7fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:52.510528 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f5b84-1077-4340-b44d-a73be83d7fac None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:52.510813 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f5b84-1077-4340-b44d-a73be83d7fac None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:52.511092 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f5b84-1077-4340-b44d-a73be83d7fac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:52.511918 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7f5b84-1077-4340-b44d-a73be83d7fac None admin] RBAC: Adding query filter params (role.id=43105000610f402ca2486e7648018cca, scope.project.id=513e6592cd83457b8ff461b0e5e1fd40, user.id=f646147bdad8476ba0ab9da5d9c50b55) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:03:52.512260 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7f5b84-1077-4340-b44d-a73be83d7fac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:03:52.513675 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7f5b84-1077-4340-b44d-a73be83d7fac None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:03:52.519472 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 638/1260] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 10 03:03:52 2022] GET /identity/v3/role_assignments?user.id=f646147bdad8476ba0ab9da5d9c50b55&scope.project.id=513e6592cd83457b8ff461b0e5e1fd40&role.id=43105000610f402ca2486e7648018cca => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:03:54.688154 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4fc63-cc12-4385-8aaa-752bf620f7a2 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:54.688667 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4fc63-cc12-4385-8aaa-752bf620f7a2 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:54.688758 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4fc63-cc12-4385-8aaa-752bf620f7a2 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:54.690138 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 623/1261] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:03:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:03:54.695258 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194ce0a-20a5-45ae-b2cc-4493bd1b0c42 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:54.695654 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194ce0a-20a5-45ae-b2cc-4493bd1b0c42 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:54.695818 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194ce0a-20a5-45ae-b2cc-4493bd1b0c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:54.714353 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-5194ce0a-20a5-45ae-b2cc-4493bd1b0c42 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:03:54.714353 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-5194ce0a-20a5-45ae-b2cc-4493bd1b0c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:03:54.775962 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 639/1262] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:03:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:03:54.800075 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd4fc63-cc12-4385-8aaa-752bf620f7a2 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:54.895185 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd4fc63-cc12-4385-8aaa-752bf620f7a2 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:54.928100 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41db1ace-fb4d-4c49-a948-c1fe0621de8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:54.928880 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db1ace-fb4d-4c49-a948-c1fe0621de8a None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:54.929162 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db1ace-fb4d-4c49-a948-c1fe0621de8a None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:54.929438 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db1ace-fb4d-4c49-a948-c1fe0621de8a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:54.938983 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41db1ace-fb4d-4c49-a948-c1fe0621de8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:03:54.946640 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-41db1ace-fb4d-4c49-a948-c1fe0621de8a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:03:54.946640 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:03:54.946640 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:03:54.946640 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:03:54.946640 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:03:54.946640 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:03:54.946640 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:03:54.946640 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:03:54.946640 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:03:54.946640 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:03:54.946640 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:03:54.946640 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:03:54.946640 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:03:54.946640 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:03:54.946640 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:03:54.946640 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:03:54.951957 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:03:54.951957 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:03:54.951957 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:03:54.951957 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:03:54.951957 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:03:54.951957 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:03:54.951957 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:03:54.951957 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:03:54.951957 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:03:54.951957 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:03:54.951957 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:03:54.951957 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:03:54.951957 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:03:54.951957 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:03:54.951957 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:03:54.951957 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:03:54.953219 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:03:54.953219 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:03:54.953219 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:03:54.953219 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:03:54.953219 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:03:54.953219 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:03:54.953219 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:03:54.953219 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:03:54.953219 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:03:54.953219 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:03:54.953219 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:03:54.953219 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:03:54.953219 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 624/1263] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 10 03:03:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:03:54.953975 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5194ce0a-20a5-45ae-b2cc-4493bd1b0c42 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:55.048357 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5194ce0a-20a5-45ae-b2cc-4493bd1b0c42 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:55.080949 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a658664-96a4-41eb-aca7-e13ae1db2ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:55.106018 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a658664-96a4-41eb-aca7-e13ae1db2ba8 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:55.106018 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a658664-96a4-41eb-aca7-e13ae1db2ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:55.106018 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a658664-96a4-41eb-aca7-e13ae1db2ba8 None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:55.106018 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a658664-96a4-41eb-aca7-e13ae1db2ba8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:03:55.106018 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a658664-96a4-41eb-aca7-e13ae1db2ba8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:03:55.106018 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a658664-96a4-41eb-aca7-e13ae1db2ba8 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:03:55.106571 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 640/1264] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 10 03:03:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:03:55.106663 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41db1ace-fb4d-4c49-a948-c1fe0621de8a None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:55.193285 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41db1ace-fb4d-4c49-a948-c1fe0621de8a None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:55.226237 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51150656-0b99-4f43-b514-858ee473a52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:55.227023 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51150656-0b99-4f43-b514-858ee473a52b None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:55.227309 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51150656-0b99-4f43-b514-858ee473a52b None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:55.227586 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51150656-0b99-4f43-b514-858ee473a52b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:55.237742 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51150656-0b99-4f43-b514-858ee473a52b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:03:55.239180 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51150656-0b99-4f43-b514-858ee473a52b None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:03:55.255547 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-51150656-0b99-4f43-b514-858ee473a52b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:03:55.255547 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:03:55.255547 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:03:55.255547 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:03:55.255547 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:03:55.255547 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:03:55.255547 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:03:55.255547 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:03:55.255547 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:03:55.255547 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:03:55.255547 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:03:55.255547 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:03:55.255547 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:03:55.255547 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:03:55.255547 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:03:55.256700 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:03:55.256700 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:03:55.256700 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:03:55.256700 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:03:55.256700 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:03:55.256700 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:03:55.256700 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:03:55.256700 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:03:55.256700 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:03:55.256700 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:03:55.256700 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:03:55.256700 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:03:55.256700 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:03:55.256700 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:03:55.256700 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:03:55.256700 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:03:55.256700 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:03:55.257738 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:03:55.257738 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:03:55.257738 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:03:55.257738 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:03:55.257738 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 625/1265] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:03:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:03:55.262549 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a658664-96a4-41eb-aca7-e13ae1db2ba8 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:55.356366 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a658664-96a4-41eb-aca7-e13ae1db2ba8 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:55.387355 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d268769-7b1b-4030-8e07-bf2c8d47debb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:55.388025 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d268769-7b1b-4030-8e07-bf2c8d47debb None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:55.388308 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d268769-7b1b-4030-8e07-bf2c8d47debb None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:55.388580 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d268769-7b1b-4030-8e07-bf2c8d47debb None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:55.389822 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d268769-7b1b-4030-8e07-bf2c8d47debb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:03:55.390126 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d268769-7b1b-4030-8e07-bf2c8d47debb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:03:55.391469 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d268769-7b1b-4030-8e07-bf2c8d47debb None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:03:55.403081 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 641/1266] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:03:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:03:55.409673 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51150656-0b99-4f43-b514-858ee473a52b None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:55.510884 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51150656-0b99-4f43-b514-858ee473a52b None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:55.542944 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3139bf5b-6578-4084-ad7a-9c4794c83f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:55.543738 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3139bf5b-6578-4084-ad7a-9c4794c83f53 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:55.544033 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3139bf5b-6578-4084-ad7a-9c4794c83f53 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:55.544317 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3139bf5b-6578-4084-ad7a-9c4794c83f53 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:55.551465 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3139bf5b-6578-4084-ad7a-9c4794c83f53 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:03:55.552921 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3139bf5b-6578-4084-ad7a-9c4794c83f53 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:03:55.567058 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-3139bf5b-6578-4084-ad7a-9c4794c83f53 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 03:03:55.567058 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:03:55.567058 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:03:55.567058 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:03:55.567058 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:03:55.567058 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:03:55.567058 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:03:55.567058 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:03:55.567058 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:03:55.567058 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:03:55.567058 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:03:55.567058 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:03:55.567058 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:03:55.567058 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:03:55.567058 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:03:55.567058 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:03:55.568298 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:03:55.568298 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:03:55.568298 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:03:55.568298 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:03:55.568298 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:03:55.568298 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:03:55.568298 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:03:55.568298 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:03:55.568298 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:03:55.568298 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:03:55.568298 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:03:55.568298 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:03:55.568298 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:03:55.568298 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:03:55.568298 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:03:55.568298 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:03:55.568298 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:03:55.568298 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:03:55.569260 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:03:55.569260 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:03:55.569260 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:03:55.569260 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:03:55.569260 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:03:55.569260 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:03:55.569260 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:03:55.569260 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:03:55.569260 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 03:03:55.569260 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:03:55.569260 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 626/1267] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:03:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:03:55.574248 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d268769-7b1b-4030-8e07-bf2c8d47debb None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:55.669421 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d268769-7b1b-4030-8e07-bf2c8d47debb None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:55.701016 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd61f648-1684-43f8-b03b-540f14cb7966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:55.701666 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd61f648-1684-43f8-b03b-540f14cb7966 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:55.702509 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd61f648-1684-43f8-b03b-540f14cb7966 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:55.702783 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd61f648-1684-43f8-b03b-540f14cb7966 None admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:55.703607 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd61f648-1684-43f8-b03b-540f14cb7966 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:03:55.703910 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd61f648-1684-43f8-b03b-540f14cb7966 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:03:55.705529 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd61f648-1684-43f8-b03b-540f14cb7966 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:03:55.721520 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 642/1268] 10.222.0.65 () {56 vars in 1143 bytes} [Tue May 10 03:03:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:03:55.727215 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3139bf5b-6578-4084-ad7a-9c4794c83f53 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:55.827263 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3139bf5b-6578-4084-ad7a-9c4794c83f53 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:55.861105 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2e7a08-371b-4e27-bd23-d08f94b9fade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:55.861899 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e7a08-371b-4e27-bd23-d08f94b9fade None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:55.862187 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e7a08-371b-4e27-bd23-d08f94b9fade None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:55.862464 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e7a08-371b-4e27-bd23-d08f94b9fade None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:55.872966 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2e7a08-371b-4e27-bd23-d08f94b9fade None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:03:55.875130 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2e7a08-371b-4e27-bd23-d08f94b9fade None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:03:55.891588 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-6d2e7a08-371b-4e27-bd23-d08f94b9fade None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:03:55.891588 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:03:55.891588 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:03:55.891588 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:03:55.891588 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:03:55.891588 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:03:55.891588 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:03:55.891588 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:03:55.891588 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:03:55.891588 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:03:55.891588 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:03:55.891588 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:03:55.891588 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:03:55.891588 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:03:55.891588 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:03:55.892667 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:03:55.892667 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:03:55.892667 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:03:55.892667 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:03:55.892667 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:03:55.892667 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:03:55.892667 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:03:55.892667 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:03:55.892667 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:03:55.892667 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:03:55.892667 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:03:55.892667 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:03:55.892667 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:03:55.892667 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:03:55.892667 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:03:55.892667 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:03:55.892667 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:03:55.893753 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:03:55.893753 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:03:55.893753 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:03:55.893753 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:03:55.893753 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 627/1269] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:03:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:03:55.898492 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd61f648-1684-43f8-b03b-540f14cb7966 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:55.994275 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd61f648-1684-43f8-b03b-540f14cb7966 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:56.025880 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c1034-ac41-4313-b802-9c87eddfe156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:56.026556 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c1034-ac41-4313-b802-9c87eddfe156 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:56.026836 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c1034-ac41-4313-b802-9c87eddfe156 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:56.027114 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c1034-ac41-4313-b802-9c87eddfe156 None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:56.027823 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680c1034-ac41-4313-b802-9c87eddfe156 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:03:56.028160 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680c1034-ac41-4313-b802-9c87eddfe156 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:03:56.029497 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680c1034-ac41-4313-b802-9c87eddfe156 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:03:56.040360 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 643/1270] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:03:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:03:56.046670 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2e7a08-371b-4e27-bd23-d08f94b9fade None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:56.141891 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2e7a08-371b-4e27-bd23-d08f94b9fade None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:56.175240 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8827fe2b-fc9a-4f91-9517-7ee16197dcee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:56.176151 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827fe2b-fc9a-4f91-9517-7ee16197dcee None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:56.176470 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827fe2b-fc9a-4f91-9517-7ee16197dcee None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:56.176744 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827fe2b-fc9a-4f91-9517-7ee16197dcee None admin] PATH_INFO: `/v3/projects/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:56.183167 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8827fe2b-fc9a-4f91-9517-7ee16197dcee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:03:56.184645 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8827fe2b-fc9a-4f91-9517-7ee16197dcee None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:03:56.198330 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-8827fe2b-fc9a-4f91-9517-7ee16197dcee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:03:56.198330 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:03:56.198330 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:03:56.198330 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:03:56.198330 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:03:56.198330 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:03:56.198330 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:03:56.198330 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:03:56.198330 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:03:56.198330 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:03:56.198330 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:03:56.198330 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:03:56.198330 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:03:56.198330 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:03:56.198330 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:03:56.199399 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:03:56.199399 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:03:56.199399 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:03:56.199399 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:03:56.199399 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:03:56.199399 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:03:56.199399 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:03:56.199399 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:03:56.199399 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:03:56.199399 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:03:56.199399 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:03:56.199399 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:03:56.199399 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:03:56.199399 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:03:56.199399 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:03:56.199399 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:03:56.199399 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:03:56.200610 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:03:56.200610 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:03:56.200610 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:03:56.200610 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:03:56.200610 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:03:56.200610 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:03:56.200610 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:03:56.200610 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:03:56.200610 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 628/1271] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 10 03:03:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:03:56.205437 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c1034-ac41-4313-b802-9c87eddfe156 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:56.301046 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c1034-ac41-4313-b802-9c87eddfe156 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:56.333232 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d04950d-92a2-4969-be9b-158ed8b46056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:56.333898 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04950d-92a2-4969-be9b-158ed8b46056 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:56.334180 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04950d-92a2-4969-be9b-158ed8b46056 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:56.334455 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04950d-92a2-4969-be9b-158ed8b46056 None admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:56.335240 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d04950d-92a2-4969-be9b-158ed8b46056 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:03:56.335549 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d04950d-92a2-4969-be9b-158ed8b46056 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:03:56.337016 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d04950d-92a2-4969-be9b-158ed8b46056 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:03:56.348951 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 644/1272] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 10 03:03:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:03:56.354926 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8827fe2b-fc9a-4f91-9517-7ee16197dcee None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:56.454487 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8827fe2b-fc9a-4f91-9517-7ee16197dcee None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:56.490485 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e143ddc-d259-4dc1-ac4f-25e7a052259f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:56.491375 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e143ddc-d259-4dc1-ac4f-25e7a052259f None admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:56.491683 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e143ddc-d259-4dc1-ac4f-25e7a052259f None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:56.491962 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e143ddc-d259-4dc1-ac4f-25e7a052259f None admin] PATH_INFO: `/v3/projects/513e6592cd83457b8ff461b0e5e1fd40/users/f646147bdad8476ba0ab9da5d9c50b55/roles/43105000610f402ca2486e7648018cca` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:56.493974 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e143ddc-d259-4dc1-ac4f-25e7a052259f None admin] RBAC: Authorizing `identity:create_grant(project_id=513e6592cd83457b8ff461b0e5e1fd40, user_id=f646147bdad8476ba0ab9da5d9c50b55, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:03:56.495407 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e143ddc-d259-4dc1-ac4f-25e7a052259f None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:03:56.581035 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 629/1273] 10.222.0.65 () {58 vars in 1439 bytes} [Tue May 10 03:03:56 2022] PUT /identity/v3/projects/513e6592cd83457b8ff461b0e5e1fd40/users/f646147bdad8476ba0ab9da5d9c50b55/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:03:58.804261 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d12b1-8d3d-4584-84e6-fd756ddbfd84 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:58.804767 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d12b1-8d3d-4584-84e6-fd756ddbfd84 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:58.804767 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d12b1-8d3d-4584-84e6-fd756ddbfd84 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:58.806159 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 645/1274] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:03:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:03:58.811988 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abdfa45-ccfb-460b-9e54-f59c9c9baaf8 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:58.813063 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abdfa45-ccfb-460b-9e54-f59c9c9baaf8 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:58.813063 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abdfa45-ccfb-460b-9e54-f59c9c9baaf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:58.833554 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-1abdfa45-ccfb-460b-9e54-f59c9c9baaf8 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:03:58.834959 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-1abdfa45-ccfb-460b-9e54-f59c9c9baaf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:03:58.899821 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 630/1275] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:03:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:03:58.923899 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d12b1-8d3d-4584-84e6-fd756ddbfd84 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:59.020974 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d12b1-8d3d-4584-84e6-fd756ddbfd84 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:59.053579 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b3aa6-e41d-405c-b9f3-c8a0143c575e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:59.054410 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b3aa6-e41d-405c-b9f3-c8a0143c575e None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:59.054643 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b3aa6-e41d-405c-b9f3-c8a0143c575e None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:59.054916 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b3aa6-e41d-405c-b9f3-c8a0143c575e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:59.064732 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20b3aa6-e41d-405c-b9f3-c8a0143c575e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 03:03:59.072285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-c20b3aa6-e41d-405c-b9f3-c8a0143c575e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:03:59.072285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:03:59.072285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:03:59.072285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:03:59.072285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:03:59.072285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:03:59.072285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:03:59.072285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:03:59.072285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:03:59.072285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:03:59.072285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:03:59.072285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:03:59.072285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 03:03:59.072285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 03:03:59.072285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 03:03:59.072285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 03:03:59.077351 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 03:03:59.077351 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 03:03:59.077351 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 03:03:59.077351 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 03:03:59.077351 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:03:59.077351 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:03:59.077351 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:03:59.077351 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:03:59.077351 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:03:59.077351 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:03:59.077351 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:03:59.077351 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:03:59.077351 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:03:59.077351 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:03:59.077351 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:03:59.077351 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:03:59.078191 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:03:59.078191 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:03:59.078191 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:03:59.078191 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:03:59.078191 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 03:03:59.078191 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 03:03:59.078191 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 03:03:59.078191 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 03:03:59.078191 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 03:03:59.078191 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 03:03:59.078191 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 03:03:59.078191 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:03:59.078191 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 646/1276] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 10 03:03:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:03:59.080163 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abdfa45-ccfb-460b-9e54-f59c9c9baaf8 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:59.177404 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abdfa45-ccfb-460b-9e54-f59c9c9baaf8 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:59.213319 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215cf517-44d4-49f6-b1cd-7896b791532e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:59.213974 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215cf517-44d4-49f6-b1cd-7896b791532e None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:59.214253 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215cf517-44d4-49f6-b1cd-7896b791532e None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:59.214526 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215cf517-44d4-49f6-b1cd-7896b791532e None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:59.215261 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215cf517-44d4-49f6-b1cd-7896b791532e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:03:59.215563 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215cf517-44d4-49f6-b1cd-7896b791532e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:03:59.216948 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215cf517-44d4-49f6-b1cd-7896b791532e None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:03:59.224562 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 631/1277] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 10 03:03:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:03:59.230449 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b3aa6-e41d-405c-b9f3-c8a0143c575e None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:59.325735 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b3aa6-e41d-405c-b9f3-c8a0143c575e None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:59.357811 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6015459-59bd-46a8-bab7-e404a04e5aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:59.359237 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6015459-59bd-46a8-bab7-e404a04e5aef None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:59.359515 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6015459-59bd-46a8-bab7-e404a04e5aef None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:59.359786 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6015459-59bd-46a8-bab7-e404a04e5aef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:59.370035 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6015459-59bd-46a8-bab7-e404a04e5aef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:03:59.371469 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6015459-59bd-46a8-bab7-e404a04e5aef None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:03:59.388824 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-e6015459-59bd-46a8-bab7-e404a04e5aef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:03:59.388824 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:03:59.388824 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:03:59.388824 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:03:59.388824 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:03:59.388824 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:03:59.388824 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:03:59.388824 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:03:59.388824 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:03:59.388824 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:03:59.388824 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:03:59.388824 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:03:59.388824 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:03:59.388824 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:03:59.388824 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:03:59.391020 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:03:59.391020 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:03:59.391020 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:03:59.391020 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:03:59.391020 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:03:59.391020 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:03:59.391020 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:03:59.391020 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:03:59.391020 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:03:59.391020 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:03:59.391020 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:03:59.391020 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:03:59.391020 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:03:59.391020 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:03:59.391020 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:03:59.391020 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:03:59.391020 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:03:59.392732 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:03:59.392732 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:03:59.392732 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:03:59.392732 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:03:59.392732 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 647/1278] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:03:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:03:59.396408 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215cf517-44d4-49f6-b1cd-7896b791532e None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:59.496630 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215cf517-44d4-49f6-b1cd-7896b791532e None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:59.529080 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b1a52f-6739-4cf4-8246-acef2dce954e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:59.529774 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1a52f-6739-4cf4-8246-acef2dce954e None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:59.530055 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1a52f-6739-4cf4-8246-acef2dce954e None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:59.530333 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1a52f-6739-4cf4-8246-acef2dce954e None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:59.531300 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b1a52f-6739-4cf4-8246-acef2dce954e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:03:59.531606 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b1a52f-6739-4cf4-8246-acef2dce954e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:03:59.533005 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b1a52f-6739-4cf4-8246-acef2dce954e None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:03:59.548390 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 632/1279] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:03:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:03:59.550368 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6015459-59bd-46a8-bab7-e404a04e5aef None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:59.645066 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6015459-59bd-46a8-bab7-e404a04e5aef None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:59.677181 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4771d393-2da7-4308-b372-df5d47ce1a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:59.677969 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771d393-2da7-4308-b372-df5d47ce1a86 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:59.678255 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771d393-2da7-4308-b372-df5d47ce1a86 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:59.678530 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771d393-2da7-4308-b372-df5d47ce1a86 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:59.685634 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4771d393-2da7-4308-b372-df5d47ce1a86 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:03:59.687709 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4771d393-2da7-4308-b372-df5d47ce1a86 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:03:59.701579 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-4771d393-2da7-4308-b372-df5d47ce1a86 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 03:03:59.701579 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:03:59.701579 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:03:59.701579 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:03:59.701579 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:03:59.701579 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:03:59.701579 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:03:59.701579 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:03:59.701579 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:03:59.701579 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:03:59.701579 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:03:59.701579 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:03:59.701579 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 03:03:59.701579 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 03:03:59.701579 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 03:03:59.701579 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 03:03:59.702700 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:03:59.702700 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:03:59.702700 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 03:03:59.702700 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:03:59.702700 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 03:03:59.702700 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 03:03:59.702700 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:03:59.702700 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:03:59.702700 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:03:59.702700 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:03:59.702700 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:03:59.702700 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:03:59.702700 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:03:59.702700 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:03:59.702700 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:03:59.702700 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:03:59.702700 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:03:59.702700 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:03:59.703761 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:03:59.703761 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:03:59.703761 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 03:03:59.703761 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 03:03:59.703761 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 03:03:59.703761 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 03:03:59.703761 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 03:03:59.703761 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 03:03:59.703761 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 03:03:59.703761 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:03:59.703761 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 648/1280] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:03:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:03:59.708553 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b1a52f-6739-4cf4-8246-acef2dce954e None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:59.804158 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b1a52f-6739-4cf4-8246-acef2dce954e None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:59.836694 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e7124f-87f4-4ce1-bac9-21f1bbf1b909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:59.837361 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7124f-87f4-4ce1-bac9-21f1bbf1b909 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:59.837646 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7124f-87f4-4ce1-bac9-21f1bbf1b909 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:59.837926 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7124f-87f4-4ce1-bac9-21f1bbf1b909 None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:03:59.838757 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e7124f-87f4-4ce1-bac9-21f1bbf1b909 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:03:59.839071 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e7124f-87f4-4ce1-bac9-21f1bbf1b909 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:03:59.840659 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e7124f-87f4-4ce1-bac9-21f1bbf1b909 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:03:59.857310 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 633/1281] 10.222.0.65 () {56 vars in 1143 bytes} [Tue May 10 03:03:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:03:59.863566 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4771d393-2da7-4308-b372-df5d47ce1a86 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:03:59.959097 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4771d393-2da7-4308-b372-df5d47ce1a86 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:03:59.991586 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aedbe44-f729-4932-a77a-61a92879ba7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:03:59.992251 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aedbe44-f729-4932-a77a-61a92879ba7a None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:03:59.992539 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aedbe44-f729-4932-a77a-61a92879ba7a None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:03:59.992822 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aedbe44-f729-4932-a77a-61a92879ba7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:00.056623 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aedbe44-f729-4932-a77a-61a92879ba7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:00.058049 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aedbe44-f729-4932-a77a-61a92879ba7a None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:00.149563 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 649/1282] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 10 03:03:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 03:04:00.156205 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e7124f-87f4-4ce1-bac9-21f1bbf1b909 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:00.250389 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e7124f-87f4-4ce1-bac9-21f1bbf1b909 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:00.283236 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656d126-6c6b-46fd-86a4-9f6798eb5772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:00.284034 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656d126-6c6b-46fd-86a4-9f6798eb5772 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:00.284323 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656d126-6c6b-46fd-86a4-9f6798eb5772 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:00.284595 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656d126-6c6b-46fd-86a4-9f6798eb5772 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:00.294285 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7656d126-6c6b-46fd-86a4-9f6798eb5772 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:00.295773 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7656d126-6c6b-46fd-86a4-9f6798eb5772 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:00.312915 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-7656d126-6c6b-46fd-86a4-9f6798eb5772 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:04:00.312915 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:04:00.312915 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:04:00.312915 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:04:00.312915 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:04:00.312915 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:04:00.312915 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:04:00.312915 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:04:00.312915 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:04:00.312915 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:04:00.312915 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:04:00.312915 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:04:00.312915 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 03:04:00.312915 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 03:04:00.312915 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 03:04:00.313976 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 03:04:00.313976 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:04:00.313976 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:04:00.313976 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:04:00.313976 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:04:00.313976 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:04:00.313976 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:04:00.313976 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:04:00.313976 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:04:00.313976 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:04:00.313976 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:04:00.313976 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:04:00.313976 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:04:00.313976 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:04:00.313976 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:04:00.313976 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:04:00.313976 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:04:00.314972 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 03:04:00.314972 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 03:04:00.314972 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 03:04:00.314972 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:04:00.314972 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 634/1283] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:04:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:04:00.319711 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aedbe44-f729-4932-a77a-61a92879ba7a None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:00.421423 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aedbe44-f729-4932-a77a-61a92879ba7a None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:00.454158 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e7821b-8444-4503-bf3d-254b1f747177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:00.454825 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7821b-8444-4503-bf3d-254b1f747177 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:00.455109 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7821b-8444-4503-bf3d-254b1f747177 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:00.455378 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7821b-8444-4503-bf3d-254b1f747177 None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:00.456131 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e7821b-8444-4503-bf3d-254b1f747177 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:04:00.456437 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e7821b-8444-4503-bf3d-254b1f747177 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:00.457802 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e7821b-8444-4503-bf3d-254b1f747177 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:00.469393 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 650/1284] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 10 03:04:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:04:00.474964 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656d126-6c6b-46fd-86a4-9f6798eb5772 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:00.571183 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656d126-6c6b-46fd-86a4-9f6798eb5772 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:00.603337 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de4cb7-cba9-464a-af06-009b7ad7e776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:00.604135 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de4cb7-cba9-464a-af06-009b7ad7e776 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:00.604418 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de4cb7-cba9-464a-af06-009b7ad7e776 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:00.604691 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de4cb7-cba9-464a-af06-009b7ad7e776 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:00.611250 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9de4cb7-cba9-464a-af06-009b7ad7e776 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:00.612749 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9de4cb7-cba9-464a-af06-009b7ad7e776 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:00.625950 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-d9de4cb7-cba9-464a-af06-009b7ad7e776 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:04:00.625950 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:04:00.625950 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:04:00.625950 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:04:00.625950 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:04:00.625950 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:04:00.625950 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:04:00.625950 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:04:00.625950 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:04:00.625950 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:04:00.625950 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:04:00.625950 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:04:00.625950 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 03:04:00.625950 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 03:04:00.625950 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 03:04:00.626996 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 03:04:00.626996 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:04:00.626996 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:04:00.626996 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:04:00.626996 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:04:00.626996 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:04:00.626996 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:04:00.626996 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:04:00.626996 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 10 03:04:00.626996 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:04:00.626996 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 10 03:04:00.626996 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:04:00.626996 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:04:00.626996 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:04:00.626996 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 10 03:04:00.626996 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:04:00.626996 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 10 03:04:00.628177 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 03:04:00.628177 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 03:04:00.628177 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 03:04:00.628177 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 03:04:00.628177 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 03:04:00.628177 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 03:04:00.628177 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 03:04:00.628177 dv-cinder-830094-4-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 10 03:04:00.628177 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 635/1285] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 10 03:04:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:04:00.633030 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e7821b-8444-4503-bf3d-254b1f747177 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:00.734219 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e7821b-8444-4503-bf3d-254b1f747177 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:00.766217 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b56905d-a001-44b1-a932-1eb5ce1f0254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:00.766861 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b56905d-a001-44b1-a932-1eb5ce1f0254 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:00.767140 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b56905d-a001-44b1-a932-1eb5ce1f0254 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:00.767410 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b56905d-a001-44b1-a932-1eb5ce1f0254 None admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:00.768272 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b56905d-a001-44b1-a932-1eb5ce1f0254 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:04:00.768575 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b56905d-a001-44b1-a932-1eb5ce1f0254 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:00.769973 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b56905d-a001-44b1-a932-1eb5ce1f0254 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:00.782528 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 651/1286] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 10 03:04:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:04:00.788059 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de4cb7-cba9-464a-af06-009b7ad7e776 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:00.885090 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de4cb7-cba9-464a-af06-009b7ad7e776 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:00.917464 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0158a04a-6303-4016-8ee1-4a26d2f24006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:00.918108 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158a04a-6303-4016-8ee1-4a26d2f24006 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:00.918393 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158a04a-6303-4016-8ee1-4a26d2f24006 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:00.918672 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158a04a-6303-4016-8ee1-4a26d2f24006 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:00.919497 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0158a04a-6303-4016-8ee1-4a26d2f24006 None admin] RBAC: Adding query filter params (role.id=43105000610f402ca2486e7648018cca, scope.project.id=513e6592cd83457b8ff461b0e5e1fd40, user.id=f646147bdad8476ba0ab9da5d9c50b55) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:04:00.919810 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0158a04a-6303-4016-8ee1-4a26d2f24006 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:00.921337 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0158a04a-6303-4016-8ee1-4a26d2f24006 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:00.926951 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 636/1287] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 10 03:04:00 2022] GET /identity/v3/role_assignments?user.id=f646147bdad8476ba0ab9da5d9c50b55&scope.project.id=513e6592cd83457b8ff461b0e5e1fd40&role.id=43105000610f402ca2486e7648018cca => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:04:03.203288 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6541d4b-f450-45f6-a82c-453dc3668bf7 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:03.203908 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6541d4b-f450-45f6-a82c-453dc3668bf7 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:03.203908 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6541d4b-f450-45f6-a82c-453dc3668bf7 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:03.205254 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 652/1288] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:04:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:04:03.210433 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0abf119-19fc-4309-ac2c-98b09e1f9ef4 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:03.210832 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0abf119-19fc-4309-ac2c-98b09e1f9ef4 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:03.210995 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0abf119-19fc-4309-ac2c-98b09e1f9ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:03.227445 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-f0abf119-19fc-4309-ac2c-98b09e1f9ef4 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:04:03.228947 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-f0abf119-19fc-4309-ac2c-98b09e1f9ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:04:03.292588 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 637/1289] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:04:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:04:03.315452 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6541d4b-f450-45f6-a82c-453dc3668bf7 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:03.410226 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6541d4b-f450-45f6-a82c-453dc3668bf7 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:03.442685 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f083f-edd9-4930-bacf-6191a6ee9582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:03.443470 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f083f-edd9-4930-bacf-6191a6ee9582 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:03.443754 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f083f-edd9-4930-bacf-6191a6ee9582 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:03.444053 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f083f-edd9-4930-bacf-6191a6ee9582 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:03.444709 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1f083f-edd9-4930-bacf-6191a6ee9582 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:03.446065 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1f083f-edd9-4930-bacf-6191a6ee9582 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:03.457740 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-5f1f083f-edd9-4930-bacf-6191a6ee9582 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 10 03:04:03.457740 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:04:03.457740 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 03:04:03.457740 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 03:04:03.457740 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 03:04:03.457740 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 03:04:03.457740 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 03:04:03.457740 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:04:03.457740 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 03:04:03.457740 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:04:03.457740 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 03:04:03.457740 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:04:03.457740 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:04:03.457740 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:04:03.457740 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:04:03.457740 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:04:03.457740 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:04:03.458999 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:04:03.458999 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:04:03.458999 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:04:03.458999 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:04:03.458999 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:04:03.458999 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:04:03.458999 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 03:04:03.458999 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 03:04:03.458999 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 03:04:03.458999 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 03:04:03.458999 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:04:03.458999 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:04:03.458999 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:04:03.458999 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:04:03.458999 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:04:03.458999 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:04:03.459940 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:04:03.459940 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:04:03.459940 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:04:03.459940 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:04:03.459940 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:04:03.459940 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:04:03.459940 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:04:03.459940 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:04:03.459940 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:04:03.459940 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:04:03.459940 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 03:04:03.459940 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:04:03.459940 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 03:04:03.459940 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:04:03.459940 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 653/1290] 10.222.0.65 () {56 vars in 1117 bytes} [Tue May 10 03:04:03 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:04:03.465086 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0abf119-19fc-4309-ac2c-98b09e1f9ef4 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:03.561559 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0abf119-19fc-4309-ac2c-98b09e1f9ef4 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:03.593156 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325a827-6b13-4cdc-96b7-962f85f93ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:03.593812 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325a827-6b13-4cdc-96b7-962f85f93ef2 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:03.594096 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325a827-6b13-4cdc-96b7-962f85f93ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:03.594372 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325a827-6b13-4cdc-96b7-962f85f93ef2 None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:03.595082 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d325a827-6b13-4cdc-96b7-962f85f93ef2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:04:03.595386 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d325a827-6b13-4cdc-96b7-962f85f93ef2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:03.596791 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d325a827-6b13-4cdc-96b7-962f85f93ef2 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:03.604048 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 638/1291] 10.222.0.65 () {56 vars in 1116 bytes} [Tue May 10 03:04:03 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:04:03.607233 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f083f-edd9-4930-bacf-6191a6ee9582 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:03.702255 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f083f-edd9-4930-bacf-6191a6ee9582 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:03.734626 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfbfabd-9c90-4ba0-8f70-d304a133569b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:03.735221 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbfabd-9c90-4ba0-8f70-d304a133569b None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:03.735505 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbfabd-9c90-4ba0-8f70-d304a133569b None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:03.735785 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbfabd-9c90-4ba0-8f70-d304a133569b None admin] PATH_INFO: `/v3/services` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:03.736518 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfbfabd-9c90-4ba0-8f70-d304a133569b None admin] RBAC: Adding query filter params (type=placement) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:04:03.736825 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfbfabd-9c90-4ba0-8f70-d304a133569b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:03.738175 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfbfabd-9c90-4ba0-8f70-d304a133569b None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:03.742629 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 654/1292] 10.222.0.65 () {56 vars in 1116 bytes} [Tue May 10 03:04:03 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:04:05.928732 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71425a26-accf-4236-afe7-b2c178628a2d None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:05.929288 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71425a26-accf-4236-afe7-b2c178628a2d None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:05.929288 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71425a26-accf-4236-afe7-b2c178628a2d None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:05.930636 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 639/1293] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:04:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:04:05.935901 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88c5f2-f19d-4dcb-a541-08a0a32cdb26 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:05.936388 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88c5f2-f19d-4dcb-a541-08a0a32cdb26 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:05.936490 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88c5f2-f19d-4dcb-a541-08a0a32cdb26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:05.953136 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-7a88c5f2-f19d-4dcb-a541-08a0a32cdb26 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:04:05.954319 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-7a88c5f2-f19d-4dcb-a541-08a0a32cdb26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:04:06.016943 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 655/1294] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:04:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:04:06.040259 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71425a26-accf-4236-afe7-b2c178628a2d None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:06.134623 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71425a26-accf-4236-afe7-b2c178628a2d None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:06.169861 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74681907-6d0f-4dbe-93b6-bd0063ed57f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:06.170541 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74681907-6d0f-4dbe-93b6-bd0063ed57f2 None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:06.170822 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74681907-6d0f-4dbe-93b6-bd0063ed57f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:06.171096 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74681907-6d0f-4dbe-93b6-bd0063ed57f2 None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:06.171832 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74681907-6d0f-4dbe-93b6-bd0063ed57f2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:06.173228 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74681907-6d0f-4dbe-93b6-bd0063ed57f2 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:06.284353 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 640/1295] 10.222.0.65 () {60 vars in 1141 bytes} [Tue May 10 03:04:06 2022] POST /identity/v3/services => generated 246 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:04:08.483834 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f511761-3922-45cd-b0b8-8c5f233a7900 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:08.484437 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f511761-3922-45cd-b0b8-8c5f233a7900 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:08.484536 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f511761-3922-45cd-b0b8-8c5f233a7900 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:08.485908 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 656/1296] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:04:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:04:08.492335 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d063fd47-de7a-47d4-826c-3043cecad8cd None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:08.495587 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d063fd47-de7a-47d4-826c-3043cecad8cd None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:08.495587 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d063fd47-de7a-47d4-826c-3043cecad8cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:08.512475 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-d063fd47-de7a-47d4-826c-3043cecad8cd None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:04:08.513722 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-d063fd47-de7a-47d4-826c-3043cecad8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:04:08.594484 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 641/1297] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:04:08 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 03:04:08.617259 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f511761-3922-45cd-b0b8-8c5f233a7900 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:08.718501 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f511761-3922-45cd-b0b8-8c5f233a7900 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:08.754530 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d31838-3ff7-4d9e-ada1-e783b780e1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:08.755324 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d31838-3ff7-4d9e-ada1-e783b780e1fe None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:08.755602 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d31838-3ff7-4d9e-ada1-e783b780e1fe None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:08.755876 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d31838-3ff7-4d9e-ada1-e783b780e1fe None admin] PATH_INFO: `/v3/services/placement` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:08.756555 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d31838-3ff7-4d9e-ada1-e783b780e1fe None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:08.764773 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d31838-3ff7-4d9e-ada1-e783b780e1fe None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:08.770316 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-66d31838-3ff7-4d9e-ada1-e783b780e1fe None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 10 03:04:08.770316 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:04:08.770316 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 03:04:08.770316 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 03:04:08.770316 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 03:04:08.770316 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 03:04:08.770316 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 03:04:08.770316 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:04:08.770316 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 03:04:08.770316 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:04:08.770316 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 03:04:08.770316 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:04:08.770316 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:04:08.770316 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:04:08.770316 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:04:08.770316 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:04:08.770316 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:04:08.771522 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:04:08.771522 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:04:08.771522 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:04:08.771522 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:04:08.771522 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:04:08.771522 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:04:08.771522 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 03:04:08.771522 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 03:04:08.771522 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 03:04:08.771522 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 03:04:08.771522 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:04:08.771522 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:04:08.771522 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:04:08.771522 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:04:08.771522 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:04:08.771522 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:04:08.772613 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:04:08.772613 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:04:08.772613 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:04:08.772613 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:04:08.772613 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:04:08.772613 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:04:08.772613 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:04:08.772613 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:04:08.772613 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:04:08.772613 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:04:08.772613 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 03:04:08.772613 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:04:08.772613 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 03:04:08.772613 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:04:08.772613 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 657/1298] 10.222.0.65 () {56 vars in 1117 bytes} [Tue May 10 03:04:08 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:04:08.777769 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d063fd47-de7a-47d4-826c-3043cecad8cd None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:08.874635 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d063fd47-de7a-47d4-826c-3043cecad8cd None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:08.907145 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250614b3-a442-4f38-9819-460aad8cbe3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:08.907802 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250614b3-a442-4f38-9819-460aad8cbe3e None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:08.908111 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250614b3-a442-4f38-9819-460aad8cbe3e None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:08.908390 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250614b3-a442-4f38-9819-460aad8cbe3e None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:08.909097 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250614b3-a442-4f38-9819-460aad8cbe3e None admin] RBAC: Adding query filter params (name=placement) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:04:08.909404 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250614b3-a442-4f38-9819-460aad8cbe3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:08.910790 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250614b3-a442-4f38-9819-460aad8cbe3e None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:08.915706 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 642/1299] 10.222.0.65 () {56 vars in 1116 bytes} [Tue May 10 03:04:08 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:04:08.922200 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d31838-3ff7-4d9e-ada1-e783b780e1fe None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:09.016150 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d31838-3ff7-4d9e-ada1-e783b780e1fe None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:09.048166 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ecaaa8-7eb2-4bd7-80c3-14b8d72b7c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:09.048816 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ecaaa8-7eb2-4bd7-80c3-14b8d72b7c22 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:09.049094 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ecaaa8-7eb2-4bd7-80c3-14b8d72b7c22 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:09.049367 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ecaaa8-7eb2-4bd7-80c3-14b8d72b7c22 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:09.050153 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ecaaa8-7eb2-4bd7-80c3-14b8d72b7c22 None admin] RBAC: Adding query filter params (interface=public, service_id=45caa72f771945dd97c1be0039e33a3f, region_id=RegionOne) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:04:09.050463 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ecaaa8-7eb2-4bd7-80c3-14b8d72b7c22 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:09.051849 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ecaaa8-7eb2-4bd7-80c3-14b8d72b7c22 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:09.056791 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 658/1300] 10.222.0.65 () {56 vars in 1251 bytes} [Tue May 10 03:04:08 2022] GET /identity/v3/endpoints?service_id=45caa72f771945dd97c1be0039e33a3f&interface=public®ion_id=RegionOne => generated 194 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:04:09.063155 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250614b3-a442-4f38-9819-460aad8cbe3e None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:09.157659 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250614b3-a442-4f38-9819-460aad8cbe3e None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:09.190303 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34634650-0b9a-4dd5-92fe-f307832fd37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:09.190954 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34634650-0b9a-4dd5-92fe-f307832fd37b None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:09.191237 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34634650-0b9a-4dd5-92fe-f307832fd37b None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:09.191511 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34634650-0b9a-4dd5-92fe-f307832fd37b None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:09.192208 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34634650-0b9a-4dd5-92fe-f307832fd37b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:09.193575 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34634650-0b9a-4dd5-92fe-f307832fd37b None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:09.200223 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 643/1301] 10.222.0.65 () {56 vars in 1087 bytes} [Tue May 10 03:04:09 2022] GET /identity/v3/services => generated 2191 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:04:11.402757 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b242e6c-b33f-4f61-889a-01d431ae7aa6 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:11.403308 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b242e6c-b33f-4f61-889a-01d431ae7aa6 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:11.403308 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b242e6c-b33f-4f61-889a-01d431ae7aa6 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:11.404680 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 659/1302] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:04:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:04:11.410009 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cac764-7d37-4ad4-bddc-327b5ca10069 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:11.410437 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cac764-7d37-4ad4-bddc-327b5ca10069 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:11.410536 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cac764-7d37-4ad4-bddc-327b5ca10069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:11.427072 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-a3cac764-7d37-4ad4-bddc-327b5ca10069 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:04:11.428274 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-a3cac764-7d37-4ad4-bddc-327b5ca10069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:04:11.491920 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 644/1303] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:04:11 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 03:04:11.515127 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b242e6c-b33f-4f61-889a-01d431ae7aa6 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:11.611050 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b242e6c-b33f-4f61-889a-01d431ae7aa6 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:11.641698 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a8012-9a3f-4f20-b49c-e4c779c074e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:11.642473 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a8012-9a3f-4f20-b49c-e4c779c074e1 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:11.642754 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a8012-9a3f-4f20-b49c-e4c779c074e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:11.643025 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a8012-9a3f-4f20-b49c-e4c779c074e1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:11.643673 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66a8012-9a3f-4f20-b49c-e4c779c074e1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:11.645051 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66a8012-9a3f-4f20-b49c-e4c779c074e1 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:11.657228 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-b66a8012-9a3f-4f20-b49c-e4c779c074e1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 10 03:04:11.657228 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:04:11.657228 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 03:04:11.657228 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 03:04:11.657228 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 03:04:11.657228 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 03:04:11.657228 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 03:04:11.657228 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:04:11.657228 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 03:04:11.657228 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:04:11.657228 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 03:04:11.657228 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:04:11.657228 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 03:04:11.657228 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 03:04:11.657228 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 03:04:11.657228 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 03:04:11.657228 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 03:04:11.658375 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 03:04:11.658375 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 03:04:11.658375 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 03:04:11.658375 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 03:04:11.658375 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 03:04:11.658375 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 03:04:11.658375 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 03:04:11.658375 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 03:04:11.658375 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 03:04:11.658375 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 03:04:11.658375 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 03:04:11.658375 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 03:04:11.658375 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 03:04:11.658375 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 03:04:11.658375 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 03:04:11.658375 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( May 10 03:04:11.659214 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 03:04:11.659214 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( May 10 03:04:11.659214 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 03:04:11.659214 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() May 10 03:04:11.659214 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 03:04:11.659214 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 03:04:11.659214 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 03:04:11.659214 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() May 10 03:04:11.659214 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 03:04:11.659214 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( May 10 03:04:11.659214 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 03:04:11.659214 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 03:04:11.659214 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 03:04:11.659214 dv-cinder-830094-4-smb devstack@keystone.service[80197]: ERROR keystone.server.flask.application May 10 03:04:11.659214 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 660/1304] 10.222.0.65 () {56 vars in 1117 bytes} [Tue May 10 03:04:11 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 03:04:11.664305 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cac764-7d37-4ad4-bddc-327b5ca10069 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:11.758384 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cac764-7d37-4ad4-bddc-327b5ca10069 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:11.792194 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16117609-f2e3-492d-af5f-4bb02a72f6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:11.792855 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16117609-f2e3-492d-af5f-4bb02a72f6f4 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:11.793136 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16117609-f2e3-492d-af5f-4bb02a72f6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:11.793411 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16117609-f2e3-492d-af5f-4bb02a72f6f4 None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:11.794118 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16117609-f2e3-492d-af5f-4bb02a72f6f4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:04:11.794425 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16117609-f2e3-492d-af5f-4bb02a72f6f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:11.796414 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16117609-f2e3-492d-af5f-4bb02a72f6f4 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:11.801441 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 645/1305] 10.222.0.65 () {56 vars in 1116 bytes} [Tue May 10 03:04:11 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:04:11.807118 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a8012-9a3f-4f20-b49c-e4c779c074e1 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:04:11.899368 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a8012-9a3f-4f20-b49c-e4c779c074e1 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:04:11.931384 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b05473b-2e0d-4bed-97ab-d4320e1a0f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:04:11.931965 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b05473b-2e0d-4bed-97ab-d4320e1a0f79 None admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:04:11.932270 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b05473b-2e0d-4bed-97ab-d4320e1a0f79 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:04:11.932540 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b05473b-2e0d-4bed-97ab-d4320e1a0f79 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:04:11.933359 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b05473b-2e0d-4bed-97ab-d4320e1a0f79 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:04:11.934667 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b05473b-2e0d-4bed-97ab-d4320e1a0f79 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:04:12.023678 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 661/1306] 10.222.0.65 () {60 vars in 1144 bytes} [Tue May 10 03:04:11 2022] POST /identity/v3/endpoints => generated 331 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:10:10.443566 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68a84c-032e-4429-bf60-07ac910fc91a None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:10:10.444504 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68a84c-032e-4429-bf60-07ac910fc91a None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:10:10.444929 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68a84c-032e-4429-bf60-07ac910fc91a None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:10:10.451998 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f567c-9a29-4e4c-8c50-50704040797d None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:10:10.452838 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f567c-9a29-4e4c-8c50-50704040797d None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:10:10.453277 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f567c-9a29-4e4c-8c50-50704040797d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:10:10.455474 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 646/1307] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:10:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:10:10.568511 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-188f567c-9a29-4e4c-8c50-50704040797d None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:10:10.570608 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-188f567c-9a29-4e4c-8c50-50704040797d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:10:10.713538 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 662/1308] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:10:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:10:10.768407 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd8b88-732b-46fd-a7e2-12437993d0d2 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:10:10.768609 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd8b88-732b-46fd-a7e2-12437993d0d2 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:10:10.768890 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd8b88-732b-46fd-a7e2-12437993d0d2 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:10:10.770517 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 647/1309] 10.222.0.65 () {54 vars in 964 bytes} [Tue May 10 03:10:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:10:10.778804 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c5c710-9091-474d-899a-f66a26602cd6 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:10:10.781047 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c5c710-9091-474d-899a-f66a26602cd6 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:10:10.781345 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c5c710-9091-474d-899a-f66a26602cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:10:10.863568 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-f3c5c710-9091-474d-899a-f66a26602cd6 None None] MFA Rules not processed for user `ccfba74826234915bc989fede9bde3e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:10:10.864995 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-f3c5c710-9091-474d-899a-f66a26602cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:10:10.947704 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 663/1310] 10.222.0.65 () {58 vars in 1061 bytes} [Tue May 10 03:10:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:10:10.957362 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bd8b88-732b-46fd-a7e2-12437993d0d2 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:10:10.959286 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-86bd8b88-732b-46fd-a7e2-12437993d0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:10:11.066301 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bd8b88-732b-46fd-a7e2-12437993d0d2 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:10:11.150206 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1eab89-d9a4-4fb6-9211-b1d37310b33c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:10:11.151223 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1eab89-d9a4-4fb6-9211-b1d37310b33c service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:10:11.151507 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1eab89-d9a4-4fb6-9211-b1d37310b33c service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:10:11.151785 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1eab89-d9a4-4fb6-9211-b1d37310b33c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:10:11.153610 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-3b1eab89-d9a4-4fb6-9211-b1d37310b33c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:10:11.262713 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1eab89-d9a4-4fb6-9211-b1d37310b33c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:10:11.264251 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1eab89-d9a4-4fb6-9211-b1d37310b33c service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:10:11.283095 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 648/1311] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:10:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:10:13.865826 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a30a4-926e-4c64-becf-ed058edad3e5 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:10:13.866285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a30a4-926e-4c64-becf-ed058edad3e5 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:10:13.866531 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a30a4-926e-4c64-becf-ed058edad3e5 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:10:13.868074 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 664/1312] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:10:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:10:13.873311 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490f486-db2b-4d9c-9f71-b5b360b1420b None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:10:13.874138 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490f486-db2b-4d9c-9f71-b5b360b1420b None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:10:13.874704 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490f486-db2b-4d9c-9f71-b5b360b1420b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:10:13.946654 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-3490f486-db2b-4d9c-9f71-b5b360b1420b None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:10:13.948132 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-3490f486-db2b-4d9c-9f71-b5b360b1420b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:10:14.052764 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 649/1313] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:10:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:10:14.091435 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904a30a4-926e-4c64-becf-ed058edad3e5 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:10:14.093185 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-904a30a4-926e-4c64-becf-ed058edad3e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:10:14.198955 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904a30a4-926e-4c64-becf-ed058edad3e5 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:10:14.274284 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3532eaa7-e4ec-47c2-a59b-d3b3f951f365 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:10:14.274861 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532eaa7-e4ec-47c2-a59b-d3b3f951f365 service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:10:14.275136 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532eaa7-e4ec-47c2-a59b-d3b3f951f365 service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:10:14.275414 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532eaa7-e4ec-47c2-a59b-d3b3f951f365 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:10:14.277132 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-3532eaa7-e4ec-47c2-a59b-d3b3f951f365 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:10:14.387777 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3532eaa7-e4ec-47c2-a59b-d3b3f951f365 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:10:14.389285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3532eaa7-e4ec-47c2-a59b-d3b3f951f365 service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:10:14.410166 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 665/1314] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:10:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:10:17.190728 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6951041-cb29-46a1-8b2f-4887b204855f None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:10:17.191299 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6951041-cb29-46a1-8b2f-4887b204855f None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:10:17.191299 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6951041-cb29-46a1-8b2f-4887b204855f None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:10:17.192711 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 650/1315] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:10:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:10:17.198028 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7389a-0488-4f30-bb6a-271f88d69d46 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:10:17.198443 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7389a-0488-4f30-bb6a-271f88d69d46 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:10:17.198578 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7389a-0488-4f30-bb6a-271f88d69d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:10:17.261957 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-8cc7389a-0488-4f30-bb6a-271f88d69d46 None None] MFA Rules not processed for user `80d1ae1ee3d6406ba9cfc944e06e2daa`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:10:17.263167 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-8cc7389a-0488-4f30-bb6a-271f88d69d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:10:17.355750 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 666/1316] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:10:17 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:10:17.395536 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6951041-cb29-46a1-8b2f-4887b204855f None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:10:17.398427 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-d6951041-cb29-46a1-8b2f-4887b204855f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:10:17.504291 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6951041-cb29-46a1-8b2f-4887b204855f None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:10:17.577397 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d156796-25eb-4fc3-9e91-c1f329e26739 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:10:17.578043 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d156796-25eb-4fc3-9e91-c1f329e26739 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:10:17.578327 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d156796-25eb-4fc3-9e91-c1f329e26739 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:10:17.578602 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d156796-25eb-4fc3-9e91-c1f329e26739 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:10:17.580286 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-7d156796-25eb-4fc3-9e91-c1f329e26739 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:10:17.682498 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d156796-25eb-4fc3-9e91-c1f329e26739 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:10:17.684530 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d156796-25eb-4fc3-9e91-c1f329e26739 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:10:17.701650 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 651/1317] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:10:17 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:10:20.661477 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d0324-3e34-425c-84ee-aa1e3a4f2b0f None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:10:20.661996 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d0324-3e34-425c-84ee-aa1e3a4f2b0f None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:10:20.662194 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d0324-3e34-425c-84ee-aa1e3a4f2b0f None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:10:20.663432 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 667/1318] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:10:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:10:20.669048 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbce0ab-72e5-4653-8b20-3ecf58c5ed00 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:10:20.669422 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbce0ab-72e5-4653-8b20-3ecf58c5ed00 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:10:20.669618 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbce0ab-72e5-4653-8b20-3ecf58c5ed00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:10:20.733864 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-1dbce0ab-72e5-4653-8b20-3ecf58c5ed00 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:10:20.734997 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-1dbce0ab-72e5-4653-8b20-3ecf58c5ed00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:10:20.830637 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 652/1319] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:10:20 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:10:20.881366 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e8641-07bf-43e7-8791-da56523e02aa None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:10:20.881686 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e8641-07bf-43e7-8791-da56523e02aa None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:10:20.881963 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e8641-07bf-43e7-8791-da56523e02aa None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:10:20.883324 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 668/1320] 10.222.0.65 () {54 vars in 964 bytes} [Tue May 10 03:10:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:10:20.889825 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6965623-fa77-4fae-8aaf-2b12b1cac095 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:10:20.890108 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6965623-fa77-4fae-8aaf-2b12b1cac095 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:10:20.890380 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6965623-fa77-4fae-8aaf-2b12b1cac095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:10:20.963076 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-b6965623-fa77-4fae-8aaf-2b12b1cac095 None None] MFA Rules not processed for user `ccfba74826234915bc989fede9bde3e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:10:20.964318 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-b6965623-fa77-4fae-8aaf-2b12b1cac095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:10:21.039593 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 653/1321] 10.222.0.65 () {58 vars in 1061 bytes} [Tue May 10 03:10:20 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:10:21.048633 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246e8641-07bf-43e7-8791-da56523e02aa None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:10:21.050170 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-246e8641-07bf-43e7-8791-da56523e02aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:10:21.147708 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246e8641-07bf-43e7-8791-da56523e02aa None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:10:21.221916 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eddee5c-ea76-4ccc-a240-bac056992a69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:10:21.222569 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eddee5c-ea76-4ccc-a240-bac056992a69 service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:10:21.222854 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eddee5c-ea76-4ccc-a240-bac056992a69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:10:21.223134 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eddee5c-ea76-4ccc-a240-bac056992a69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:10:21.225153 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-5eddee5c-ea76-4ccc-a240-bac056992a69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:10:21.328678 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eddee5c-ea76-4ccc-a240-bac056992a69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:10:21.330030 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eddee5c-ea76-4ccc-a240-bac056992a69 service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:10:21.347659 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 669/1322] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:10:21 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:10:25.008326 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab14ad6-fa21-4486-ae4f-6c2911ba1356 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:10:25.008897 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab14ad6-fa21-4486-ae4f-6c2911ba1356 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:10:25.008897 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab14ad6-fa21-4486-ae4f-6c2911ba1356 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:10:25.010224 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 654/1323] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:10:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:10:25.016037 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fcb797-a437-4bf6-bb35-91786a176a14 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:10:25.016453 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fcb797-a437-4bf6-bb35-91786a176a14 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:10:25.016712 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fcb797-a437-4bf6-bb35-91786a176a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:10:25.079051 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-f6fcb797-a437-4bf6-bb35-91786a176a14 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:10:25.080273 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-f6fcb797-a437-4bf6-bb35-91786a176a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:10:25.176176 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 670/1324] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:10:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:10:25.216078 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab14ad6-fa21-4486-ae4f-6c2911ba1356 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:10:25.216078 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-6ab14ad6-fa21-4486-ae4f-6c2911ba1356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:10:25.328153 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab14ad6-fa21-4486-ae4f-6c2911ba1356 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:10:25.405056 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29848f69-5e51-44a4-8927-cca4e006d4c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:10:25.405713 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29848f69-5e51-44a4-8927-cca4e006d4c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:10:25.405999 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29848f69-5e51-44a4-8927-cca4e006d4c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:10:25.406281 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29848f69-5e51-44a4-8927-cca4e006d4c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:10:25.407934 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-29848f69-5e51-44a4-8927-cca4e006d4c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:10:25.528142 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29848f69-5e51-44a4-8927-cca4e006d4c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:10:25.529594 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29848f69-5e51-44a4-8927-cca4e006d4c6 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:10:25.555236 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 655/1325] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:10:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:10:27.831522 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead86015-5a13-4ae9-ae9b-2b888bf0fe9f None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:10:27.832064 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead86015-5a13-4ae9-ae9b-2b888bf0fe9f None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:10:27.832064 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead86015-5a13-4ae9-ae9b-2b888bf0fe9f None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:10:27.833383 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 671/1326] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:10:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:10:27.838618 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a44b6-37c7-4d52-92a8-2970ec17f04f None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:10:27.839039 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a44b6-37c7-4d52-92a8-2970ec17f04f None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:10:27.839185 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a44b6-37c7-4d52-92a8-2970ec17f04f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:10:27.908973 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-f78a44b6-37c7-4d52-92a8-2970ec17f04f None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:10:27.910186 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-f78a44b6-37c7-4d52-92a8-2970ec17f04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:10:28.003516 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 656/1327] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:10:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:10:28.039997 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead86015-5a13-4ae9-ae9b-2b888bf0fe9f None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:10:28.041641 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-ead86015-5a13-4ae9-ae9b-2b888bf0fe9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:10:28.139284 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead86015-5a13-4ae9-ae9b-2b888bf0fe9f None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:10:28.207772 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db8bce-6964-4268-a5f4-c0777ee53d8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:10:28.208451 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db8bce-6964-4268-a5f4-c0777ee53d8e service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:10:28.208732 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db8bce-6964-4268-a5f4-c0777ee53d8e service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:10:28.209004 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db8bce-6964-4268-a5f4-c0777ee53d8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:10:28.210622 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-f9db8bce-6964-4268-a5f4-c0777ee53d8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:10:28.315182 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9db8bce-6964-4268-a5f4-c0777ee53d8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:10:28.316650 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9db8bce-6964-4268-a5f4-c0777ee53d8e service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:10:28.334685 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 672/1328] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:10:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:10:30.599109 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825da4e2-c091-42ca-9844-1cdef337c19f None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:10:30.599617 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825da4e2-c091-42ca-9844-1cdef337c19f None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:10:30.599728 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825da4e2-c091-42ca-9844-1cdef337c19f None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:10:30.601055 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 657/1329] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:10:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:10:30.606908 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb5b10-0353-45cf-9960-ab59360e01fa None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:10:30.607336 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb5b10-0353-45cf-9960-ab59360e01fa None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:10:30.607462 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb5b10-0353-45cf-9960-ab59360e01fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:10:30.671317 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-70cb5b10-0353-45cf-9960-ab59360e01fa None None] MFA Rules not processed for user `80d1ae1ee3d6406ba9cfc944e06e2daa`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:10:30.672551 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-70cb5b10-0353-45cf-9960-ab59360e01fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:10:30.763259 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 673/1330] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:10:30 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:10:30.800793 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825da4e2-c091-42ca-9844-1cdef337c19f None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:10:30.802415 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-825da4e2-c091-42ca-9844-1cdef337c19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:10:30.906309 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825da4e2-c091-42ca-9844-1cdef337c19f None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:10:30.982858 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d7555-d132-49be-8b5a-fce211a410a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:10:30.983658 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d7555-d132-49be-8b5a-fce211a410a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:10:30.984129 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d7555-d132-49be-8b5a-fce211a410a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:10:30.984534 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d7555-d132-49be-8b5a-fce211a410a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:10:30.986458 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-fa8d7555-d132-49be-8b5a-fce211a410a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:10:31.093622 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8d7555-d132-49be-8b5a-fce211a410a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:10:31.094983 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8d7555-d132-49be-8b5a-fce211a410a8 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:10:31.113106 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 658/1331] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:10:30 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:10:33.814584 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a98ffb-bd61-4441-b53e-291068e61e36 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:10:33.815152 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a98ffb-bd61-4441-b53e-291068e61e36 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:10:33.815152 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a98ffb-bd61-4441-b53e-291068e61e36 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:10:33.816593 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 674/1332] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:10:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:10:33.821726 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940fa97-f8f5-4c9d-9e49-d2a9d0106a10 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:10:33.822158 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940fa97-f8f5-4c9d-9e49-d2a9d0106a10 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:10:33.822292 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940fa97-f8f5-4c9d-9e49-d2a9d0106a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:10:33.886751 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-6940fa97-f8f5-4c9d-9e49-d2a9d0106a10 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:10:33.887889 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-6940fa97-f8f5-4c9d-9e49-d2a9d0106a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:10:33.982625 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 659/1333] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:10:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:10:34.018271 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a98ffb-bd61-4441-b53e-291068e61e36 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:10:34.019795 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-d5a98ffb-bd61-4441-b53e-291068e61e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:10:34.118702 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a98ffb-bd61-4441-b53e-291068e61e36 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:10:34.190156 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25357581-cba2-4537-9028-e273a54bb5aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:10:34.190806 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25357581-cba2-4537-9028-e273a54bb5aa service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:10:34.191090 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25357581-cba2-4537-9028-e273a54bb5aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:10:34.191368 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25357581-cba2-4537-9028-e273a54bb5aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:10:34.193092 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-25357581-cba2-4537-9028-e273a54bb5aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:10:34.303040 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25357581-cba2-4537-9028-e273a54bb5aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:10:34.304525 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25357581-cba2-4537-9028-e273a54bb5aa service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:10:34.324144 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 675/1334] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:10:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:10:36.571123 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde94b9-7b4a-434f-83f5-dff7537ec415 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:10:36.571646 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde94b9-7b4a-434f-83f5-dff7537ec415 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:10:36.571646 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde94b9-7b4a-434f-83f5-dff7537ec415 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:10:36.573054 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 660/1335] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:10:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:10:36.578584 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf82de-0931-45fb-8035-39233dae7991 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:10:36.579000 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf82de-0931-45fb-8035-39233dae7991 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:10:36.579137 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf82de-0931-45fb-8035-39233dae7991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:10:36.642709 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-adcf82de-0931-45fb-8035-39233dae7991 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:10:36.644124 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-adcf82de-0931-45fb-8035-39233dae7991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:10:36.738131 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 676/1336] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:10:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:10:36.776529 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde94b9-7b4a-434f-83f5-dff7537ec415 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:10:36.778601 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-2cde94b9-7b4a-434f-83f5-dff7537ec415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:10:36.880812 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde94b9-7b4a-434f-83f5-dff7537ec415 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:10:36.951807 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92933ad8-2d4e-4c18-a01c-a176b8a51ae1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:10:36.952480 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92933ad8-2d4e-4c18-a01c-a176b8a51ae1 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:10:36.952767 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92933ad8-2d4e-4c18-a01c-a176b8a51ae1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:10:36.953047 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92933ad8-2d4e-4c18-a01c-a176b8a51ae1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:10:36.954694 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-92933ad8-2d4e-4c18-a01c-a176b8a51ae1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:10:37.060319 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92933ad8-2d4e-4c18-a01c-a176b8a51ae1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:10:37.061695 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92933ad8-2d4e-4c18-a01c-a176b8a51ae1 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:10:37.078843 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 661/1337] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:10:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:10:39.855397 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617f63d-5ccf-40a3-b14b-5ac894fd2604 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:10:39.855937 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617f63d-5ccf-40a3-b14b-5ac894fd2604 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:10:39.855937 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617f63d-5ccf-40a3-b14b-5ac894fd2604 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:10:39.857353 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 677/1338] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:10:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:10:39.862432 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3900f196-f66d-401b-bcb6-92a21648a8e5 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:10:39.862840 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3900f196-f66d-401b-bcb6-92a21648a8e5 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:10:39.862994 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3900f196-f66d-401b-bcb6-92a21648a8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:10:39.925954 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-3900f196-f66d-401b-bcb6-92a21648a8e5 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:10:39.927172 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-3900f196-f66d-401b-bcb6-92a21648a8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:10:40.022521 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 662/1339] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:10:39 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:10:40.057901 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a617f63d-5ccf-40a3-b14b-5ac894fd2604 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:10:40.059425 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-a617f63d-5ccf-40a3-b14b-5ac894fd2604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:10:40.158376 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a617f63d-5ccf-40a3-b14b-5ac894fd2604 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:10:40.227496 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83684982-5429-4da8-a34d-42657a27b3cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:10:40.228166 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83684982-5429-4da8-a34d-42657a27b3cb service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:10:40.228447 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83684982-5429-4da8-a34d-42657a27b3cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:10:40.228724 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83684982-5429-4da8-a34d-42657a27b3cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:10:40.230469 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-83684982-5429-4da8-a34d-42657a27b3cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:10:40.332933 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83684982-5429-4da8-a34d-42657a27b3cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:10:40.334283 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83684982-5429-4da8-a34d-42657a27b3cb service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:10:40.351651 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 678/1340] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:10:40 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:10:44.816338 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d1867-646b-424e-ba35-25a139515297 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:10:44.816928 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d1867-646b-424e-ba35-25a139515297 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:10:44.816928 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d1867-646b-424e-ba35-25a139515297 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:10:44.818312 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 663/1341] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:10:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:10:44.824438 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3bb71a-710f-4cbe-9eb2-4c123550c43c None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:10:44.824887 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3bb71a-710f-4cbe-9eb2-4c123550c43c None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:10:44.825229 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3bb71a-710f-4cbe-9eb2-4c123550c43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:10:44.893926 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-5d3bb71a-710f-4cbe-9eb2-4c123550c43c None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:10:44.895141 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-5d3bb71a-710f-4cbe-9eb2-4c123550c43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:10:44.996238 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 679/1342] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:10:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:10:45.034457 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d1867-646b-424e-ba35-25a139515297 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:10:45.036610 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-e77d1867-646b-424e-ba35-25a139515297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:10:45.137386 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d1867-646b-424e-ba35-25a139515297 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:10:45.142557 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b86d8dc-ef03-4aef-a877-a9fcbdd9e1cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:10:45.143508 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b86d8dc-ef03-4aef-a877-a9fcbdd9e1cc service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:10:45.143984 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b86d8dc-ef03-4aef-a877-a9fcbdd9e1cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:10:45.144389 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b86d8dc-ef03-4aef-a877-a9fcbdd9e1cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:10:45.157303 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b86d8dc-ef03-4aef-a877-a9fcbdd9e1cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:10:45.159010 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b86d8dc-ef03-4aef-a877-a9fcbdd9e1cc service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:10:45.171625 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 664/1343] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:10:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:10:48.411413 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cfd0fb-680a-4133-ae85-7af35f492d4d None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:10:48.411955 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cfd0fb-680a-4133-ae85-7af35f492d4d None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:10:48.411955 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cfd0fb-680a-4133-ae85-7af35f492d4d None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:10:48.413364 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 680/1344] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:10:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:10:48.419243 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6675a09d-c6b1-4f28-bc4e-3ec96df989f0 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:10:48.419671 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6675a09d-c6b1-4f28-bc4e-3ec96df989f0 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:10:48.419789 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6675a09d-c6b1-4f28-bc4e-3ec96df989f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:10:48.447210 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-6675a09d-c6b1-4f28-bc4e-3ec96df989f0 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:10:48.448453 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-6675a09d-c6b1-4f28-bc4e-3ec96df989f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:10:48.524300 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 665/1345] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:10:48 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:10:48.564519 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cfd0fb-680a-4133-ae85-7af35f492d4d None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:10:48.577480 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cfd0fb-680a-4133-ae85-7af35f492d4d None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:10:48.581180 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f58527-a003-4dda-aeb3-b1775678e905 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:10:48.581828 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f58527-a003-4dda-aeb3-b1775678e905 service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:10:48.582115 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f58527-a003-4dda-aeb3-b1775678e905 service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:10:48.582392 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f58527-a003-4dda-aeb3-b1775678e905 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:10:48.592460 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f58527-a003-4dda-aeb3-b1775678e905 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:10:48.593885 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f58527-a003-4dda-aeb3-b1775678e905 service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:10:48.606075 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 681/1346] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:10:48 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:10:53.099824 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882afd83-ea37-4fff-a30b-3571799da9de None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:10:53.100356 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882afd83-ea37-4fff-a30b-3571799da9de None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:10:53.100356 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882afd83-ea37-4fff-a30b-3571799da9de None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:10:53.101707 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 666/1347] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:10:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:10:53.107448 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0194e2-91e7-413b-b236-bcd9bc91733c None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:10:53.107838 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0194e2-91e7-413b-b236-bcd9bc91733c None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:10:53.108022 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0194e2-91e7-413b-b236-bcd9bc91733c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:10:53.125219 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-7c0194e2-91e7-413b-b236-bcd9bc91733c None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:10:53.126405 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-7c0194e2-91e7-413b-b236-bcd9bc91733c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:10:53.134539 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 682/1348] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:10:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:10:53.173051 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882afd83-ea37-4fff-a30b-3571799da9de None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:10:53.184044 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882afd83-ea37-4fff-a30b-3571799da9de None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:10:53.187556 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb3352-4c41-4d10-a0f9-e29182da7463 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:10:53.188275 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb3352-4c41-4d10-a0f9-e29182da7463 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:10:53.188565 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb3352-4c41-4d10-a0f9-e29182da7463 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:10:53.188843 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb3352-4c41-4d10-a0f9-e29182da7463 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:10:53.197735 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cb3352-4c41-4d10-a0f9-e29182da7463 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:10:53.199186 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cb3352-4c41-4d10-a0f9-e29182da7463 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:10:53.208840 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 667/1349] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:10:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:10:58.528834 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f8910d-aab3-442b-969a-f19220c0ffff None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:10:58.529724 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f8910d-aab3-442b-969a-f19220c0ffff None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:10:58.530161 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f8910d-aab3-442b-969a-f19220c0ffff None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:10:58.532067 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 683/1350] 10.222.0.65 () {54 vars in 921 bytes} [Tue May 10 03:10:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:10:58.536738 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68192f5b-c39b-4f58-9c85-c4a72ad50411 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:10:58.537139 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68192f5b-c39b-4f58-9c85-c4a72ad50411 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:10:58.537296 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68192f5b-c39b-4f58-9c85-c4a72ad50411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:10:58.639237 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-68192f5b-c39b-4f58-9c85-c4a72ad50411 None None] MFA Rules not processed for user `f646147bdad8476ba0ab9da5d9c50b55`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:10:58.640634 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-68192f5b-c39b-4f58-9c85-c4a72ad50411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:10:58.805576 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 668/1351] 10.222.0.65 () {58 vars in 1018 bytes} [Tue May 10 03:10:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:11:02.972125 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ad1c8-65bf-42e4-b050-f6ad8ec30a9d None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:11:02.972702 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ad1c8-65bf-42e4-b050-f6ad8ec30a9d None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:11:02.972702 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ad1c8-65bf-42e4-b050-f6ad8ec30a9d None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:11:02.974331 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 684/1352] 10.222.0.65 () {54 vars in 921 bytes} [Tue May 10 03:11:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:11:02.979890 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3af1dc-09ff-405c-b11a-f777d788e3c2 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:11:02.980720 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3af1dc-09ff-405c-b11a-f777d788e3c2 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:11:02.981265 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3af1dc-09ff-405c-b11a-f777d788e3c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:11:03.000302 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-5c3af1dc-09ff-405c-b11a-f777d788e3c2 None None] MFA Rules not processed for user `f646147bdad8476ba0ab9da5d9c50b55`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:11:03.001499 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-5c3af1dc-09ff-405c-b11a-f777d788e3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:11:03.010116 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 669/1353] 10.222.0.65 () {58 vars in 1018 bytes} [Tue May 10 03:11:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:11:04.780115 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d7c50-a41a-438a-be19-2ce8564260e8 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:11:04.780608 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d7c50-a41a-438a-be19-2ce8564260e8 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:11:04.780608 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d7c50-a41a-438a-be19-2ce8564260e8 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:11:04.782005 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 685/1354] 10.222.0.65 () {54 vars in 921 bytes} [Tue May 10 03:11:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:11:04.787055 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883d428-60cc-4d60-bb5b-5eb7e28115c3 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:11:04.787457 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883d428-60cc-4d60-bb5b-5eb7e28115c3 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:11:04.787640 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883d428-60cc-4d60-bb5b-5eb7e28115c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:11:04.806474 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-3883d428-60cc-4d60-bb5b-5eb7e28115c3 None None] MFA Rules not processed for user `f646147bdad8476ba0ab9da5d9c50b55`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:11:04.808328 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-3883d428-60cc-4d60-bb5b-5eb7e28115c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:11:04.817159 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 670/1355] 10.222.0.65 () {58 vars in 1018 bytes} [Tue May 10 03:11:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:11:08.598067 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685659b-83a7-4d22-a722-61e8863cdcc9 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:11:08.598594 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685659b-83a7-4d22-a722-61e8863cdcc9 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:11:08.598594 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685659b-83a7-4d22-a722-61e8863cdcc9 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:11:08.600147 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 686/1356] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:11:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:11:08.605392 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7f681-8ede-427b-8b6a-03481067e9d6 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:11:08.605850 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7f681-8ede-427b-8b6a-03481067e9d6 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:11:08.605949 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7f681-8ede-427b-8b6a-03481067e9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:11:08.624161 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-bea7f681-8ede-427b-8b6a-03481067e9d6 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:11:08.625347 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-bea7f681-8ede-427b-8b6a-03481067e9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:11:08.637691 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 671/1357] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:11:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:11:08.683158 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82593396-b3ba-4cef-84d3-63558d41040d None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:11:08.683783 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82593396-b3ba-4cef-84d3-63558d41040d None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:11:08.684282 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82593396-b3ba-4cef-84d3-63558d41040d None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:11:08.686157 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 687/1358] 10.222.0.65 () {54 vars in 961 bytes} [Tue May 10 03:11:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:11:08.692547 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32f0d5-18ae-46a7-905e-0feacebf7e28 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:11:08.693100 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32f0d5-18ae-46a7-905e-0feacebf7e28 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:11:08.693528 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32f0d5-18ae-46a7-905e-0feacebf7e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:11:08.746276 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-9f32f0d5-18ae-46a7-905e-0feacebf7e28 None None] MFA Rules not processed for user `9b7ccdccba0b4f9e86817946f22dbe28`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:11:08.747453 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-9f32f0d5-18ae-46a7-905e-0feacebf7e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:11:08.827313 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 672/1359] 10.222.0.65 () {58 vars in 1058 bytes} [Tue May 10 03:11:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:11:08.835222 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82593396-b3ba-4cef-84d3-63558d41040d None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:11:08.849779 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82593396-b3ba-4cef-84d3-63558d41040d None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:11:08.855409 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6923bd90-cc13-41fd-b9c1-d56750b0733e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b7ccdccba0b4f9e86817946f22dbe28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:11:08.856215 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923bd90-cc13-41fd-b9c1-d56750b0733e service nova] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:11:08.856596 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923bd90-cc13-41fd-b9c1-d56750b0733e service nova] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:11:08.856968 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923bd90-cc13-41fd-b9c1-d56750b0733e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:11:08.864971 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6923bd90-cc13-41fd-b9c1-d56750b0733e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:11:08.866645 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6923bd90-cc13-41fd-b9c1-d56750b0733e service nova] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:11:08.876658 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 688/1360] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:11:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:11:11.327914 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bee081-9433-4136-b1ed-2472dd96e1d0 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:11:11.328867 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bee081-9433-4136-b1ed-2472dd96e1d0 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:11:11.329303 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bee081-9433-4136-b1ed-2472dd96e1d0 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:11:11.336210 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa327cba-d9bf-456b-b844-cf459e7e3a2e None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:11:11.336982 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa327cba-d9bf-456b-b844-cf459e7e3a2e None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:11:11.337415 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa327cba-d9bf-456b-b844-cf459e7e3a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:11:11.339755 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 673/1361] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:11:11 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:11:11.356188 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-aa327cba-d9bf-456b-b844-cf459e7e3a2e None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:11:11.357396 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-aa327cba-d9bf-456b-b844-cf459e7e3a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:11:11.365425 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 689/1362] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:11:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:11:11.409440 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bee081-9433-4136-b1ed-2472dd96e1d0 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:11:11.426769 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bee081-9433-4136-b1ed-2472dd96e1d0 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:11:11.433592 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f417ce3-4408-4c31-8424-a482d53673fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b7ccdccba0b4f9e86817946f22dbe28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:11:11.434466 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f417ce3-4408-4c31-8424-a482d53673fc service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:11:11.434937 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f417ce3-4408-4c31-8424-a482d53673fc service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:11:11.435470 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f417ce3-4408-4c31-8424-a482d53673fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:11:11.444637 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f417ce3-4408-4c31-8424-a482d53673fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:11:11.446461 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f417ce3-4408-4c31-8424-a482d53673fc service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:11:11.459279 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 674/1363] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:11:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:11:14.163415 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce616960-0968-4056-aeac-f4ced91e4a93 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:11:14.163963 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce616960-0968-4056-aeac-f4ced91e4a93 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:11:14.163963 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce616960-0968-4056-aeac-f4ced91e4a93 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:11:14.165554 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 690/1364] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:11:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:11:14.170759 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f174303-9210-45d2-afbb-cd870ed2e2e4 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:11:14.171249 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f174303-9210-45d2-afbb-cd870ed2e2e4 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:11:14.171354 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f174303-9210-45d2-afbb-cd870ed2e2e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:11:14.189134 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-0f174303-9210-45d2-afbb-cd870ed2e2e4 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:11:14.190320 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-0f174303-9210-45d2-afbb-cd870ed2e2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:11:14.198775 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 675/1365] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:11:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:11:14.242483 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e154a-4bd3-406f-860e-757cd30bc8a4 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:11:14.242785 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e154a-4bd3-406f-860e-757cd30bc8a4 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:11:14.243044 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e154a-4bd3-406f-860e-757cd30bc8a4 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:11:14.244429 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 691/1366] 10.222.0.65 () {54 vars in 961 bytes} [Tue May 10 03:11:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:11:14.250357 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9dbd0e-ba5f-4093-b25a-066fca71aefb None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:11:14.250723 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9dbd0e-ba5f-4093-b25a-066fca71aefb None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:11:14.251006 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9dbd0e-ba5f-4093-b25a-066fca71aefb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:11:14.269160 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-2d9dbd0e-ba5f-4093-b25a-066fca71aefb None None] MFA Rules not processed for user `9b7ccdccba0b4f9e86817946f22dbe28`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:11:14.270333 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-2d9dbd0e-ba5f-4093-b25a-066fca71aefb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:11:14.279375 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 676/1367] 10.222.0.65 () {58 vars in 1058 bytes} [Tue May 10 03:11:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:11:14.286813 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e154a-4bd3-406f-860e-757cd30bc8a4 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:11:14.300876 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e154a-4bd3-406f-860e-757cd30bc8a4 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:11:14.306294 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101bf283-290b-48c4-8f7f-c849b1c14c3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b7ccdccba0b4f9e86817946f22dbe28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:11:14.306919 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101bf283-290b-48c4-8f7f-c849b1c14c3f service nova] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:11:14.307710 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101bf283-290b-48c4-8f7f-c849b1c14c3f service nova] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:11:14.308010 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101bf283-290b-48c4-8f7f-c849b1c14c3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:11:14.315887 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101bf283-290b-48c4-8f7f-c849b1c14c3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:11:14.317467 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101bf283-290b-48c4-8f7f-c849b1c14c3f service nova] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:11:14.327208 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 692/1368] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:11:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:11:16.843212 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3caa2-09e1-46d9-b072-ec2f8ff53086 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:11:16.844097 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3caa2-09e1-46d9-b072-ec2f8ff53086 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:11:16.844551 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3caa2-09e1-46d9-b072-ec2f8ff53086 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:11:16.846371 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 677/1369] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:11:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:11:16.851630 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2dea24-c0c0-473c-9731-3c74e125500e None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:11:16.852077 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2dea24-c0c0-473c-9731-3c74e125500e None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:11:16.852227 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2dea24-c0c0-473c-9731-3c74e125500e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:11:16.866412 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce5229-4cb1-484e-bddf-c29dbf902369 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:11:16.866837 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce5229-4cb1-484e-bddf-c29dbf902369 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:11:16.867244 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce5229-4cb1-484e-bddf-c29dbf902369 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:11:16.868941 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 678/1370] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:11:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:11:16.871526 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-4a2dea24-c0c0-473c-9731-3c74e125500e None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:11:16.872745 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-4a2dea24-c0c0-473c-9731-3c74e125500e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:11:16.874618 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8921665-c370-4a88-b58f-5806389ea8b4 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:11:16.874907 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8921665-c370-4a88-b58f-5806389ea8b4 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:11:16.875378 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8921665-c370-4a88-b58f-5806389ea8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:11:16.888851 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 693/1371] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:11:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:11:16.893358 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-b8921665-c370-4a88-b58f-5806389ea8b4 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:11:16.894760 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-b8921665-c370-4a88-b58f-5806389ea8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:11:16.902948 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 679/1372] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:11:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:11:16.951510 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2dea24-c0c0-473c-9731-3c74e125500e None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:11:16.965013 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2dea24-c0c0-473c-9731-3c74e125500e None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:11:16.970546 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e38ef66-40bd-4cd6-9459-c667b02a2551 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b7ccdccba0b4f9e86817946f22dbe28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:11:16.971206 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38ef66-40bd-4cd6-9459-c667b02a2551 service nova] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:11:16.971493 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38ef66-40bd-4cd6-9459-c667b02a2551 service nova] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:11:16.971774 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38ef66-40bd-4cd6-9459-c667b02a2551 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:11:16.981098 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e38ef66-40bd-4cd6-9459-c667b02a2551 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:11:16.982676 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e38ef66-40bd-4cd6-9459-c667b02a2551 service nova] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:11:16.992569 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 694/1373] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:11:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:11:17.161574 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d932dd-1568-4175-9011-d733ecf2464e None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:11:17.161972 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d932dd-1568-4175-9011-d733ecf2464e None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:11:17.162356 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d932dd-1568-4175-9011-d733ecf2464e None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:11:17.164036 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 680/1374] 10.222.0.65 () {54 vars in 963 bytes} [Tue May 10 03:11:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:11:17.170260 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65522ab-423b-4d5c-9863-dcc056208529 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:11:17.174232 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65522ab-423b-4d5c-9863-dcc056208529 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:11:17.174232 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65522ab-423b-4d5c-9863-dcc056208529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:11:17.224149 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-c65522ab-423b-4d5c-9863-dcc056208529 None None] MFA Rules not processed for user `3509cdb58f6a4d05a7ed79e46791ac19`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:11:17.225543 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-c65522ab-423b-4d5c-9863-dcc056208529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:11:17.298906 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 695/1375] 10.222.0.65 () {58 vars in 1060 bytes} [Tue May 10 03:11:17 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:11:17.300988 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d932dd-1568-4175-9011-d733ecf2464e None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:11:17.312590 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d932dd-1568-4175-9011-d733ecf2464e None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:11:17.316622 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d0536-e57f-40f6-8659-6b01892d1099 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:11:17.317403 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d0536-e57f-40f6-8659-6b01892d1099 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:11:17.317916 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d0536-e57f-40f6-8659-6b01892d1099 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:11:17.318296 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d0536-e57f-40f6-8659-6b01892d1099 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:11:17.329401 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189d0536-e57f-40f6-8659-6b01892d1099 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:11:17.331058 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189d0536-e57f-40f6-8659-6b01892d1099 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:11:17.342672 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 681/1376] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:11:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:11:19.414162 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb7a46-2f79-4dbc-9ab8-8c1fb9c4e35b None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:11:19.414847 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb7a46-2f79-4dbc-9ab8-8c1fb9c4e35b None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:11:19.415223 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb7a46-2f79-4dbc-9ab8-8c1fb9c4e35b None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:11:19.417519 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 696/1377] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:11:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:11:19.424057 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41f9ef-45f7-4176-8b04-439e7dc79c1a None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:11:19.424627 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41f9ef-45f7-4176-8b04-439e7dc79c1a None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:11:19.424977 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41f9ef-45f7-4176-8b04-439e7dc79c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:11:19.442968 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-0c41f9ef-45f7-4176-8b04-439e7dc79c1a None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:11:19.444225 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-0c41f9ef-45f7-4176-8b04-439e7dc79c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:11:19.452396 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 682/1378] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:11:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:11:19.502494 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eb7a46-2f79-4dbc-9ab8-8c1fb9c4e35b None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:11:19.509863 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eb7a46-2f79-4dbc-9ab8-8c1fb9c4e35b None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:11:19.516897 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b16bf36-54e4-4734-b291-357557f6d483 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b7ccdccba0b4f9e86817946f22dbe28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:11:19.517550 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b16bf36-54e4-4734-b291-357557f6d483 service nova] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:11:19.517834 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b16bf36-54e4-4734-b291-357557f6d483 service nova] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:11:19.518110 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b16bf36-54e4-4734-b291-357557f6d483 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:11:19.527456 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b16bf36-54e4-4734-b291-357557f6d483 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:11:19.529426 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b16bf36-54e4-4734-b291-357557f6d483 service nova] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:11:19.539481 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 697/1379] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:11:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:11:21.941562 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50967512-4458-456a-a2dd-bacada05ba85 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:11:21.942134 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50967512-4458-456a-a2dd-bacada05ba85 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:11:21.942134 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50967512-4458-456a-a2dd-bacada05ba85 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:11:21.943464 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 683/1380] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:11:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:11:21.948662 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6c459-f360-48de-a3ff-09082a1307e2 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:11:21.949071 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6c459-f360-48de-a3ff-09082a1307e2 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:11:21.949220 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6c459-f360-48de-a3ff-09082a1307e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:11:21.966784 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-ece6c459-f360-48de-a3ff-09082a1307e2 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:11:21.967996 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-ece6c459-f360-48de-a3ff-09082a1307e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:11:21.976443 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 698/1381] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:11:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:11:22.024329 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50967512-4458-456a-a2dd-bacada05ba85 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:11:22.039228 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50967512-4458-456a-a2dd-bacada05ba85 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:11:22.045857 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c590cd0e-86c6-47bb-9732-9cd0a622d079 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b7ccdccba0b4f9e86817946f22dbe28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:11:22.046635 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590cd0e-86c6-47bb-9732-9cd0a622d079 service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:11:22.047016 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590cd0e-86c6-47bb-9732-9cd0a622d079 service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:11:22.047392 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590cd0e-86c6-47bb-9732-9cd0a622d079 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:11:22.056269 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c590cd0e-86c6-47bb-9732-9cd0a622d079 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:11:22.058583 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c590cd0e-86c6-47bb-9732-9cd0a622d079 service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:11:22.069367 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 684/1382] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:11:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:11:24.458415 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa53a9-df92-4f06-a0e5-28f558ca9042 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:11:24.459196 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa53a9-df92-4f06-a0e5-28f558ca9042 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:11:24.459634 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa53a9-df92-4f06-a0e5-28f558ca9042 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:11:24.461205 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 699/1383] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:11:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:11:24.467347 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe0e64-1302-4d8c-8e11-338776f447f3 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:11:24.467815 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe0e64-1302-4d8c-8e11-338776f447f3 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:11:24.468160 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe0e64-1302-4d8c-8e11-338776f447f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:11:24.489080 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-59fe0e64-1302-4d8c-8e11-338776f447f3 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:11:24.490572 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-59fe0e64-1302-4d8c-8e11-338776f447f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:11:24.499662 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 685/1384] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:11:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:11:24.543480 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fa53a9-df92-4f06-a0e5-28f558ca9042 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:11:24.559161 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fa53a9-df92-4f06-a0e5-28f558ca9042 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:11:24.565034 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d5db4-c7ed-4d6a-a70b-1a86809b5a10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b7ccdccba0b4f9e86817946f22dbe28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:11:24.565676 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d5db4-c7ed-4d6a-a70b-1a86809b5a10 service nova] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:11:24.565962 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d5db4-c7ed-4d6a-a70b-1a86809b5a10 service nova] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:11:24.566236 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d5db4-c7ed-4d6a-a70b-1a86809b5a10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:11:24.575516 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71d5db4-c7ed-4d6a-a70b-1a86809b5a10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:11:24.581235 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71d5db4-c7ed-4d6a-a70b-1a86809b5a10 service nova] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:11:24.593030 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 700/1385] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:11:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:11:27.170813 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e42362-5868-4117-9619-3d88681be864 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:11:27.171355 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e42362-5868-4117-9619-3d88681be864 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:11:27.171472 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e42362-5868-4117-9619-3d88681be864 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:11:27.172884 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 686/1386] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:11:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:11:27.179350 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2955d7-4fb6-4c84-8faf-f8c6433b773c None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:11:27.179805 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2955d7-4fb6-4c84-8faf-f8c6433b773c None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:11:27.180181 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2955d7-4fb6-4c84-8faf-f8c6433b773c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:11:27.201738 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-9c2955d7-4fb6-4c84-8faf-f8c6433b773c None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:11:27.203221 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-9c2955d7-4fb6-4c84-8faf-f8c6433b773c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:11:27.212392 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 701/1387] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:11:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:11:27.263386 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e42362-5868-4117-9619-3d88681be864 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:11:27.279003 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e42362-5868-4117-9619-3d88681be864 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:11:27.284699 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb9bb75-ce89-4e69-9892-98e9e665d1a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b7ccdccba0b4f9e86817946f22dbe28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:11:27.285394 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9bb75-ce89-4e69-9892-98e9e665d1a4 service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:11:27.285680 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9bb75-ce89-4e69-9892-98e9e665d1a4 service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:11:27.285985 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9bb75-ce89-4e69-9892-98e9e665d1a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:11:27.294885 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb9bb75-ce89-4e69-9892-98e9e665d1a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:11:27.296634 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb9bb75-ce89-4e69-9892-98e9e665d1a4 service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:11:27.306487 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 687/1388] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:11:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:11:29.704593 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dedc902-b7ed-49bd-94c4-2c730336ef95 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:11:29.705120 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dedc902-b7ed-49bd-94c4-2c730336ef95 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:11:29.705221 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dedc902-b7ed-49bd-94c4-2c730336ef95 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:11:29.707088 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 702/1389] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:11:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:11:29.714236 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b64952-351c-4534-9203-d3249fb3ead1 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:11:29.714800 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b64952-351c-4534-9203-d3249fb3ead1 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:11:29.714800 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b64952-351c-4534-9203-d3249fb3ead1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:11:29.732799 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-f7b64952-351c-4534-9203-d3249fb3ead1 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:11:29.734013 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-f7b64952-351c-4534-9203-d3249fb3ead1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:11:29.742035 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 688/1390] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:11:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:11:29.787122 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dedc902-b7ed-49bd-94c4-2c730336ef95 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:11:29.802131 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dedc902-b7ed-49bd-94c4-2c730336ef95 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:11:29.808234 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb0d3c0-e44e-438e-8d10-6d88cd370e9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b7ccdccba0b4f9e86817946f22dbe28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:11:29.808874 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb0d3c0-e44e-438e-8d10-6d88cd370e9a service nova] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:11:29.809159 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb0d3c0-e44e-438e-8d10-6d88cd370e9a service nova] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:11:29.809436 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb0d3c0-e44e-438e-8d10-6d88cd370e9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:11:29.817825 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb0d3c0-e44e-438e-8d10-6d88cd370e9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:11:29.819393 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb0d3c0-e44e-438e-8d10-6d88cd370e9a service nova] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:11:29.829549 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 703/1391] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:11:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:11:32.385341 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97450ae-3132-4b5c-8ecd-66b7b9255e03 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:11:32.385944 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97450ae-3132-4b5c-8ecd-66b7b9255e03 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:11:32.385944 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97450ae-3132-4b5c-8ecd-66b7b9255e03 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:11:32.387280 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 689/1392] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:11:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:11:32.392805 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91043213-28e0-4b5b-baaa-a9f973d77b76 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:11:32.393237 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91043213-28e0-4b5b-baaa-a9f973d77b76 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:11:32.393368 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91043213-28e0-4b5b-baaa-a9f973d77b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:11:32.411520 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-91043213-28e0-4b5b-baaa-a9f973d77b76 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:11:32.412747 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-91043213-28e0-4b5b-baaa-a9f973d77b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:11:32.422382 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 704/1393] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:11:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:11:32.466725 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97450ae-3132-4b5c-8ecd-66b7b9255e03 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:11:32.481808 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97450ae-3132-4b5c-8ecd-66b7b9255e03 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:11:32.487231 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d897b6e3-3fcf-4556-80ea-3380447afdfe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b7ccdccba0b4f9e86817946f22dbe28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:11:32.487870 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897b6e3-3fcf-4556-80ea-3380447afdfe service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:11:32.488187 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897b6e3-3fcf-4556-80ea-3380447afdfe service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:11:32.488469 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897b6e3-3fcf-4556-80ea-3380447afdfe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:11:32.499355 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d897b6e3-3fcf-4556-80ea-3380447afdfe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:11:32.501160 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d897b6e3-3fcf-4556-80ea-3380447afdfe service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:11:32.511214 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 690/1394] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:11:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:11:33.324087 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901db45e-1c1d-4f63-b86d-7b81900d3d99 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:11:33.324376 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901db45e-1c1d-4f63-b86d-7b81900d3d99 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:11:33.324653 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901db45e-1c1d-4f63-b86d-7b81900d3d99 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:11:33.326053 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 705/1395] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:11:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:11:33.331410 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d91252-0bbf-4137-88fb-e21c76023e2b None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:11:33.331704 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d91252-0bbf-4137-88fb-e21c76023e2b None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:11:33.331986 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d91252-0bbf-4137-88fb-e21c76023e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:11:33.349956 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-85d91252-0bbf-4137-88fb-e21c76023e2b None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:11:33.351158 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-85d91252-0bbf-4137-88fb-e21c76023e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:11:33.360143 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 691/1396] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:11:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:11:33.414528 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3361b-0b14-4142-b07b-d2df3eea0909 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:11:33.415296 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3361b-0b14-4142-b07b-d2df3eea0909 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:11:33.415400 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3361b-0b14-4142-b07b-d2df3eea0909 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:11:33.416768 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 706/1397] 10.222.0.65 () {54 vars in 962 bytes} [Tue May 10 03:11:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:11:33.422717 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac974c-296c-461b-bb74-d03e6c9022eb None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:11:33.423187 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac974c-296c-461b-bb74-d03e6c9022eb None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:11:33.423409 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac974c-296c-461b-bb74-d03e6c9022eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:11:33.482765 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-e1ac974c-296c-461b-bb74-d03e6c9022eb None None] MFA Rules not processed for user `c79f0a3a3223444c82589da07305469f`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:11:33.484347 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-e1ac974c-296c-461b-bb74-d03e6c9022eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:11:33.547688 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 692/1398] 10.222.0.65 () {58 vars in 1059 bytes} [Tue May 10 03:11:33 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:11:33.557683 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3361b-0b14-4142-b07b-d2df3eea0909 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:11:33.567985 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3361b-0b14-4142-b07b-d2df3eea0909 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:11:33.571487 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b5fb7c-95a9-4812-8614-ff87e1978fc5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c79f0a3a3223444c82589da07305469f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:11:33.572180 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b5fb7c-95a9-4812-8614-ff87e1978fc5 service glance] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:11:33.572999 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b5fb7c-95a9-4812-8614-ff87e1978fc5 service glance] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:11:33.573274 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b5fb7c-95a9-4812-8614-ff87e1978fc5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:11:33.581978 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b5fb7c-95a9-4812-8614-ff87e1978fc5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:11:33.583313 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b5fb7c-95a9-4812-8614-ff87e1978fc5 service glance] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:11:33.592406 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 707/1399] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:11:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:11:34.152670 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468fabe5-84b8-4dd5-be84-228ff649a58b None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:11:34.164266 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468fabe5-84b8-4dd5-be84-228ff649a58b None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:11:34.164266 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468fabe5-84b8-4dd5-be84-228ff649a58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:11:34.208266 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-468fabe5-84b8-4dd5-be84-228ff649a58b None None] MFA Rules not processed for user `6ebfab3ff0b24f4aaabb8c6bb0ad10c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:11:34.209465 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-468fabe5-84b8-4dd5-be84-228ff649a58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:11:34.270335 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 693/1400] 10.222.0.65 () {58 vars in 1009 bytes} [Tue May 10 03:11:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:11:34.312234 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1fc66e-8e97-4486-a7bc-496641353010 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:11:34.312599 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1fc66e-8e97-4486-a7bc-496641353010 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:11:34.312964 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1fc66e-8e97-4486-a7bc-496641353010 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:11:34.314423 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 708/1401] 10.222.0.65 () {54 vars in 942 bytes} [Tue May 10 03:11:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:11:34.320813 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d7f8b-a4fb-46df-a7e9-7da1ff845055 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:11:34.321103 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d7f8b-a4fb-46df-a7e9-7da1ff845055 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:11:34.321382 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d7f8b-a4fb-46df-a7e9-7da1ff845055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:11:34.368958 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-326d7f8b-a4fb-46df-a7e9-7da1ff845055 None None] MFA Rules not processed for user `f1cb8ad43a234233ad602f451f0f8ebf`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:11:34.370198 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-326d7f8b-a4fb-46df-a7e9-7da1ff845055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:11:34.438992 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 694/1402] 10.222.0.65 () {58 vars in 1039 bytes} [Tue May 10 03:11:34 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:11:34.448560 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1fc66e-8e97-4486-a7bc-496641353010 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:11:34.466019 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1fc66e-8e97-4486-a7bc-496641353010 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:11:34.471715 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d92e49-9d7a-486a-a39b-771a177e27fa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1cb8ad43a234233ad602f451f0f8ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:11:34.472531 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d92e49-9d7a-486a-a39b-771a177e27fa service swift] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:11:34.472908 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d92e49-9d7a-486a-a39b-771a177e27fa service swift] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:11:34.473278 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d92e49-9d7a-486a-a39b-771a177e27fa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:11:34.482463 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d92e49-9d7a-486a-a39b-771a177e27fa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:11:34.488935 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d92e49-9d7a-486a-a39b-771a177e27fa service swift] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:11:34.493308 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 709/1403] 10.222.0.65 () {60 vars in 1384 bytes} [Tue May 10 03:11:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 03:11:34.922163 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9ed7c-d9b4-49b3-8ca7-ab23be388ea1 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:11:34.922453 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9ed7c-d9b4-49b3-8ca7-ab23be388ea1 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:11:34.922735 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9ed7c-d9b4-49b3-8ca7-ab23be388ea1 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:11:34.924134 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 695/1404] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:11:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:11:34.929400 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8edf2-ab5c-4290-867e-ab0409620988 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:11:34.932177 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8edf2-ab5c-4290-867e-ab0409620988 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:11:34.932177 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8edf2-ab5c-4290-867e-ab0409620988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:11:34.947717 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-afe8edf2-ab5c-4290-867e-ab0409620988 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:11:34.948962 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-afe8edf2-ab5c-4290-867e-ab0409620988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:11:34.957100 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 710/1405] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:11:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:11:35.001967 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c9ed7c-d9b4-49b3-8ca7-ab23be388ea1 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:11:35.021090 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c9ed7c-d9b4-49b3-8ca7-ab23be388ea1 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:11:35.026592 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4386f17-cddd-4f72-a446-efd83a1dc7c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b7ccdccba0b4f9e86817946f22dbe28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:11:35.027241 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4386f17-cddd-4f72-a446-efd83a1dc7c3 service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:11:35.027523 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4386f17-cddd-4f72-a446-efd83a1dc7c3 service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:11:35.027801 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4386f17-cddd-4f72-a446-efd83a1dc7c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:11:35.036723 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4386f17-cddd-4f72-a446-efd83a1dc7c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:11:35.038334 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4386f17-cddd-4f72-a446-efd83a1dc7c3 service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:11:35.048647 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 696/1406] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:11:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:11:37.477387 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23866f-33ff-41a3-bfc7-ee56ffa23897 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:11:37.477963 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23866f-33ff-41a3-bfc7-ee56ffa23897 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:11:37.477963 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23866f-33ff-41a3-bfc7-ee56ffa23897 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:11:37.480086 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 711/1407] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:11:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:11:37.485457 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9712c-2261-41ec-ab8f-60980a7b500f None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:11:37.485907 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9712c-2261-41ec-ab8f-60980a7b500f None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:11:37.486020 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9712c-2261-41ec-ab8f-60980a7b500f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:11:37.505916 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-17a9712c-2261-41ec-ab8f-60980a7b500f None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:11:37.507198 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-17a9712c-2261-41ec-ab8f-60980a7b500f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:11:37.524386 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 697/1408] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:11:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:11:37.565717 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a23866f-33ff-41a3-bfc7-ee56ffa23897 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:11:37.583700 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a23866f-33ff-41a3-bfc7-ee56ffa23897 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:11:37.589805 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23873dc6-8031-4252-aa40-4f9ef79a35ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b7ccdccba0b4f9e86817946f22dbe28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:11:37.590641 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23873dc6-8031-4252-aa40-4f9ef79a35ca service nova] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:11:37.590956 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23873dc6-8031-4252-aa40-4f9ef79a35ca service nova] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:11:37.591233 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23873dc6-8031-4252-aa40-4f9ef79a35ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:11:37.600044 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23873dc6-8031-4252-aa40-4f9ef79a35ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:11:37.601639 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23873dc6-8031-4252-aa40-4f9ef79a35ca service nova] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:11:37.613299 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 712/1409] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:11:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:11:59.336335 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824adac-95ca-4669-bd49-75857fab733e None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:11:59.336994 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824adac-95ca-4669-bd49-75857fab733e None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:11:59.336994 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824adac-95ca-4669-bd49-75857fab733e None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:11:59.338271 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 698/1410] 10.222.0.65 () {54 vars in 918 bytes} [Tue May 10 03:11:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:11:59.343514 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933b8d8-b7e5-4069-83a8-0bec5ab8f23b None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:11:59.343985 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933b8d8-b7e5-4069-83a8-0bec5ab8f23b None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:11:59.344124 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933b8d8-b7e5-4069-83a8-0bec5ab8f23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:11:59.362301 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-6933b8d8-b7e5-4069-83a8-0bec5ab8f23b None None] MFA Rules not processed for user `f646147bdad8476ba0ab9da5d9c50b55`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:11:59.363499 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-6933b8d8-b7e5-4069-83a8-0bec5ab8f23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:11:59.373007 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 713/1411] 10.222.0.65 () {58 vars in 1015 bytes} [Tue May 10 03:11:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:11:59.387010 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa5d9da-43d7-47ad-a051-4e0b24f6c038 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:11:59.387297 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa5d9da-43d7-47ad-a051-4e0b24f6c038 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:11:59.387573 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa5d9da-43d7-47ad-a051-4e0b24f6c038 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:11:59.388935 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 699/1412] 10.222.0.65 () {54 vars in 918 bytes} [Tue May 10 03:11:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:11:59.393619 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49f472-8bde-46ee-93b0-111777bdc577 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:11:59.393899 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49f472-8bde-46ee-93b0-111777bdc577 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:11:59.394173 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49f472-8bde-46ee-93b0-111777bdc577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:11:59.411946 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-2e49f472-8bde-46ee-93b0-111777bdc577 None None] MFA Rules not processed for user `9b7ccdccba0b4f9e86817946f22dbe28`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:11:59.413165 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-2e49f472-8bde-46ee-93b0-111777bdc577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:11:59.422999 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 714/1413] 10.222.0.65 () {58 vars in 1015 bytes} [Tue May 10 03:11:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:12:02.058775 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca6a5d-881b-461d-86db-85ebd661186e None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:02.059339 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca6a5d-881b-461d-86db-85ebd661186e None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:02.059339 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca6a5d-881b-461d-86db-85ebd661186e None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:02.060697 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 700/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 03:12:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:12:02.065882 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ffba71-7c1d-4457-baf5-193fb084ad76 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:02.066295 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ffba71-7c1d-4457-baf5-193fb084ad76 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:02.066435 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ffba71-7c1d-4457-baf5-193fb084ad76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:02.083344 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-67ffba71-7c1d-4457-baf5-193fb084ad76 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:12:02.084560 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-67ffba71-7c1d-4457-baf5-193fb084ad76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:12:02.092689 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 715/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 03:12:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:12:02.133067 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ca6a5d-881b-461d-86db-85ebd661186e None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:12:02.146859 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ca6a5d-881b-461d-86db-85ebd661186e None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:12:02.152698 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e3af9-5bff-46d8-9fde-09049df31f98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b7ccdccba0b4f9e86817946f22dbe28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:12:02.153317 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e3af9-5bff-46d8-9fde-09049df31f98 service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:02.153596 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e3af9-5bff-46d8-9fde-09049df31f98 service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:02.153869 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e3af9-5bff-46d8-9fde-09049df31f98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:02.161643 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416e3af9-5bff-46d8-9fde-09049df31f98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:12:02.163206 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416e3af9-5bff-46d8-9fde-09049df31f98 service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:12:02.173035 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 701/1416] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:12:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:12:03.168936 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2de19c-04d4-4822-9cdd-d9534c0f48c5 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:03.169506 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2de19c-04d4-4822-9cdd-d9534c0f48c5 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:03.169506 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2de19c-04d4-4822-9cdd-d9534c0f48c5 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:03.170851 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 716/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 03:12:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:12:03.175780 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c13d62-cd0c-40d1-8559-0b9121a4fa2b None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:03.176225 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c13d62-cd0c-40d1-8559-0b9121a4fa2b None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:03.176367 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c13d62-cd0c-40d1-8559-0b9121a4fa2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:03.193832 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-05c13d62-cd0c-40d1-8559-0b9121a4fa2b None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:12:03.195029 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-05c13d62-cd0c-40d1-8559-0b9121a4fa2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:12:03.203337 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 702/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 03:12:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:12:03.360283 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2de19c-04d4-4822-9cdd-d9534c0f48c5 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:12:03.374393 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2de19c-04d4-4822-9cdd-d9534c0f48c5 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:12:03.379645 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11de2140-d143-4ffc-b8c8-03ae74dece70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b7ccdccba0b4f9e86817946f22dbe28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:12:03.380317 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de2140-d143-4ffc-b8c8-03ae74dece70 service nova] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:03.380605 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de2140-d143-4ffc-b8c8-03ae74dece70 service nova] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:03.380881 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de2140-d143-4ffc-b8c8-03ae74dece70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:03.389330 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11de2140-d143-4ffc-b8c8-03ae74dece70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:12:03.390917 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11de2140-d143-4ffc-b8c8-03ae74dece70 service nova] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:12:03.400709 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 717/1419] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:12:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:12:04.364308 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed5951-686d-4af3-a08f-b9fd90f5c196 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:04.364875 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed5951-686d-4af3-a08f-b9fd90f5c196 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:04.364875 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed5951-686d-4af3-a08f-b9fd90f5c196 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:04.366239 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 703/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 03:12:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:12:04.371141 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a2d871-13e5-47ff-b748-80003a0598c5 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:04.371633 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a2d871-13e5-47ff-b748-80003a0598c5 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:04.371740 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a2d871-13e5-47ff-b748-80003a0598c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:04.390156 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-43a2d871-13e5-47ff-b748-80003a0598c5 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:12:04.391865 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-43a2d871-13e5-47ff-b748-80003a0598c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:12:04.399550 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 718/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 03:12:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:12:04.548259 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed5951-686d-4af3-a08f-b9fd90f5c196 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:12:04.562470 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed5951-686d-4af3-a08f-b9fd90f5c196 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:12:04.567851 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7ec8f5-70a7-4243-9cea-da29c76aede6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b7ccdccba0b4f9e86817946f22dbe28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:12:04.568521 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ec8f5-70a7-4243-9cea-da29c76aede6 service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:04.568811 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ec8f5-70a7-4243-9cea-da29c76aede6 service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:04.569090 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ec8f5-70a7-4243-9cea-da29c76aede6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:04.577673 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7ec8f5-70a7-4243-9cea-da29c76aede6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:12:04.579338 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7ec8f5-70a7-4243-9cea-da29c76aede6 service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:12:04.589487 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 704/1422] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:12:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:12:05.511086 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30290123-d333-4b7e-96be-f3247d78d65b None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:05.511648 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30290123-d333-4b7e-96be-f3247d78d65b None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:05.511648 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30290123-d333-4b7e-96be-f3247d78d65b None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:05.513022 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 719/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 03:12:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:12:05.518105 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af7d20-88b4-429a-bb52-5bfea5bde1e3 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:05.518505 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af7d20-88b4-429a-bb52-5bfea5bde1e3 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:05.518670 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af7d20-88b4-429a-bb52-5bfea5bde1e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:05.536810 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-f9af7d20-88b4-429a-bb52-5bfea5bde1e3 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:12:05.538002 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-f9af7d20-88b4-429a-bb52-5bfea5bde1e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:12:05.546907 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 705/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 03:12:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:12:05.695946 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30290123-d333-4b7e-96be-f3247d78d65b None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:12:05.709872 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30290123-d333-4b7e-96be-f3247d78d65b None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:12:05.715714 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8ed02-89fa-4678-b604-bb208db0b731 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b7ccdccba0b4f9e86817946f22dbe28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:12:05.716386 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8ed02-89fa-4678-b604-bb208db0b731 service nova] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:05.716672 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8ed02-89fa-4678-b604-bb208db0b731 service nova] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:05.716951 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8ed02-89fa-4678-b604-bb208db0b731 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:05.724814 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b8ed02-89fa-4678-b604-bb208db0b731 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:12:05.726371 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b8ed02-89fa-4678-b604-bb208db0b731 service nova] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:12:05.736143 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 720/1425] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:12:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:12:06.663204 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1eeac-fe47-45ec-9113-747c6dfa5e4d None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:06.663724 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1eeac-fe47-45ec-9113-747c6dfa5e4d None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:06.663822 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1eeac-fe47-45ec-9113-747c6dfa5e4d None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:06.665434 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 706/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 03:12:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:12:06.670259 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a860b-1bf9-42eb-82ad-9b4830ef9585 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:06.670662 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a860b-1bf9-42eb-82ad-9b4830ef9585 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:06.670814 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a860b-1bf9-42eb-82ad-9b4830ef9585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:06.688619 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-d85a860b-1bf9-42eb-82ad-9b4830ef9585 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:12:06.689799 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-d85a860b-1bf9-42eb-82ad-9b4830ef9585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:12:06.697997 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 721/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 03:12:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:12:06.845440 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a1eeac-fe47-45ec-9113-747c6dfa5e4d None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:12:06.859691 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a1eeac-fe47-45ec-9113-747c6dfa5e4d None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:12:06.864905 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d690c595-dc46-43d5-8be1-cd13497b36f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b7ccdccba0b4f9e86817946f22dbe28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:12:06.865532 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690c595-dc46-43d5-8be1-cd13497b36f3 service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:06.865811 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690c595-dc46-43d5-8be1-cd13497b36f3 service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:06.866084 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690c595-dc46-43d5-8be1-cd13497b36f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:06.874526 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d690c595-dc46-43d5-8be1-cd13497b36f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:12:06.876170 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d690c595-dc46-43d5-8be1-cd13497b36f3 service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:12:06.885501 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 707/1428] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:12:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:12:07.833518 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66d283-2d9a-476b-bc49-60944612ba99 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:07.834025 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66d283-2d9a-476b-bc49-60944612ba99 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:07.834025 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66d283-2d9a-476b-bc49-60944612ba99 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:07.835342 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 722/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 03:12:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:12:07.840264 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eafa44-18ee-4810-b2aa-d26caedca9fe None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:07.840673 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eafa44-18ee-4810-b2aa-d26caedca9fe None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:07.840860 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eafa44-18ee-4810-b2aa-d26caedca9fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:07.858889 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-95eafa44-18ee-4810-b2aa-d26caedca9fe None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:12:07.860117 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-95eafa44-18ee-4810-b2aa-d26caedca9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:12:07.867940 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 708/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 03:12:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:12:08.016000 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a66d283-2d9a-476b-bc49-60944612ba99 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:12:08.030027 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a66d283-2d9a-476b-bc49-60944612ba99 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:12:08.035329 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba96b37-c4eb-4617-944e-1db69417d6c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b7ccdccba0b4f9e86817946f22dbe28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:12:08.036096 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba96b37-c4eb-4617-944e-1db69417d6c7 service nova] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:08.036382 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba96b37-c4eb-4617-944e-1db69417d6c7 service nova] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:08.036660 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba96b37-c4eb-4617-944e-1db69417d6c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:08.044842 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba96b37-c4eb-4617-944e-1db69417d6c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:12:08.046432 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba96b37-c4eb-4617-944e-1db69417d6c7 service nova] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:12:08.056608 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 723/1431] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:12:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:12:08.958446 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d3c86-62a8-42da-9722-33d6d5fc593e None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:08.959038 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d3c86-62a8-42da-9722-33d6d5fc593e None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:08.959038 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d3c86-62a8-42da-9722-33d6d5fc593e None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:08.960439 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 709/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 03:12:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:12:08.965733 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98b811-21f2-4fe8-b8f9-1e3e4d3f0e6b None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:08.966173 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98b811-21f2-4fe8-b8f9-1e3e4d3f0e6b None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:08.966268 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98b811-21f2-4fe8-b8f9-1e3e4d3f0e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:08.984054 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-1c98b811-21f2-4fe8-b8f9-1e3e4d3f0e6b None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:12:08.985225 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-1c98b811-21f2-4fe8-b8f9-1e3e4d3f0e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:12:08.992769 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 724/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 03:12:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:12:09.140701 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73d3c86-62a8-42da-9722-33d6d5fc593e None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:12:09.155524 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73d3c86-62a8-42da-9722-33d6d5fc593e None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:12:09.160903 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4c069d-f999-42ea-bf58-15d87c02e80b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b7ccdccba0b4f9e86817946f22dbe28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:12:09.161536 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c069d-f999-42ea-bf58-15d87c02e80b service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:09.161819 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c069d-f999-42ea-bf58-15d87c02e80b service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:09.162096 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c069d-f999-42ea-bf58-15d87c02e80b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:09.170206 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4c069d-f999-42ea-bf58-15d87c02e80b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:12:09.171779 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4c069d-f999-42ea-bf58-15d87c02e80b service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:12:09.180903 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 710/1434] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:12:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:12:10.150076 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732c39e-4396-40e6-9218-17308ee037ce None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:10.150682 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732c39e-4396-40e6-9218-17308ee037ce None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:10.150794 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732c39e-4396-40e6-9218-17308ee037ce None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:10.152199 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 725/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 03:12:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:12:10.157237 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc784f-da58-4b35-b86b-90ccda93a41a None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:10.157641 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc784f-da58-4b35-b86b-90ccda93a41a None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:10.157802 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc784f-da58-4b35-b86b-90ccda93a41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:10.176214 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-71cc784f-da58-4b35-b86b-90ccda93a41a None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:12:10.177425 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-71cc784f-da58-4b35-b86b-90ccda93a41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:12:10.185844 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 711/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 03:12:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:12:10.334839 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5732c39e-4396-40e6-9218-17308ee037ce None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:12:10.349613 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5732c39e-4396-40e6-9218-17308ee037ce None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:12:10.355647 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b6306b-8430-41da-8be1-5c07caddbb87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b7ccdccba0b4f9e86817946f22dbe28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:12:10.356321 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6306b-8430-41da-8be1-5c07caddbb87 service nova] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:10.356605 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6306b-8430-41da-8be1-5c07caddbb87 service nova] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:10.356885 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6306b-8430-41da-8be1-5c07caddbb87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:10.364968 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b6306b-8430-41da-8be1-5c07caddbb87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:12:10.366644 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b6306b-8430-41da-8be1-5c07caddbb87 service nova] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:12:10.375835 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 726/1437] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:12:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:12:11.289145 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e18447-277d-42ac-af2c-23f046f70249 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:11.289730 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e18447-277d-42ac-af2c-23f046f70249 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:11.289730 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e18447-277d-42ac-af2c-23f046f70249 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:11.291301 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 712/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 03:12:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:12:11.296370 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b878f-0c69-4799-8976-85dfc070e584 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:11.296799 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b878f-0c69-4799-8976-85dfc070e584 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:11.296939 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b878f-0c69-4799-8976-85dfc070e584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:11.314831 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-036b878f-0c69-4799-8976-85dfc070e584 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:12:11.316078 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-036b878f-0c69-4799-8976-85dfc070e584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:12:11.324482 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 727/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 03:12:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:12:11.471468 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e18447-277d-42ac-af2c-23f046f70249 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:12:11.486130 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e18447-277d-42ac-af2c-23f046f70249 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:12:11.491617 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c324f02b-1c27-4456-b4b8-d21295da07dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b7ccdccba0b4f9e86817946f22dbe28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:12:11.492295 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c324f02b-1c27-4456-b4b8-d21295da07dd service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:11.492580 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c324f02b-1c27-4456-b4b8-d21295da07dd service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:11.492862 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c324f02b-1c27-4456-b4b8-d21295da07dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:11.501575 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c324f02b-1c27-4456-b4b8-d21295da07dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:12:11.503629 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c324f02b-1c27-4456-b4b8-d21295da07dd service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:12:11.512435 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 713/1440] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:12:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:12:13.580524 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d92267-1367-4d02-829c-0395e7b43571 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:13.581083 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d92267-1367-4d02-829c-0395e7b43571 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:13.581083 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d92267-1367-4d02-829c-0395e7b43571 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:13.582525 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 728/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 03:12:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:12:13.588551 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82af7f-a160-4549-a6f5-0473828ad704 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:13.588973 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82af7f-a160-4549-a6f5-0473828ad704 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:13.589283 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82af7f-a160-4549-a6f5-0473828ad704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:13.606517 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-ac82af7f-a160-4549-a6f5-0473828ad704 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:12:13.607715 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-ac82af7f-a160-4549-a6f5-0473828ad704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:12:13.615443 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 714/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 03:12:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:12:13.653887 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d92267-1367-4d02-829c-0395e7b43571 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:12:13.664200 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d92267-1367-4d02-829c-0395e7b43571 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:12:13.667916 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da47897-0750-4e99-a2f8-7153b3dc4a0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:12:13.668571 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da47897-0750-4e99-a2f8-7153b3dc4a0e service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:13.668854 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da47897-0750-4e99-a2f8-7153b3dc4a0e service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:13.669128 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da47897-0750-4e99-a2f8-7153b3dc4a0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:13.677812 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da47897-0750-4e99-a2f8-7153b3dc4a0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:12:13.679223 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da47897-0750-4e99-a2f8-7153b3dc4a0e service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:12:13.688306 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 729/1443] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:12:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:12:16.046240 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64439efa-208d-4a2a-a02c-2b8c65ce1353 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:16.046811 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64439efa-208d-4a2a-a02c-2b8c65ce1353 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:16.046811 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64439efa-208d-4a2a-a02c-2b8c65ce1353 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:16.048175 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 715/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 03:12:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:12:16.053431 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3632dd-8661-41af-910c-7b0dd020782c None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:16.053872 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3632dd-8661-41af-910c-7b0dd020782c None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:16.053979 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3632dd-8661-41af-910c-7b0dd020782c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:16.071638 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-8e3632dd-8661-41af-910c-7b0dd020782c None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:12:16.072887 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-8e3632dd-8661-41af-910c-7b0dd020782c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:12:16.080959 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 730/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 03:12:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:12:16.117393 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64439efa-208d-4a2a-a02c-2b8c65ce1353 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:12:16.128229 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64439efa-208d-4a2a-a02c-2b8c65ce1353 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:12:16.131629 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c4b79-7b8c-4241-b7cf-c4476257b514 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:12:16.132291 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c4b79-7b8c-4241-b7cf-c4476257b514 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:16.132571 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c4b79-7b8c-4241-b7cf-c4476257b514 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:16.132846 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c4b79-7b8c-4241-b7cf-c4476257b514 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:16.141412 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89c4b79-7b8c-4241-b7cf-c4476257b514 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:12:16.142824 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89c4b79-7b8c-4241-b7cf-c4476257b514 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:12:16.151854 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 716/1446] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:12:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:12:18.730264 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e8c198-059e-48dd-a95c-d11c84a5b13b None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:18.731249 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e8c198-059e-48dd-a95c-d11c84a5b13b None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:18.731249 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e8c198-059e-48dd-a95c-d11c84a5b13b None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:18.732925 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 731/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 03:12:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:12:18.738189 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af22554-2428-460d-a43f-c085775a5260 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:18.738634 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af22554-2428-460d-a43f-c085775a5260 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:18.738750 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af22554-2428-460d-a43f-c085775a5260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:18.756640 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-6af22554-2428-460d-a43f-c085775a5260 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:12:18.758216 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-6af22554-2428-460d-a43f-c085775a5260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:12:18.767421 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 717/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 03:12:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:12:18.810658 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e8c198-059e-48dd-a95c-d11c84a5b13b None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:12:18.822241 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e8c198-059e-48dd-a95c-d11c84a5b13b None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:12:18.826839 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b39bc-a802-4ace-b707-b3613e4f0b4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:12:18.827478 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b39bc-a802-4ace-b707-b3613e4f0b4d service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:18.827761 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b39bc-a802-4ace-b707-b3613e4f0b4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:18.828071 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b39bc-a802-4ace-b707-b3613e4f0b4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:18.837104 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848b39bc-a802-4ace-b707-b3613e4f0b4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:12:18.838523 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848b39bc-a802-4ace-b707-b3613e4f0b4d service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:12:18.847819 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 732/1449] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:12:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:12:21.218973 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051408aa-ed55-489b-b02b-9ba562c1b1d8 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:21.219526 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051408aa-ed55-489b-b02b-9ba562c1b1d8 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:21.219526 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051408aa-ed55-489b-b02b-9ba562c1b1d8 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:21.220933 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 718/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 03:12:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:12:21.226118 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74585cbd-f87b-4990-8150-a253d05175c2 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:21.226527 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74585cbd-f87b-4990-8150-a253d05175c2 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:21.226665 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74585cbd-f87b-4990-8150-a253d05175c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:21.243663 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-74585cbd-f87b-4990-8150-a253d05175c2 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:12:21.244873 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-74585cbd-f87b-4990-8150-a253d05175c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:12:21.252430 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 733/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 03:12:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:12:21.290954 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051408aa-ed55-489b-b02b-9ba562c1b1d8 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:12:21.301442 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051408aa-ed55-489b-b02b-9ba562c1b1d8 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:12:21.305016 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446a9313-6509-46c1-bfdb-5566cc5fb10b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:12:21.305675 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a9313-6509-46c1-bfdb-5566cc5fb10b service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:21.305961 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a9313-6509-46c1-bfdb-5566cc5fb10b service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:21.306240 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a9313-6509-46c1-bfdb-5566cc5fb10b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:21.314910 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446a9313-6509-46c1-bfdb-5566cc5fb10b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:12:21.316383 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446a9313-6509-46c1-bfdb-5566cc5fb10b service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:12:21.326070 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 719/1452] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:12:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:12:23.616743 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d035afd-ae07-49eb-a7ab-7fe441d7c3ea None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:23.617378 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d035afd-ae07-49eb-a7ab-7fe441d7c3ea None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:23.617378 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d035afd-ae07-49eb-a7ab-7fe441d7c3ea None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:23.619307 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 734/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 03:12:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:12:23.624989 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad50128-2947-472c-8997-911aeca43bda None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:23.625394 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad50128-2947-472c-8997-911aeca43bda None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:23.625552 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad50128-2947-472c-8997-911aeca43bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:23.642734 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-2ad50128-2947-472c-8997-911aeca43bda None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:12:23.643924 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-2ad50128-2947-472c-8997-911aeca43bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:12:23.651665 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 720/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 03:12:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:12:23.689222 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d035afd-ae07-49eb-a7ab-7fe441d7c3ea None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:12:23.700516 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d035afd-ae07-49eb-a7ab-7fe441d7c3ea None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:12:23.704197 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a4126e-bb15-4579-b8ea-32d40447e3d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:12:23.704777 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4126e-bb15-4579-b8ea-32d40447e3d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:23.705057 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4126e-bb15-4579-b8ea-32d40447e3d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:23.705334 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4126e-bb15-4579-b8ea-32d40447e3d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:23.714478 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a4126e-bb15-4579-b8ea-32d40447e3d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:12:23.715945 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a4126e-bb15-4579-b8ea-32d40447e3d3 service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:12:23.725174 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 735/1455] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:12:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:12:25.975145 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31562111-a416-4678-8c46-b046d5be923a None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:25.975678 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31562111-a416-4678-8c46-b046d5be923a None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:25.975678 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31562111-a416-4678-8c46-b046d5be923a None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:25.977813 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 721/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 03:12:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:12:25.983054 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d2f4a-0563-436a-8a72-eb5e7003a442 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:25.983484 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d2f4a-0563-436a-8a72-eb5e7003a442 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:25.983608 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d2f4a-0563-436a-8a72-eb5e7003a442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:26.000672 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-7a9d2f4a-0563-436a-8a72-eb5e7003a442 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:12:26.001842 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-7a9d2f4a-0563-436a-8a72-eb5e7003a442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:12:26.009515 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 736/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 03:12:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:12:26.047679 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31562111-a416-4678-8c46-b046d5be923a None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:12:26.058244 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31562111-a416-4678-8c46-b046d5be923a None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:12:26.061811 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5de4b55-0b07-4e2d-978b-0f1376966c60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:12:26.062446 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de4b55-0b07-4e2d-978b-0f1376966c60 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:26.062730 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de4b55-0b07-4e2d-978b-0f1376966c60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:26.063007 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de4b55-0b07-4e2d-978b-0f1376966c60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:26.071692 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5de4b55-0b07-4e2d-978b-0f1376966c60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:12:26.073167 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5de4b55-0b07-4e2d-978b-0f1376966c60 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:12:26.082381 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 722/1458] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:12:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:12:28.350124 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d4dee-2d44-44c3-bd8b-b40af7854a93 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:28.350689 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d4dee-2d44-44c3-bd8b-b40af7854a93 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:28.350689 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d4dee-2d44-44c3-bd8b-b40af7854a93 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:28.352222 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 737/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 03:12:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:12:28.357448 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3671c439-6d08-4f5c-b454-abfb40b5c28c None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:28.357882 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3671c439-6d08-4f5c-b454-abfb40b5c28c None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:28.358009 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3671c439-6d08-4f5c-b454-abfb40b5c28c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:28.375961 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-3671c439-6d08-4f5c-b454-abfb40b5c28c None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:12:28.377184 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-3671c439-6d08-4f5c-b454-abfb40b5c28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:12:28.385591 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 723/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 03:12:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:12:28.422807 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d4dee-2d44-44c3-bd8b-b40af7854a93 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:12:28.434065 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d4dee-2d44-44c3-bd8b-b40af7854a93 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:12:28.437698 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26989df5-228f-4b05-b640-0ef375d496b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:12:28.438438 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26989df5-228f-4b05-b640-0ef375d496b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:28.438723 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26989df5-228f-4b05-b640-0ef375d496b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:28.439001 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26989df5-228f-4b05-b640-0ef375d496b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:28.448343 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26989df5-228f-4b05-b640-0ef375d496b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:12:28.449774 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26989df5-228f-4b05-b640-0ef375d496b9 service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:12:28.459421 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 738/1461] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:12:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:12:30.706644 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08885f8b-0e3b-4c12-b6e8-70a05baf8f65 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:30.707148 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08885f8b-0e3b-4c12-b6e8-70a05baf8f65 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:30.707148 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08885f8b-0e3b-4c12-b6e8-70a05baf8f65 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:30.708555 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 724/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 03:12:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:12:30.714414 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af4b12-b8e8-48d0-ab6b-76389cb4c00c None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:30.714825 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af4b12-b8e8-48d0-ab6b-76389cb4c00c None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:30.714965 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af4b12-b8e8-48d0-ab6b-76389cb4c00c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:30.733163 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-42af4b12-b8e8-48d0-ab6b-76389cb4c00c None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:12:30.734331 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-42af4b12-b8e8-48d0-ab6b-76389cb4c00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:12:30.741841 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 739/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 03:12:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:12:30.778463 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08885f8b-0e3b-4c12-b6e8-70a05baf8f65 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:12:30.788871 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08885f8b-0e3b-4c12-b6e8-70a05baf8f65 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:12:30.792889 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f292a26-4fa4-439e-b82c-981df73ac283 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:12:30.793515 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f292a26-4fa4-439e-b82c-981df73ac283 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:30.793801 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f292a26-4fa4-439e-b82c-981df73ac283 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:30.794077 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f292a26-4fa4-439e-b82c-981df73ac283 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:30.802736 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f292a26-4fa4-439e-b82c-981df73ac283 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:12:30.804199 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f292a26-4fa4-439e-b82c-981df73ac283 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:12:30.813262 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 725/1464] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:12:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:12:33.129423 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ab15b-efef-4671-87fe-fcbea3bc8cfc None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:33.129958 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ab15b-efef-4671-87fe-fcbea3bc8cfc None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:33.129958 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ab15b-efef-4671-87fe-fcbea3bc8cfc None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:33.131310 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 740/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 03:12:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:12:33.137099 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4df5b1-5fe4-443c-9134-c18bb1316b9c None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:33.137530 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4df5b1-5fe4-443c-9134-c18bb1316b9c None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:33.137657 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4df5b1-5fe4-443c-9134-c18bb1316b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:33.159548 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-3c4df5b1-5fe4-443c-9134-c18bb1316b9c None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:12:33.161379 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-3c4df5b1-5fe4-443c-9134-c18bb1316b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:12:33.170135 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 726/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 03:12:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:12:33.209021 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976ab15b-efef-4671-87fe-fcbea3bc8cfc None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:12:33.221474 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976ab15b-efef-4671-87fe-fcbea3bc8cfc None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:12:33.224906 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82145e0-dc61-47b8-8324-a3e632a14d50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:12:33.225537 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82145e0-dc61-47b8-8324-a3e632a14d50 service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:33.225812 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82145e0-dc61-47b8-8324-a3e632a14d50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:33.226078 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82145e0-dc61-47b8-8324-a3e632a14d50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:33.234761 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82145e0-dc61-47b8-8324-a3e632a14d50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:12:33.236230 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82145e0-dc61-47b8-8324-a3e632a14d50 service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:12:33.245276 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 741/1467] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:12:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:12:35.468220 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d666f-fc3f-4412-abee-5a14f71f3c80 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:35.468664 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d666f-fc3f-4412-abee-5a14f71f3c80 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:35.468774 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d666f-fc3f-4412-abee-5a14f71f3c80 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:35.470187 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 727/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 03:12:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:12:35.475321 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298daf3-1a4e-4632-b488-32ab4617f741 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:35.475740 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298daf3-1a4e-4632-b488-32ab4617f741 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:35.475896 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298daf3-1a4e-4632-b488-32ab4617f741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:35.493837 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-9298daf3-1a4e-4632-b488-32ab4617f741 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:12:35.495057 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-9298daf3-1a4e-4632-b488-32ab4617f741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:12:35.502841 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 742/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 03:12:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:12:35.538836 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d666f-fc3f-4412-abee-5a14f71f3c80 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:12:35.549672 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d666f-fc3f-4412-abee-5a14f71f3c80 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:12:35.553346 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d31c6a-6fce-4b7f-b66e-dfc340ecbebe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:12:35.553991 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d31c6a-6fce-4b7f-b66e-dfc340ecbebe service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:12:35.554305 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d31c6a-6fce-4b7f-b66e-dfc340ecbebe service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:12:35.554584 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d31c6a-6fce-4b7f-b66e-dfc340ecbebe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:12:35.563710 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d31c6a-6fce-4b7f-b66e-dfc340ecbebe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:12:35.565179 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d31c6a-6fce-4b7f-b66e-dfc340ecbebe service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:12:35.575202 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 728/1470] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:12:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:13:08.990407 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6273a0-8602-4360-b5f6-c65aef8c1d11 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:13:08.991022 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6273a0-8602-4360-b5f6-c65aef8c1d11 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:13:08.991022 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6273a0-8602-4360-b5f6-c65aef8c1d11 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:13:08.992974 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 743/1471] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:13:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:13:08.998515 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecce5b0-19e5-48dc-a68a-7af7a0ad9a56 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:13:08.998940 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecce5b0-19e5-48dc-a68a-7af7a0ad9a56 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:13:08.999069 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecce5b0-19e5-48dc-a68a-7af7a0ad9a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:13:09.017081 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-1ecce5b0-19e5-48dc-a68a-7af7a0ad9a56 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:13:09.018290 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-1ecce5b0-19e5-48dc-a68a-7af7a0ad9a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:13:09.026185 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 729/1472] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:13:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:13:09.073006 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe0e3b-eec0-4c5d-8c45-f851a9524688 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:13:09.073297 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe0e3b-eec0-4c5d-8c45-f851a9524688 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:13:09.073577 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe0e3b-eec0-4c5d-8c45-f851a9524688 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:13:09.074938 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 744/1473] 10.222.0.65 () {54 vars in 962 bytes} [Tue May 10 03:13:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:13:09.079744 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4694f6ef-2dbb-4cdf-921e-0ff8e36fadc3 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:13:09.080058 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4694f6ef-2dbb-4cdf-921e-0ff8e36fadc3 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:13:09.080339 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4694f6ef-2dbb-4cdf-921e-0ff8e36fadc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:13:09.097976 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-4694f6ef-2dbb-4cdf-921e-0ff8e36fadc3 None None] MFA Rules not processed for user `c79f0a3a3223444c82589da07305469f`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:13:09.099155 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-4694f6ef-2dbb-4cdf-921e-0ff8e36fadc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:13:09.106040 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 730/1474] 10.222.0.65 () {58 vars in 1059 bytes} [Tue May 10 03:13:09 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:13:09.112880 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe0e3b-eec0-4c5d-8c45-f851a9524688 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:13:09.123847 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe0e3b-eec0-4c5d-8c45-f851a9524688 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:13:09.127318 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b58639-6a5b-4f80-963e-433fcd7726d2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c79f0a3a3223444c82589da07305469f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:13:09.127944 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b58639-6a5b-4f80-963e-433fcd7726d2 service glance] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:13:09.128252 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b58639-6a5b-4f80-963e-433fcd7726d2 service glance] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:13:09.128526 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b58639-6a5b-4f80-963e-433fcd7726d2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:13:09.137217 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b58639-6a5b-4f80-963e-433fcd7726d2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:13:09.138701 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b58639-6a5b-4f80-963e-433fcd7726d2 service glance] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:13:09.147965 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 745/1475] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:13:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:13:11.426478 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0fbb40-0cac-4495-83c3-da05d6c112ac None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:13:11.427039 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0fbb40-0cac-4495-83c3-da05d6c112ac None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:13:11.427039 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0fbb40-0cac-4495-83c3-da05d6c112ac None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:13:11.428465 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 731/1476] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:13:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:13:11.434324 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4bf6a-e67d-4f2a-9fd5-b1509d3b01c7 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:13:11.434736 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4bf6a-e67d-4f2a-9fd5-b1509d3b01c7 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:13:11.434878 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4bf6a-e67d-4f2a-9fd5-b1509d3b01c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:13:11.452440 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-26b4bf6a-e67d-4f2a-9fd5-b1509d3b01c7 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:13:11.453646 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-26b4bf6a-e67d-4f2a-9fd5-b1509d3b01c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:13:11.461846 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 746/1477] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:13:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:13:11.485023 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0fbb40-0cac-4495-83c3-da05d6c112ac None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:13:11.497963 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0fbb40-0cac-4495-83c3-da05d6c112ac None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:13:11.502452 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74889598-1c70-483d-a589-0b230f722c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:13:11.508197 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74889598-1c70-483d-a589-0b230f722c0e admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:13:11.508197 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74889598-1c70-483d-a589-0b230f722c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:13:11.508197 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74889598-1c70-483d-a589-0b230f722c0e admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:13:11.508197 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74889598-1c70-483d-a589-0b230f722c0e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:13:11.508197 dv-cinder-830094-4-smb devstack@keystone.service[80198]: WARNING py.warnings [None req-74889598-1c70-483d-a589-0b230f722c0e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 03:13:11.508197 dv-cinder-830094-4-smb devstack@keystone.service[80198]: warnings.warn(msg) May 10 03:13:11.508197 dv-cinder-830094-4-smb devstack@keystone.service[80198]: May 10 03:13:11.508818 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74889598-1c70-483d-a589-0b230f722c0e admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:13:11.526860 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 732/1478] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 10 03:13:11 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:13:13.758061 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416118e3-a641-47e4-a272-45563892f086 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:13:13.758594 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416118e3-a641-47e4-a272-45563892f086 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:13:13.758594 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416118e3-a641-47e4-a272-45563892f086 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:13:13.759883 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 747/1479] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:13:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:13:13.765227 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e0063-6edf-47bd-8fc9-a44fd8ab31a5 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:13:13.765692 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e0063-6edf-47bd-8fc9-a44fd8ab31a5 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:13:13.765811 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e0063-6edf-47bd-8fc9-a44fd8ab31a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:13:13.783538 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-6f8e0063-6edf-47bd-8fc9-a44fd8ab31a5 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:13:13.784797 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-6f8e0063-6edf-47bd-8fc9-a44fd8ab31a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:13:13.792984 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 733/1480] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:13:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:13:13.834420 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416118e3-a641-47e4-a272-45563892f086 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:13:13.849130 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416118e3-a641-47e4-a272-45563892f086 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:13:13.854517 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee59718-6423-487c-98b8-d892f3d0c1fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b7ccdccba0b4f9e86817946f22dbe28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:13:13.855149 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee59718-6423-487c-98b8-d892f3d0c1fe service nova] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:13:13.855432 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee59718-6423-487c-98b8-d892f3d0c1fe service nova] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:13:13.855706 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee59718-6423-487c-98b8-d892f3d0c1fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:13:13.863582 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee59718-6423-487c-98b8-d892f3d0c1fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:13:13.865178 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee59718-6423-487c-98b8-d892f3d0c1fe service nova] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:13:13.874345 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 748/1481] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:13:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:13:16.258323 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca09e24-879d-4fed-8605-30740feebc79 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:13:16.258892 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca09e24-879d-4fed-8605-30740feebc79 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:13:16.258892 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca09e24-879d-4fed-8605-30740feebc79 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:13:16.260344 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 734/1482] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:13:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:13:16.265710 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70baeea4-ce1c-47d0-94a7-71e9d67c7559 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:13:16.266155 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70baeea4-ce1c-47d0-94a7-71e9d67c7559 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:13:16.266263 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70baeea4-ce1c-47d0-94a7-71e9d67c7559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:13:16.283656 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-70baeea4-ce1c-47d0-94a7-71e9d67c7559 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:13:16.284866 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-70baeea4-ce1c-47d0-94a7-71e9d67c7559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:13:16.293333 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 749/1483] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:13:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:13:16.328152 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca09e24-879d-4fed-8605-30740feebc79 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:13:16.339189 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca09e24-879d-4fed-8605-30740feebc79 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:13:16.342709 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519fc460-b538-4f20-b54a-0b43ccaae165 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:13:16.343341 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519fc460-b538-4f20-b54a-0b43ccaae165 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:13:16.343624 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519fc460-b538-4f20-b54a-0b43ccaae165 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:13:16.343898 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519fc460-b538-4f20-b54a-0b43ccaae165 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:13:16.353248 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519fc460-b538-4f20-b54a-0b43ccaae165 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:13:16.354677 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519fc460-b538-4f20-b54a-0b43ccaae165 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:13:16.363893 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 735/1484] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:13:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:13:18.625586 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825e97b-d0ff-4fa2-ac88-ad827561ee8c None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:13:18.626161 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825e97b-d0ff-4fa2-ac88-ad827561ee8c None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:13:18.626161 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825e97b-d0ff-4fa2-ac88-ad827561ee8c None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:13:18.627496 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 750/1485] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:13:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:13:18.632785 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0511e7-d9db-428a-b1de-97a6dd788940 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:13:18.633176 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0511e7-d9db-428a-b1de-97a6dd788940 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:13:18.633405 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0511e7-d9db-428a-b1de-97a6dd788940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:13:18.651452 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-aa0511e7-d9db-428a-b1de-97a6dd788940 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:13:18.652678 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-aa0511e7-d9db-428a-b1de-97a6dd788940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:13:18.660419 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 736/1486] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:13:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:13:18.697935 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0825e97b-d0ff-4fa2-ac88-ad827561ee8c None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:13:18.710417 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0825e97b-d0ff-4fa2-ac88-ad827561ee8c None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:13:18.712189 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c9d7ed-2e04-46dd-9da2-fd8a5e2647ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:13:18.712820 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9d7ed-2e04-46dd-9da2-fd8a5e2647ef service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:13:18.713098 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9d7ed-2e04-46dd-9da2-fd8a5e2647ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:13:18.713369 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9d7ed-2e04-46dd-9da2-fd8a5e2647ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:13:18.722035 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c9d7ed-2e04-46dd-9da2-fd8a5e2647ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:13:18.723591 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c9d7ed-2e04-46dd-9da2-fd8a5e2647ef service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:13:18.733687 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 751/1487] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:13:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:13:21.097863 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a36bbc5-d68b-4e92-a874-5a0ee0db1748 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:13:21.098462 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a36bbc5-d68b-4e92-a874-5a0ee0db1748 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:13:21.098462 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a36bbc5-d68b-4e92-a874-5a0ee0db1748 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:13:21.099772 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 737/1488] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:13:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:13:21.105477 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c5fd7-d44d-4a06-b131-505e46326b75 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:13:21.105920 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c5fd7-d44d-4a06-b131-505e46326b75 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:13:21.106032 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c5fd7-d44d-4a06-b131-505e46326b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:13:21.123716 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-4d8c5fd7-d44d-4a06-b131-505e46326b75 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:13:21.124935 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-4d8c5fd7-d44d-4a06-b131-505e46326b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:13:21.132627 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 752/1489] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:13:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:13:21.172180 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a36bbc5-d68b-4e92-a874-5a0ee0db1748 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:13:21.183351 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a36bbc5-d68b-4e92-a874-5a0ee0db1748 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:13:21.186816 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58660348-be98-4e38-9871-5d7fd1cfc457 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:13:21.187447 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58660348-be98-4e38-9871-5d7fd1cfc457 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:13:21.187730 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58660348-be98-4e38-9871-5d7fd1cfc457 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:13:21.188022 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58660348-be98-4e38-9871-5d7fd1cfc457 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:13:21.196786 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58660348-be98-4e38-9871-5d7fd1cfc457 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:13:21.198212 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58660348-be98-4e38-9871-5d7fd1cfc457 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:13:21.207367 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 738/1490] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:13:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:13:23.918021 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f2cef-a071-4901-8f2c-b6e33dd1ff97 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:13:23.918581 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f2cef-a071-4901-8f2c-b6e33dd1ff97 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:13:23.918581 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f2cef-a071-4901-8f2c-b6e33dd1ff97 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:13:23.919965 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 753/1491] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 10 03:13:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:13:23.925278 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39342c8-7279-4771-8678-2df3277c051f None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:13:23.925707 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39342c8-7279-4771-8678-2df3277c051f None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:13:23.925837 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39342c8-7279-4771-8678-2df3277c051f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:13:23.943517 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-a39342c8-7279-4771-8678-2df3277c051f None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:13:23.945321 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-a39342c8-7279-4771-8678-2df3277c051f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:13:23.953060 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 739/1492] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 10 03:13:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:13:23.990782 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f2cef-a071-4901-8f2c-b6e33dd1ff97 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:13:24.001627 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f2cef-a071-4901-8f2c-b6e33dd1ff97 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:13:24.005461 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b1d9a6-a9f5-4798-b4ba-85dd01a19ecb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:13:24.006096 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b1d9a6-a9f5-4798-b4ba-85dd01a19ecb service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:13:24.006377 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b1d9a6-a9f5-4798-b4ba-85dd01a19ecb service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:13:24.007279 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b1d9a6-a9f5-4798-b4ba-85dd01a19ecb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:13:24.016103 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b1d9a6-a9f5-4798-b4ba-85dd01a19ecb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:13:24.017520 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b1d9a6-a9f5-4798-b4ba-85dd01a19ecb service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:13:24.026651 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 754/1493] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:13:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:15:06.680938 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a6b05-f045-4da5-adf0-b84891f3b941 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:06.682112 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a6b05-f045-4da5-adf0-b84891f3b941 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:06.682112 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a6b05-f045-4da5-adf0-b84891f3b941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:06.699523 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-359a6b05-f045-4da5-adf0-b84891f3b941 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:15:06.700754 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-359a6b05-f045-4da5-adf0-b84891f3b941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:06.708608 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 740/1494] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:15:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:15:06.717694 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221eb20-cdde-40eb-ac73-17a7cee02009 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:06.718161 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221eb20-cdde-40eb-ac73-17a7cee02009 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:06.718290 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221eb20-cdde-40eb-ac73-17a7cee02009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:06.735852 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-a221eb20-cdde-40eb-ac73-17a7cee02009 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:15:06.737067 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-a221eb20-cdde-40eb-ac73-17a7cee02009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:06.745307 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 755/1495] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:15:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:15:06.749735 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a6b05-f045-4da5-adf0-b84891f3b941 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:06.759100 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a6b05-f045-4da5-adf0-b84891f3b941 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:06.763556 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f0f727-0584-4704-9993-b1c842ff1600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:06.764236 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0f727-0584-4704-9993-b1c842ff1600 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:06.764525 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0f727-0584-4704-9993-b1c842ff1600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:06.764806 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0f727-0584-4704-9993-b1c842ff1600 admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:06.765526 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f0f727-0584-4704-9993-b1c842ff1600 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:15:06.765835 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f0f727-0584-4704-9993-b1c842ff1600 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:06.766847 dv-cinder-830094-4-smb devstack@keystone.service[80198]: WARNING py.warnings [None req-b5f0f727-0584-4704-9993-b1c842ff1600 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 03:15:06.766847 dv-cinder-830094-4-smb devstack@keystone.service[80198]: warnings.warn(msg) May 10 03:15:06.766847 dv-cinder-830094-4-smb devstack@keystone.service[80198]: May 10 03:15:06.767733 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f0f727-0584-4704-9993-b1c842ff1600 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:06.778891 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 741/1496] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 10 03:15:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:15:06.786729 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221eb20-cdde-40eb-ac73-17a7cee02009 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:06.796380 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221eb20-cdde-40eb-ac73-17a7cee02009 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:06.800809 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4685df8d-d243-4a47-a99c-55868aaf6c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:06.801447 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685df8d-d243-4a47-a99c-55868aaf6c52 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:06.801726 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685df8d-d243-4a47-a99c-55868aaf6c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:06.801997 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685df8d-d243-4a47-a99c-55868aaf6c52 admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:06.802672 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4685df8d-d243-4a47-a99c-55868aaf6c52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:06.804408 dv-cinder-830094-4-smb devstack@keystone.service[80197]: WARNING py.warnings [None req-4685df8d-d243-4a47-a99c-55868aaf6c52 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 03:15:06.804408 dv-cinder-830094-4-smb devstack@keystone.service[80197]: warnings.warn(msg) May 10 03:15:06.804408 dv-cinder-830094-4-smb devstack@keystone.service[80197]: May 10 03:15:06.805580 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4685df8d-d243-4a47-a99c-55868aaf6c52 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:06.919996 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 756/1497] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:15:06 2022] POST /identity/v3/projects => generated 379 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:15:06.924256 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f0f727-0584-4704-9993-b1c842ff1600 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:06.934786 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f0f727-0584-4704-9993-b1c842ff1600 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:06.987728 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f5c507-8480-403a-b5da-a0ebb0a13132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:06.988388 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5c507-8480-403a-b5da-a0ebb0a13132 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:06.988670 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5c507-8480-403a-b5da-a0ebb0a13132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:06.988942 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5c507-8480-403a-b5da-a0ebb0a13132 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:06.989632 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f5c507-8480-403a-b5da-a0ebb0a13132 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:06.990637 dv-cinder-830094-4-smb devstack@keystone.service[80198]: WARNING py.warnings [None req-22f5c507-8480-403a-b5da-a0ebb0a13132 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 03:15:06.990637 dv-cinder-830094-4-smb devstack@keystone.service[80198]: warnings.warn(msg) May 10 03:15:06.990637 dv-cinder-830094-4-smb devstack@keystone.service[80198]: May 10 03:15:06.991823 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f5c507-8480-403a-b5da-a0ebb0a13132 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:07.096631 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 742/1498] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:15:06 2022] POST /identity/v3/users => generated 290 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:15:07.100822 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4685df8d-d243-4a47-a99c-55868aaf6c52 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:07.111547 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4685df8d-d243-4a47-a99c-55868aaf6c52 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:07.116109 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a918f65a-3bce-448f-89d9-10799536f89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:07.116765 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a918f65a-3bce-448f-89d9-10799536f89a admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:07.117048 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a918f65a-3bce-448f-89d9-10799536f89a admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:07.117323 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a918f65a-3bce-448f-89d9-10799536f89a admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:07.118047 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a918f65a-3bce-448f-89d9-10799536f89a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:07.119085 dv-cinder-830094-4-smb devstack@keystone.service[80197]: WARNING py.warnings [None req-a918f65a-3bce-448f-89d9-10799536f89a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 03:15:07.119085 dv-cinder-830094-4-smb devstack@keystone.service[80197]: warnings.warn(msg) May 10 03:15:07.119085 dv-cinder-830094-4-smb devstack@keystone.service[80197]: May 10 03:15:07.119958 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a918f65a-3bce-448f-89d9-10799536f89a admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:07.132331 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 757/1499] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:15:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:15:07.136071 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f5c507-8480-403a-b5da-a0ebb0a13132 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:07.145688 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f5c507-8480-403a-b5da-a0ebb0a13132 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:07.150726 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ca5ffb-741d-4cfe-8d2a-40dc756f9d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:07.151367 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca5ffb-741d-4cfe-8d2a-40dc756f9d3f admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:07.151650 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca5ffb-741d-4cfe-8d2a-40dc756f9d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:07.151923 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca5ffb-741d-4cfe-8d2a-40dc756f9d3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:07.152696 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ca5ffb-741d-4cfe-8d2a-40dc756f9d3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:07.153700 dv-cinder-830094-4-smb devstack@keystone.service[80198]: WARNING py.warnings [None req-e3ca5ffb-741d-4cfe-8d2a-40dc756f9d3f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 03:15:07.153700 dv-cinder-830094-4-smb devstack@keystone.service[80198]: warnings.warn(msg) May 10 03:15:07.153700 dv-cinder-830094-4-smb devstack@keystone.service[80198]: May 10 03:15:07.154561 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ca5ffb-741d-4cfe-8d2a-40dc756f9d3f admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:07.168420 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 743/1500] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:15:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:15:07.172488 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a918f65a-3bce-448f-89d9-10799536f89a admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:07.181983 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a918f65a-3bce-448f-89d9-10799536f89a admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:07.186483 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d905401-5c1b-4570-86c3-6a926ba5d4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:07.187353 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d905401-5c1b-4570-86c3-6a926ba5d4ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:07.187638 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d905401-5c1b-4570-86c3-6a926ba5d4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:07.187913 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d905401-5c1b-4570-86c3-6a926ba5d4ae admin admin] PATH_INFO: `/v3/projects/a5a7fd71042e4713b3b8d06f5c373b20/users/af2eeaf2dcb94db3a1fbeaa172b5aa6b/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:07.202070 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d905401-5c1b-4570-86c3-6a926ba5d4ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5a7fd71042e4713b3b8d06f5c373b20, user_id=af2eeaf2dcb94db3a1fbeaa172b5aa6b, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:07.203115 dv-cinder-830094-4-smb devstack@keystone.service[80197]: WARNING py.warnings [None req-5d905401-5c1b-4570-86c3-6a926ba5d4ae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 03:15:07.203115 dv-cinder-830094-4-smb devstack@keystone.service[80197]: warnings.warn(msg) May 10 03:15:07.203115 dv-cinder-830094-4-smb devstack@keystone.service[80197]: May 10 03:15:07.205086 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d905401-5c1b-4570-86c3-6a926ba5d4ae admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:07.303391 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 758/1501] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:15:07 2022] PUT /identity/v3/projects/a5a7fd71042e4713b3b8d06f5c373b20/users/af2eeaf2dcb94db3a1fbeaa172b5aa6b/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:15:07.314537 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555434aa-0b23-4a35-85a5-1a2d00c25fc2 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:07.314830 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555434aa-0b23-4a35-85a5-1a2d00c25fc2 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:07.315111 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555434aa-0b23-4a35-85a5-1a2d00c25fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:07.341811 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-555434aa-0b23-4a35-85a5-1a2d00c25fc2 None None] MFA Rules not processed for user `af2eeaf2dcb94db3a1fbeaa172b5aa6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:15:07.343098 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-555434aa-0b23-4a35-85a5-1a2d00c25fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:07.406472 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 744/1502] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:15:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:15:07.422336 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f3d48-24ef-4863-bf0a-5273138587cf None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:07.422627 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f3d48-24ef-4863-bf0a-5273138587cf None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:07.422914 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f3d48-24ef-4863-bf0a-5273138587cf None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:07.424336 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 759/1503] 10.222.0.65 () {54 vars in 963 bytes} [Tue May 10 03:15:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:15:07.429252 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf04c962-2523-4bb1-8961-b056862defc5 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:07.429546 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf04c962-2523-4bb1-8961-b056862defc5 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:07.429828 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf04c962-2523-4bb1-8961-b056862defc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:07.448086 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-cf04c962-2523-4bb1-8961-b056862defc5 None None] MFA Rules not processed for user `3509cdb58f6a4d05a7ed79e46791ac19`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:15:07.449314 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-cf04c962-2523-4bb1-8961-b056862defc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:07.504306 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 745/1504] 10.222.0.65 () {58 vars in 1060 bytes} [Tue May 10 03:15:07 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:15:07.517392 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f3d48-24ef-4863-bf0a-5273138587cf None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:07.531517 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f3d48-24ef-4863-bf0a-5273138587cf None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:07.538275 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5520d1-9134-40ef-98d0-8d46631eb9c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:07.538989 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5520d1-9134-40ef-98d0-8d46631eb9c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:07.539318 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5520d1-9134-40ef-98d0-8d46631eb9c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:07.539588 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5520d1-9134-40ef-98d0-8d46631eb9c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:07.548930 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5520d1-9134-40ef-98d0-8d46631eb9c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:07.550349 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5520d1-9134-40ef-98d0-8d46631eb9c5 service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:07.560409 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 760/1505] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:15:07 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:15:07.603608 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c500a9-da3a-48ea-96d6-25c9fc35208b None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:07.603903 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c500a9-da3a-48ea-96d6-25c9fc35208b None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:07.604234 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c500a9-da3a-48ea-96d6-25c9fc35208b None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:07.605533 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 746/1506] 10.222.0.65 () {52 vars in 829 bytes} [Tue May 10 03:15:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:15:07.609174 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5520d1-9134-40ef-98d0-8d46631eb9c5 service cinder] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:07.672305 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5520d1-9134-40ef-98d0-8d46631eb9c5 service cinder] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:07.676781 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fdfabe-40d1-4c8e-80cd-c3fa9700b0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:07.677645 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fdfabe-40d1-4c8e-80cd-c3fa9700b0c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:07.677924 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fdfabe-40d1-4c8e-80cd-c3fa9700b0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:07.678197 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fdfabe-40d1-4c8e-80cd-c3fa9700b0c7 admin admin] PATH_INFO: `/v3/users/af2eeaf2dcb94db3a1fbeaa172b5aa6b` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:07.679393 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fdfabe-40d1-4c8e-80cd-c3fa9700b0c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af2eeaf2dcb94db3a1fbeaa172b5aa6b)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:07.680418 dv-cinder-830094-4-smb devstack@keystone.service[80197]: WARNING py.warnings [None req-80fdfabe-40d1-4c8e-80cd-c3fa9700b0c7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 03:15:07.680418 dv-cinder-830094-4-smb devstack@keystone.service[80197]: warnings.warn(msg) May 10 03:15:07.680418 dv-cinder-830094-4-smb devstack@keystone.service[80197]: May 10 03:15:07.681720 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fdfabe-40d1-4c8e-80cd-c3fa9700b0c7 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:07.988784 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-80fdfabe-40d1-4c8e-80cd-c3fa9700b0c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af2eeaf2dcb94db3a1fbeaa172b5aa6b'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:08.006184 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-80fdfabe-40d1-4c8e-80cd-c3fa9700b0c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af2eeaf2dcb94db3a1fbeaa172b5aa6b'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:08.027682 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-80fdfabe-40d1-4c8e-80cd-c3fa9700b0c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af2eeaf2dcb94db3a1fbeaa172b5aa6b'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:08.029776 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-80fdfabe-40d1-4c8e-80cd-c3fa9700b0c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af2eeaf2dcb94db3a1fbeaa172b5aa6b'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:08.029776 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-80fdfabe-40d1-4c8e-80cd-c3fa9700b0c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af2eeaf2dcb94db3a1fbeaa172b5aa6b'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:08.102431 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 761/1507] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:15:07 2022] DELETE /identity/v3/users/af2eeaf2dcb94db3a1fbeaa172b5aa6b => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:15:08.106836 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a38b9d-672a-4829-9ab5-a211fd99d4f2 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:08.107285 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a38b9d-672a-4829-9ab5-a211fd99d4f2 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:08.107378 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a38b9d-672a-4829-9ab5-a211fd99d4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:08.125176 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-63a38b9d-672a-4829-9ab5-a211fd99d4f2 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:15:08.126373 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-63a38b9d-672a-4829-9ab5-a211fd99d4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:08.183138 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 747/1508] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:15:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:15:08.192521 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fdfabe-40d1-4c8e-80cd-c3fa9700b0c7 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:08.193919 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-80fdfabe-40d1-4c8e-80cd-c3fa9700b0c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:08.376242 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fdfabe-40d1-4c8e-80cd-c3fa9700b0c7 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:08.379810 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a385822d-5a0e-4929-afbf-fc1831938ee3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:08.380483 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385822d-5a0e-4929-afbf-fc1831938ee3 service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:08.380767 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385822d-5a0e-4929-afbf-fc1831938ee3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:08.381047 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385822d-5a0e-4929-afbf-fc1831938ee3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:08.389749 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a385822d-5a0e-4929-afbf-fc1831938ee3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:08.391161 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a385822d-5a0e-4929-afbf-fc1831938ee3 service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:08.400443 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 762/1509] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:15:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:15:08.881581 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a38b9d-672a-4829-9ab5-a211fd99d4f2 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:15:08.883027 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-63a38b9d-672a-4829-9ab5-a211fd99d4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:15:08.894818 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a38b9d-672a-4829-9ab5-a211fd99d4f2 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:15:08.900469 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f36f2c8-f9a0-402d-8526-adac1886029d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:15:08.901418 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36f2c8-f9a0-402d-8526-adac1886029d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:15:08.901811 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36f2c8-f9a0-402d-8526-adac1886029d admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:15:08.902099 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36f2c8-f9a0-402d-8526-adac1886029d admin admin] PATH_INFO: `/v3/projects/a5a7fd71042e4713b3b8d06f5c373b20` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:15:08.903316 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f36f2c8-f9a0-402d-8526-adac1886029d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5a7fd71042e4713b3b8d06f5c373b20)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:15:08.904369 dv-cinder-830094-4-smb devstack@keystone.service[80198]: WARNING py.warnings [None req-8f36f2c8-f9a0-402d-8526-adac1886029d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 03:15:08.904369 dv-cinder-830094-4-smb devstack@keystone.service[80198]: warnings.warn(msg) May 10 03:15:08.904369 dv-cinder-830094-4-smb devstack@keystone.service[80198]: May 10 03:15:08.905884 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f36f2c8-f9a0-402d-8526-adac1886029d admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:15:09.002707 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8f36f2c8-f9a0-402d-8526-adac1886029d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5a7fd71042e4713b3b8d06f5c373b20', 'request_id': 'req-8f36f2c8-f9a0-402d-8526-adac1886029d'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:09.008395 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8f36f2c8-f9a0-402d-8526-adac1886029d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5a7fd71042e4713b3b8d06f5c373b20', 'request_id': 'req-8f36f2c8-f9a0-402d-8526-adac1886029d'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:09.022325 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8f36f2c8-f9a0-402d-8526-adac1886029d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5a7fd71042e4713b3b8d06f5c373b20', 'request_id': 'req-8f36f2c8-f9a0-402d-8526-adac1886029d'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:09.101361 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8f36f2c8-f9a0-402d-8526-adac1886029d admin admin] The token cache is being invalidate because project a5a7fd71042e4713b3b8d06f5c373b20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:15:09.101648 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8f36f2c8-f9a0-402d-8526-adac1886029d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:09.102276 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8f36f2c8-f9a0-402d-8526-adac1886029d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:15:09.103933 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 748/1510] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:15:08 2022] DELETE /identity/v3/projects/a5a7fd71042e4713b3b8d06f5c373b20 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:16:52.335161 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b698e-2d60-465d-8bd4-1c6734271bb0 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:52.335768 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b698e-2d60-465d-8bd4-1c6734271bb0 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:52.335768 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b698e-2d60-465d-8bd4-1c6734271bb0 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:52.337713 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 763/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 03:16:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:16:52.342497 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed47d856-ca72-446d-9829-74bad1e72747 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:52.342890 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed47d856-ca72-446d-9829-74bad1e72747 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:52.343094 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed47d856-ca72-446d-9829-74bad1e72747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:52.360810 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-ed47d856-ca72-446d-9829-74bad1e72747 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:16:52.362018 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-ed47d856-ca72-446d-9829-74bad1e72747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:16:52.418238 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 749/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 03:16:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:16:52.586508 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2b698e-2d60-465d-8bd4-1c6734271bb0 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:16:52.588129 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-1d2b698e-2d60-465d-8bd4-1c6734271bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:16:52.658209 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2b698e-2d60-465d-8bd4-1c6734271bb0 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:16:52.663442 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f26fd0-8f1b-40ff-8d64-12ba76434dce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b7ccdccba0b4f9e86817946f22dbe28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:16:52.664106 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f26fd0-8f1b-40ff-8d64-12ba76434dce service nova] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:52.664388 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f26fd0-8f1b-40ff-8d64-12ba76434dce service nova] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:52.664657 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f26fd0-8f1b-40ff-8d64-12ba76434dce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:52.672695 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f26fd0-8f1b-40ff-8d64-12ba76434dce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:16:52.674262 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f26fd0-8f1b-40ff-8d64-12ba76434dce service nova] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:16:52.684121 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 764/1513] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:16:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:16:53.326821 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ef39c-05a7-4f15-bad0-7e797c423a40 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:53.327115 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ef39c-05a7-4f15-bad0-7e797c423a40 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:53.327386 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ef39c-05a7-4f15-bad0-7e797c423a40 None None] PATH_INFO: `/v3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:53.328864 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 750/1514] 10.222.0.61 () {54 vars in 925 bytes} [Tue May 10 03:16:53 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:16:53.335445 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8478bfa-417e-4692-b475-5a0e0555fdaf None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:53.335937 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8478bfa-417e-4692-b475-5a0e0555fdaf None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:53.336070 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8478bfa-417e-4692-b475-5a0e0555fdaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:53.359551 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-e8478bfa-417e-4692-b475-5a0e0555fdaf None None] MFA Rules not processed for user `f646147bdad8476ba0ab9da5d9c50b55`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:16:53.361180 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-e8478bfa-417e-4692-b475-5a0e0555fdaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:16:53.435405 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 765/1515] 10.222.0.61 () {58 vars in 1015 bytes} [Tue May 10 03:16:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:16:53.577236 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e48f3-6904-4592-a782-9caba010dc3f None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:53.577796 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e48f3-6904-4592-a782-9caba010dc3f None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:53.577796 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e48f3-6904-4592-a782-9caba010dc3f None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:53.579136 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 751/1516] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 03:16:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:16:53.583809 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b50218-c46e-4ab2-b99c-c10ef3a6e574 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:53.587690 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b50218-c46e-4ab2-b99c-c10ef3a6e574 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:53.587690 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b50218-c46e-4ab2-b99c-c10ef3a6e574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:53.602908 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-31b50218-c46e-4ab2-b99c-c10ef3a6e574 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:16:53.604127 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-31b50218-c46e-4ab2-b99c-c10ef3a6e574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:16:53.611850 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 766/1517] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 03:16:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:16:53.764782 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e48f3-6904-4592-a782-9caba010dc3f None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:16:53.779442 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e48f3-6904-4592-a782-9caba010dc3f None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:16:53.785153 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ef7534-97c5-4078-93be-e4d4cb28dd59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b7ccdccba0b4f9e86817946f22dbe28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:16:53.785795 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef7534-97c5-4078-93be-e4d4cb28dd59 service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:53.786084 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef7534-97c5-4078-93be-e4d4cb28dd59 service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:53.786361 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef7534-97c5-4078-93be-e4d4cb28dd59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:53.794848 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ef7534-97c5-4078-93be-e4d4cb28dd59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:16:53.796497 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ef7534-97c5-4078-93be-e4d4cb28dd59 service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:16:53.805635 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 752/1518] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:16:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:16:57.455012 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb0f8d5-8315-4b4b-b0df-9f05956325f5 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:57.455617 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb0f8d5-8315-4b4b-b0df-9f05956325f5 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:57.455617 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb0f8d5-8315-4b4b-b0df-9f05956325f5 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:57.456976 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 767/1519] 10.222.0.65 () {54 vars in 960 bytes} [Tue May 10 03:16:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:16:57.462764 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f23a7-b62a-49c4-be25-73034d76c577 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:57.463203 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f23a7-b62a-49c4-be25-73034d76c577 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:57.463317 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f23a7-b62a-49c4-be25-73034d76c577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:57.480988 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-023f23a7-b62a-49c4-be25-73034d76c577 None None] MFA Rules not processed for user `f646147bdad8476ba0ab9da5d9c50b55`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:16:57.482312 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-023f23a7-b62a-49c4-be25-73034d76c577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:16:57.491048 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 753/1520] 10.222.0.65 () {58 vars in 1057 bytes} [Tue May 10 03:16:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:16:57.500046 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb0f8d5-8315-4b4b-b0df-9f05956325f5 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:16:57.515088 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb0f8d5-8315-4b4b-b0df-9f05956325f5 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:16:57.519988 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd07111-3a92-4380-9d6f-ff3619ed6e53 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f646147bdad8476ba0ab9da5d9c50b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:16:57.520659 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd07111-3a92-4380-9d6f-ff3619ed6e53 service placement] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:16:57.520939 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd07111-3a92-4380-9d6f-ff3619ed6e53 service placement] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:16:57.521213 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd07111-3a92-4380-9d6f-ff3619ed6e53 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:16:57.530386 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd07111-3a92-4380-9d6f-ff3619ed6e53 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:16:57.531944 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd07111-3a92-4380-9d6f-ff3619ed6e53 service placement] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:16:57.541991 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 768/1521] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:16:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:17:05.111403 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf8667-8e84-429a-b566-4feb88b5c812 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:17:05.111933 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf8667-8e84-429a-b566-4feb88b5c812 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:17:05.111933 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf8667-8e84-429a-b566-4feb88b5c812 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:17:05.113297 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 754/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 03:17:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:17:05.118261 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709eb48-c14b-426b-a276-b827a1251752 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:17:05.118715 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709eb48-c14b-426b-a276-b827a1251752 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:17:05.118826 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709eb48-c14b-426b-a276-b827a1251752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:17:05.137038 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-d709eb48-c14b-426b-a276-b827a1251752 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:17:05.138212 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-d709eb48-c14b-426b-a276-b827a1251752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:17:05.145834 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 769/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 03:17:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:17:05.303039 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf8667-8e84-429a-b566-4feb88b5c812 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:17:05.318399 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf8667-8e84-429a-b566-4feb88b5c812 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:17:05.323779 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b24870e-db47-4adc-a990-689bda3e787a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b7ccdccba0b4f9e86817946f22dbe28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:17:05.324443 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24870e-db47-4adc-a990-689bda3e787a service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:17:05.324730 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24870e-db47-4adc-a990-689bda3e787a service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:17:05.325010 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24870e-db47-4adc-a990-689bda3e787a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:17:05.332881 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b24870e-db47-4adc-a990-689bda3e787a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:17:05.334471 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b24870e-db47-4adc-a990-689bda3e787a service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:17:05.343724 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 755/1524] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:17:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:17:06.227166 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a6bab-d94c-4150-ae3c-0b57a83e593c None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:17:06.227777 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a6bab-d94c-4150-ae3c-0b57a83e593c None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:17:06.227888 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a6bab-d94c-4150-ae3c-0b57a83e593c None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:17:06.229854 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 770/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 03:17:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:17:06.234631 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68298ecb-9b65-496b-a469-13c21094f6e8 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:17:06.235128 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68298ecb-9b65-496b-a469-13c21094f6e8 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:17:06.235264 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68298ecb-9b65-496b-a469-13c21094f6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:17:06.253479 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-68298ecb-9b65-496b-a469-13c21094f6e8 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:17:06.254674 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-68298ecb-9b65-496b-a469-13c21094f6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:17:06.263057 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 756/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 03:17:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:17:06.419481 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78a6bab-d94c-4150-ae3c-0b57a83e593c None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:17:06.434015 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78a6bab-d94c-4150-ae3c-0b57a83e593c None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:17:06.439303 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be78ebf5-dd44-4d93-b3b8-81218400d4fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b7ccdccba0b4f9e86817946f22dbe28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:17:06.439928 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78ebf5-dd44-4d93-b3b8-81218400d4fb service nova] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:17:06.440244 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78ebf5-dd44-4d93-b3b8-81218400d4fb service nova] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:17:06.440520 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78ebf5-dd44-4d93-b3b8-81218400d4fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:17:06.448952 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be78ebf5-dd44-4d93-b3b8-81218400d4fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:17:06.450513 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be78ebf5-dd44-4d93-b3b8-81218400d4fb service nova] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:17:06.460038 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 771/1527] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:17:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:17:10.471105 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6d794-a9c0-4cab-87d6-837554aa0921 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:17:10.471640 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6d794-a9c0-4cab-87d6-837554aa0921 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:17:10.471640 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6d794-a9c0-4cab-87d6-837554aa0921 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:17:10.473064 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 757/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 03:17:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:17:10.478203 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5dec86-09c2-4d76-9b3d-19806d7a7eca None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:17:10.478657 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5dec86-09c2-4d76-9b3d-19806d7a7eca None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:17:10.478764 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5dec86-09c2-4d76-9b3d-19806d7a7eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:17:10.496872 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-8b5dec86-09c2-4d76-9b3d-19806d7a7eca None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:17:10.498053 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-8b5dec86-09c2-4d76-9b3d-19806d7a7eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:17:10.505872 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 772/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 03:17:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:17:10.543548 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd6d794-a9c0-4cab-87d6-837554aa0921 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:17:10.546103 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-afd6d794-a9c0-4cab-87d6-837554aa0921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:17:10.612280 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd6d794-a9c0-4cab-87d6-837554aa0921 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:17:10.619131 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5994ffc2-a5a1-4a74-b212-b01b17c5bc92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:17:10.619787 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994ffc2-a5a1-4a74-b212-b01b17c5bc92 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:17:10.620111 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994ffc2-a5a1-4a74-b212-b01b17c5bc92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:17:10.620391 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994ffc2-a5a1-4a74-b212-b01b17c5bc92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:17:10.629834 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5994ffc2-a5a1-4a74-b212-b01b17c5bc92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:17:10.631280 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5994ffc2-a5a1-4a74-b212-b01b17c5bc92 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:17:10.644830 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 758/1530] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:17:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:17:12.873259 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5554a767-b11a-47a0-bae8-6d59807fada5 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:17:12.873811 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5554a767-b11a-47a0-bae8-6d59807fada5 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:17:12.873811 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5554a767-b11a-47a0-bae8-6d59807fada5 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:17:12.875228 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 773/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 03:17:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:17:12.880633 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091452e4-671b-42d8-b8a2-db69eb3286c6 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:17:12.881071 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091452e4-671b-42d8-b8a2-db69eb3286c6 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:17:12.881219 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091452e4-671b-42d8-b8a2-db69eb3286c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:17:12.898944 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-091452e4-671b-42d8-b8a2-db69eb3286c6 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:17:12.900174 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-091452e4-671b-42d8-b8a2-db69eb3286c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:17:12.908376 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 759/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 03:17:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:17:12.943706 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5554a767-b11a-47a0-bae8-6d59807fada5 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:17:12.954517 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5554a767-b11a-47a0-bae8-6d59807fada5 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:17:12.958069 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7043e9-5de5-47b9-8ed2-efcd8ddc95d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:17:12.958704 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7043e9-5de5-47b9-8ed2-efcd8ddc95d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:17:12.958991 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7043e9-5de5-47b9-8ed2-efcd8ddc95d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:17:12.959284 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7043e9-5de5-47b9-8ed2-efcd8ddc95d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:17:12.968194 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7043e9-5de5-47b9-8ed2-efcd8ddc95d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:17:12.969604 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7043e9-5de5-47b9-8ed2-efcd8ddc95d6 service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:17:12.979307 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 774/1533] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:17:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:17:16.662335 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d7db6-89d5-4374-8d07-87645e50a7c6 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:17:16.662884 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d7db6-89d5-4374-8d07-87645e50a7c6 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:17:16.662884 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d7db6-89d5-4374-8d07-87645e50a7c6 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:17:16.664289 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 760/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 03:17:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:17:16.669738 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5b221-e558-4143-9769-a1cdf0958f10 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:17:16.670170 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5b221-e558-4143-9769-a1cdf0958f10 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:17:16.670274 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5b221-e558-4143-9769-a1cdf0958f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:17:16.687877 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-6fd5b221-e558-4143-9769-a1cdf0958f10 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:17:16.689104 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-6fd5b221-e558-4143-9769-a1cdf0958f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:17:16.697433 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 775/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 03:17:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:17:16.967890 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d7db6-89d5-4374-8d07-87645e50a7c6 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:17:16.969644 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-de4d7db6-89d5-4374-8d07-87645e50a7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:17:17.025883 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d7db6-89d5-4374-8d07-87645e50a7c6 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:17:17.029461 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ffb9e-e478-4465-8295-cfd7929c7056 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:17:17.030058 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ffb9e-e478-4465-8295-cfd7929c7056 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:17:17.030368 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ffb9e-e478-4465-8295-cfd7929c7056 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:17:17.030647 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ffb9e-e478-4465-8295-cfd7929c7056 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:17:17.039390 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8ffb9e-e478-4465-8295-cfd7929c7056 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:17:17.041108 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8ffb9e-e478-4465-8295-cfd7929c7056 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:17:17.050510 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 761/1536] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:17:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:17:19.269242 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b333d3-2bae-4c27-ac3f-aae0e8d35b1c None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:17:19.269810 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b333d3-2bae-4c27-ac3f-aae0e8d35b1c None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:17:19.269810 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b333d3-2bae-4c27-ac3f-aae0e8d35b1c None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:17:19.271145 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 776/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 03:17:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:17:19.276854 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277f7be-0f62-4848-8706-9de71f3d0f0e None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:17:19.277296 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277f7be-0f62-4848-8706-9de71f3d0f0e None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:17:19.277453 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277f7be-0f62-4848-8706-9de71f3d0f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:17:19.295980 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-b277f7be-0f62-4848-8706-9de71f3d0f0e None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:17:19.297208 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-b277f7be-0f62-4848-8706-9de71f3d0f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:17:19.305033 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 762/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 03:17:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:17:19.574283 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b333d3-2bae-4c27-ac3f-aae0e8d35b1c None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:17:19.575979 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-c1b333d3-2bae-4c27-ac3f-aae0e8d35b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:17:19.589451 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b333d3-2bae-4c27-ac3f-aae0e8d35b1c None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:17:19.592973 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a7fce0-9df1-431d-83f2-2cbfa4b80238 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:17:19.593612 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7fce0-9df1-431d-83f2-2cbfa4b80238 service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:17:19.593896 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7fce0-9df1-431d-83f2-2cbfa4b80238 service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:17:19.594177 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7fce0-9df1-431d-83f2-2cbfa4b80238 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:17:19.602936 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a7fce0-9df1-431d-83f2-2cbfa4b80238 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:17:19.604381 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a7fce0-9df1-431d-83f2-2cbfa4b80238 service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:17:19.613747 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 777/1539] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:17:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:18:51.575580 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9253aa-9754-4152-b939-254a42db4a13 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:51.579192 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9253aa-9754-4152-b939-254a42db4a13 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:51.579192 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9253aa-9754-4152-b939-254a42db4a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:51.629694 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-9d9253aa-9754-4152-b939-254a42db4a13 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:18:51.631783 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-9d9253aa-9754-4152-b939-254a42db4a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:18:51.645498 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28c4dd-7a25-427e-89f7-04fa27eb5080 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:51.646529 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28c4dd-7a25-427e-89f7-04fa27eb5080 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:51.647050 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28c4dd-7a25-427e-89f7-04fa27eb5080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:51.650606 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 763/1540] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:18:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:18:51.672894 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376dce46-b221-4c0f-b517-3b4c53d6f386 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:51.674236 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376dce46-b221-4c0f-b517-3b4c53d6f386 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:51.674743 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376dce46-b221-4c0f-b517-3b4c53d6f386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:51.678194 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-1b28c4dd-7a25-427e-89f7-04fa27eb5080 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:18:51.679991 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-1b28c4dd-7a25-427e-89f7-04fa27eb5080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:18:51.694574 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 778/1541] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:18:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:18:51.704963 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8fe6eb-b331-492e-ab26-e69ebb44471d None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:51.705573 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8fe6eb-b331-492e-ab26-e69ebb44471d None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:51.706076 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8fe6eb-b331-492e-ab26-e69ebb44471d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:51.725385 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-376dce46-b221-4c0f-b517-3b4c53d6f386 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:18:51.727437 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-376dce46-b221-4c0f-b517-3b4c53d6f386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:18:51.733984 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-ed8fe6eb-b331-492e-ab26-e69ebb44471d None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:18:51.735466 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-ed8fe6eb-b331-492e-ab26-e69ebb44471d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:18:51.754887 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 779/1543] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:18:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:18:51.755308 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 764/1543] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:18:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:18:51.759700 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376dce46-b221-4c0f-b517-3b4c53d6f386 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:51.761041 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8fe6eb-b331-492e-ab26-e69ebb44471d None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:51.771905 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8fe6eb-b331-492e-ab26-e69ebb44471d None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:51.781116 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376dce46-b221-4c0f-b517-3b4c53d6f386 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:51.784113 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c0c116-8291-4349-a605-7fa14981a537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:51.785058 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0c116-8291-4349-a605-7fa14981a537 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:51.785566 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0c116-8291-4349-a605-7fa14981a537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:51.786068 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0c116-8291-4349-a605-7fa14981a537 admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:51.787229 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c0c116-8291-4349-a605-7fa14981a537 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:18:51.787767 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c0c116-8291-4349-a605-7fa14981a537 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:51.789017 dv-cinder-830094-4-smb devstack@keystone.service[80197]: WARNING py.warnings [None req-42c0c116-8291-4349-a605-7fa14981a537 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 03:18:51.789017 dv-cinder-830094-4-smb devstack@keystone.service[80197]: warnings.warn(msg) May 10 03:18:51.789017 dv-cinder-830094-4-smb devstack@keystone.service[80197]: May 10 03:18:51.790557 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c0c116-8291-4349-a605-7fa14981a537 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:51.800028 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f022a15-b128-42ad-a65c-d421abd7378b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:51.800028 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f022a15-b128-42ad-a65c-d421abd7378b admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:51.800028 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f022a15-b128-42ad-a65c-d421abd7378b admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:51.800521 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f022a15-b128-42ad-a65c-d421abd7378b admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:51.801768 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f022a15-b128-42ad-a65c-d421abd7378b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:18:51.802337 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f022a15-b128-42ad-a65c-d421abd7378b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:51.814383 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 780/1544] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 10 03:18:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:18:51.814577 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f022a15-b128-42ad-a65c-d421abd7378b admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:51.822819 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c0c116-8291-4349-a605-7fa14981a537 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:51.842607 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c0c116-8291-4349-a605-7fa14981a537 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:51.845177 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 765/1545] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 10 03:18:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:18:51.853789 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f022a15-b128-42ad-a65c-d421abd7378b admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:51.856130 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a501f802-c80b-4b1f-b364-02f41439e2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:51.857051 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501f802-c80b-4b1f-b364-02f41439e2ed admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:51.857556 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501f802-c80b-4b1f-b364-02f41439e2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:51.858062 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501f802-c80b-4b1f-b364-02f41439e2ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:51.858977 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a501f802-c80b-4b1f-b364-02f41439e2ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:51.861470 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a501f802-c80b-4b1f-b364-02f41439e2ed admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:51.877518 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f022a15-b128-42ad-a65c-d421abd7378b admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:51.894211 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88113429-b440-48bc-a579-f0c7b3510737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:51.895546 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88113429-b440-48bc-a579-f0c7b3510737 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:51.896144 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88113429-b440-48bc-a579-f0c7b3510737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:51.903836 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88113429-b440-48bc-a579-f0c7b3510737 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:51.903836 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88113429-b440-48bc-a579-f0c7b3510737 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:51.903836 dv-cinder-830094-4-smb devstack@keystone.service[80198]: WARNING py.warnings [None req-88113429-b440-48bc-a579-f0c7b3510737 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 03:18:51.903836 dv-cinder-830094-4-smb devstack@keystone.service[80198]: warnings.warn(msg) May 10 03:18:51.903836 dv-cinder-830094-4-smb devstack@keystone.service[80198]: May 10 03:18:51.905324 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88113429-b440-48bc-a579-f0c7b3510737 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:52.001457 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 781/1546] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:18:51 2022] POST /identity/v3/projects => generated 363 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:18:52.003191 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fc5942-58da-4a0e-adc0-228218ad1397 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:52.003711 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fc5942-58da-4a0e-adc0-228218ad1397 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:52.004256 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fc5942-58da-4a0e-adc0-228218ad1397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:52.060424 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 766/1547] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:18:51 2022] POST /identity/v3/projects => generated 365 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:18:52.062968 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88113429-b440-48bc-a579-f0c7b3510737 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:52.070481 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-57fc5942-58da-4a0e-adc0-228218ad1397 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:18:52.075434 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-57fc5942-58da-4a0e-adc0-228218ad1397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:18:52.262530 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88113429-b440-48bc-a579-f0c7b3510737 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:52.267488 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 782/1548] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:18:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:18:52.269215 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fc5942-58da-4a0e-adc0-228218ad1397 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:52.274034 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a867ad08-af15-4b4b-b930-f19dde86621e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:52.275772 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a867ad08-af15-4b4b-b930-f19dde86621e admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:52.276353 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a867ad08-af15-4b4b-b930-f19dde86621e admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:52.276822 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a867ad08-af15-4b4b-b930-f19dde86621e admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:52.278191 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a867ad08-af15-4b4b-b930-f19dde86621e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:52.281811 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a867ad08-af15-4b4b-b930-f19dde86621e admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:52.296939 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fc5942-58da-4a0e-adc0-228218ad1397 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:52.311048 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8dd762-5bcc-46fc-9c67-82121ddbf58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:52.312310 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8dd762-5bcc-46fc-9c67-82121ddbf58b admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:52.312885 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8dd762-5bcc-46fc-9c67-82121ddbf58b admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:52.313386 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8dd762-5bcc-46fc-9c67-82121ddbf58b admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:52.314751 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8dd762-5bcc-46fc-9c67-82121ddbf58b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:52.316736 dv-cinder-830094-4-smb devstack@keystone.service[80197]: WARNING py.warnings [None req-bd8dd762-5bcc-46fc-9c67-82121ddbf58b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 03:18:52.316736 dv-cinder-830094-4-smb devstack@keystone.service[80197]: warnings.warn(msg) May 10 03:18:52.316736 dv-cinder-830094-4-smb devstack@keystone.service[80197]: May 10 03:18:52.319162 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8dd762-5bcc-46fc-9c67-82121ddbf58b admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:52.365381 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 767/1549] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:18:52 2022] POST /identity/v3/users => generated 282 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:18:52.366845 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ccbc21-a812-432d-83a1-2b3dd8a86e2b None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:52.367223 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ccbc21-a812-432d-83a1-2b3dd8a86e2b None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:52.367577 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ccbc21-a812-432d-83a1-2b3dd8a86e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:52.394131 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-30ccbc21-a812-432d-83a1-2b3dd8a86e2b None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:18:52.395710 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-30ccbc21-a812-432d-83a1-2b3dd8a86e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:18:52.404948 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 768/1550] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:18:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:18:52.406285 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268839ad-f7be-4ca1-822e-fd786d832b80 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:52.406580 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268839ad-f7be-4ca1-822e-fd786d832b80 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:52.406856 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268839ad-f7be-4ca1-822e-fd786d832b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:52.419201 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 783/1551] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:18:52 2022] POST /identity/v3/users => generated 283 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:18:52.421593 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde33a3d-20c9-4a13-9b76-99262d800812 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:52.422124 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde33a3d-20c9-4a13-9b76-99262d800812 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:52.423015 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde33a3d-20c9-4a13-9b76-99262d800812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:52.426816 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-268839ad-f7be-4ca1-822e-fd786d832b80 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:18:52.428081 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-268839ad-f7be-4ca1-822e-fd786d832b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:18:52.437243 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 769/1552] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:18:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:18:52.440061 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b735b0b-2a7c-4cc1-bd28-2f4e3df48070 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:52.440061 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b735b0b-2a7c-4cc1-bd28-2f4e3df48070 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:52.440061 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b735b0b-2a7c-4cc1-bd28-2f4e3df48070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:52.444847 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-dde33a3d-20c9-4a13-9b76-99262d800812 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:18:52.446376 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-dde33a3d-20c9-4a13-9b76-99262d800812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:18:52.457285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 784/1553] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:18:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:18:52.458431 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde33a3d-20c9-4a13-9b76-99262d800812 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:52.465712 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-7b735b0b-2a7c-4cc1-bd28-2f4e3df48070 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:18:52.466917 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-7b735b0b-2a7c-4cc1-bd28-2f4e3df48070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:18:52.470210 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde33a3d-20c9-4a13-9b76-99262d800812 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:52.474863 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb282c-e4bc-43b0-ad94-112373059f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:52.475409 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 770/1554] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:18:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:18:52.476575 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f85aa02-6db3-452a-9c18-63db7a44e484 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:52.476893 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f85aa02-6db3-452a-9c18-63db7a44e484 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:52.477179 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f85aa02-6db3-452a-9c18-63db7a44e484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:52.483959 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb282c-e4bc-43b0-ad94-112373059f30 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:52.485087 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb282c-e4bc-43b0-ad94-112373059f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:52.485087 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb282c-e4bc-43b0-ad94-112373059f30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:52.485359 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bb282c-e4bc-43b0-ad94-112373059f30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:52.486941 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bb282c-e4bc-43b0-ad94-112373059f30 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:52.496344 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-0f85aa02-6db3-452a-9c18-63db7a44e484 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:18:52.497639 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-0f85aa02-6db3-452a-9c18-63db7a44e484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:18:52.498224 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 785/1555] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:18:52.502275 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a705fa0-963c-4419-9d84-26891989c2ef None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:52.502559 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a705fa0-963c-4419-9d84-26891989c2ef None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:52.502838 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a705fa0-963c-4419-9d84-26891989c2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:52.505819 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 771/1556] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:18:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:18:52.515323 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f85aa02-6db3-452a-9c18-63db7a44e484 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:52.524346 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-5a705fa0-963c-4419-9d84-26891989c2ef None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:18:52.524520 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f85aa02-6db3-452a-9c18-63db7a44e484 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:52.526423 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-5a705fa0-963c-4419-9d84-26891989c2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:18:52.529568 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a078d81b-f380-4dd6-9405-709daed58ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:52.530219 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078d81b-f380-4dd6-9405-709daed58ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:52.530502 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078d81b-f380-4dd6-9405-709daed58ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:52.530773 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078d81b-f380-4dd6-9405-709daed58ef8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:52.531523 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a078d81b-f380-4dd6-9405-709daed58ef8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:52.533156 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a078d81b-f380-4dd6-9405-709daed58ef8 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:52.534565 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 786/1557] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:18:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:18:52.535767 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1d41d-788b-4b62-a8c6-8ff14c5511aa None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:52.536078 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1d41d-788b-4b62-a8c6-8ff14c5511aa None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:52.536355 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1d41d-788b-4b62-a8c6-8ff14c5511aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:52.546200 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 772/1558] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:18:52.546200 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a078d81b-f380-4dd6-9405-709daed58ef8 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:52.553447 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a078d81b-f380-4dd6-9405-709daed58ef8 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:52.554871 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-fbc1d41d-788b-4b62-a8c6-8ff14c5511aa None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:18:52.556086 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-fbc1d41d-788b-4b62-a8c6-8ff14c5511aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:18:52.558314 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f45b33-2081-4241-a090-6e746cdeecc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:52.558969 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f45b33-2081-4241-a090-6e746cdeecc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:52.559251 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f45b33-2081-4241-a090-6e746cdeecc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:52.559527 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f45b33-2081-4241-a090-6e746cdeecc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:52.560337 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f45b33-2081-4241-a090-6e746cdeecc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:18:52.560804 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f45b33-2081-4241-a090-6e746cdeecc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:52.563339 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f45b33-2081-4241-a090-6e746cdeecc7 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:52.564226 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 787/1559] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:18:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:18:52.565545 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528c03a-250b-4172-89bf-b8c5fb9bd1ef None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:52.565830 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528c03a-250b-4172-89bf-b8c5fb9bd1ef None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:52.566100 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528c03a-250b-4172-89bf-b8c5fb9bd1ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:52.581602 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 773/1560] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 10 03:18:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:18:52.582682 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f45b33-2081-4241-a090-6e746cdeecc7 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:52.583453 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-8528c03a-250b-4172-89bf-b8c5fb9bd1ef None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:18:52.584791 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-8528c03a-250b-4172-89bf-b8c5fb9bd1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:18:52.593472 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 788/1561] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:18:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:18:52.594743 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da090d71-8c65-4a4e-866d-6347cc6ad77e None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:52.595030 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da090d71-8c65-4a4e-866d-6347cc6ad77e None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:52.595301 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da090d71-8c65-4a4e-866d-6347cc6ad77e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:52.597573 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f45b33-2081-4241-a090-6e746cdeecc7 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:52.602304 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341fc48a-7639-484d-b6ae-a04307f6b14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:52.603020 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341fc48a-7639-484d-b6ae-a04307f6b14f admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:52.603298 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341fc48a-7639-484d-b6ae-a04307f6b14f admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:52.603575 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341fc48a-7639-484d-b6ae-a04307f6b14f admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:52.604344 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341fc48a-7639-484d-b6ae-a04307f6b14f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:52.605989 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341fc48a-7639-484d-b6ae-a04307f6b14f admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:52.613853 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-da090d71-8c65-4a4e-866d-6347cc6ad77e None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:18:52.616360 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-da090d71-8c65-4a4e-866d-6347cc6ad77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:18:52.616573 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 774/1562] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:18:52.618150 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006243f9-547b-48ff-be8b-d891271c0266 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:52.618609 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006243f9-547b-48ff-be8b-d891271c0266 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:52.619078 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006243f9-547b-48ff-be8b-d891271c0266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:52.625929 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 789/1563] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:18:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:18:52.626729 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da090d71-8c65-4a4e-866d-6347cc6ad77e None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:52.636669 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da090d71-8c65-4a4e-866d-6347cc6ad77e None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:52.638778 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-006243f9-547b-48ff-be8b-d891271c0266 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:18:52.639968 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-006243f9-547b-48ff-be8b-d891271c0266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:18:52.641478 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd75b3c3-448e-4746-887b-5f85daff3f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:52.642117 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75b3c3-448e-4746-887b-5f85daff3f33 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:52.642403 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75b3c3-448e-4746-887b-5f85daff3f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:52.642676 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75b3c3-448e-4746-887b-5f85daff3f33 admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:52.643406 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd75b3c3-448e-4746-887b-5f85daff3f33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:18:52.643712 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd75b3c3-448e-4746-887b-5f85daff3f33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:52.645331 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd75b3c3-448e-4746-887b-5f85daff3f33 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:52.648023 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 775/1564] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:18:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:18:52.648795 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006243f9-547b-48ff-be8b-d891271c0266 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:52.657383 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 790/1565] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 10 03:18:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:18:52.658195 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd75b3c3-448e-4746-887b-5f85daff3f33 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:52.658319 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006243f9-547b-48ff-be8b-d891271c0266 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:52.662945 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c805ef1-0ee4-4c15-8144-4e161a8cbb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:52.663581 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c805ef1-0ee4-4c15-8144-4e161a8cbb46 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:52.663848 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c805ef1-0ee4-4c15-8144-4e161a8cbb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:52.664873 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c805ef1-0ee4-4c15-8144-4e161a8cbb46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:52.665270 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c805ef1-0ee4-4c15-8144-4e161a8cbb46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:52.666921 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c805ef1-0ee4-4c15-8144-4e161a8cbb46 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:52.668216 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd75b3c3-448e-4746-887b-5f85daff3f33 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:52.672828 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b0a638-00aa-4951-b2c0-e51e2b5d4325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:52.673494 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b0a638-00aa-4951-b2c0-e51e2b5d4325 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:52.673782 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b0a638-00aa-4951-b2c0-e51e2b5d4325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:52.674058 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b0a638-00aa-4951-b2c0-e51e2b5d4325 admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:52.674773 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b0a638-00aa-4951-b2c0-e51e2b5d4325 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:18:52.675110 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b0a638-00aa-4951-b2c0-e51e2b5d4325 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:52.676788 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b0a638-00aa-4951-b2c0-e51e2b5d4325 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:52.676977 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 776/1566] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:18:52.677775 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c805ef1-0ee4-4c15-8144-4e161a8cbb46 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:52.687924 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c805ef1-0ee4-4c15-8144-4e161a8cbb46 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:52.689084 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 791/1567] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 10 03:18:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:18:52.689889 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b0a638-00aa-4951-b2c0-e51e2b5d4325 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:52.693174 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8caf7b-821a-4245-a2e0-609606b15ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:52.693824 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8caf7b-821a-4245-a2e0-609606b15ee3 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:52.694108 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8caf7b-821a-4245-a2e0-609606b15ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:52.694380 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8caf7b-821a-4245-a2e0-609606b15ee3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:52.695062 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8caf7b-821a-4245-a2e0-609606b15ee3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:52.697964 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8caf7b-821a-4245-a2e0-609606b15ee3 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:52.699781 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b0a638-00aa-4951-b2c0-e51e2b5d4325 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:52.704409 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb64520-85b9-4d5c-a01e-55bdf26475e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:52.705042 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb64520-85b9-4d5c-a01e-55bdf26475e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:52.705328 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb64520-85b9-4d5c-a01e-55bdf26475e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:52.705603 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb64520-85b9-4d5c-a01e-55bdf26475e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:52.706462 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb64520-85b9-4d5c-a01e-55bdf26475e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:18:52.706773 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb64520-85b9-4d5c-a01e-55bdf26475e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:52.708371 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb64520-85b9-4d5c-a01e-55bdf26475e5 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:52.719454 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 792/1568] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 10 03:18:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:18:52.720250 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb64520-85b9-4d5c-a01e-55bdf26475e5 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:52.729504 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb64520-85b9-4d5c-a01e-55bdf26475e5 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:52.734083 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfee24f-c330-42c8-95b2-a1ed9fe8fcaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:52.734920 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfee24f-c330-42c8-95b2-a1ed9fe8fcaa admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:52.735206 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfee24f-c330-42c8-95b2-a1ed9fe8fcaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:52.735484 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfee24f-c330-42c8-95b2-a1ed9fe8fcaa admin admin] PATH_INFO: `/v3/projects/35ca140de3264740a72971dd222962c7/users/2b48a79dad444a76b72424de6f57b166/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:52.749821 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfee24f-c330-42c8-95b2-a1ed9fe8fcaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=35ca140de3264740a72971dd222962c7, user_id=2b48a79dad444a76b72424de6f57b166, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:52.752542 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfee24f-c330-42c8-95b2-a1ed9fe8fcaa admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:52.783331 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 777/1569] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:18:52 2022] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:18:52.783331 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8caf7b-821a-4245-a2e0-609606b15ee3 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:52.843382 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8caf7b-821a-4245-a2e0-609606b15ee3 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:52.845042 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 793/1570] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:18:52 2022] PUT /identity/v3/projects/35ca140de3264740a72971dd222962c7/users/2b48a79dad444a76b72424de6f57b166/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:18:52.846389 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff862d-0820-4712-a69c-1e0b0c4dc243 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:52.846681 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff862d-0820-4712-a69c-1e0b0c4dc243 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:52.846962 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff862d-0820-4712-a69c-1e0b0c4dc243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:52.871350 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-98ff862d-0820-4712-a69c-1e0b0c4dc243 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:18:52.872647 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-98ff862d-0820-4712-a69c-1e0b0c4dc243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:18:52.903254 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa51ee4-3f08-452f-9d9d-f9be834010f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:52.903934 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa51ee4-3f08-452f-9d9d-f9be834010f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:52.904248 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa51ee4-3f08-452f-9d9d-f9be834010f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:52.904530 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa51ee4-3f08-452f-9d9d-f9be834010f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:52.905290 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa51ee4-3f08-452f-9d9d-f9be834010f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:18:52.905608 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa51ee4-3f08-452f-9d9d-f9be834010f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:52.907246 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa51ee4-3f08-452f-9d9d-f9be834010f5 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:52.919454 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 778/1571] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 10 03:18:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:18:52.920299 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa51ee4-3f08-452f-9d9d-f9be834010f5 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:52.929684 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa51ee4-3f08-452f-9d9d-f9be834010f5 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:52.934346 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ba3f3-7142-4599-a5df-9e185ae26419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:52.935003 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ba3f3-7142-4599-a5df-9e185ae26419 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:52.935302 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ba3f3-7142-4599-a5df-9e185ae26419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:52.935582 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ba3f3-7142-4599-a5df-9e185ae26419 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:52.936309 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199ba3f3-7142-4599-a5df-9e185ae26419 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:52.938259 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199ba3f3-7142-4599-a5df-9e185ae26419 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:52.938449 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 794/1572] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:18:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:18:52.939263 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff862d-0820-4712-a69c-1e0b0c4dc243 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:52.950950 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff862d-0820-4712-a69c-1e0b0c4dc243 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:52.955566 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3dc057-2d83-4a0d-ae78-a93724ca2006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:52.956466 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3dc057-2d83-4a0d-ae78-a93724ca2006 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:52.956751 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3dc057-2d83-4a0d-ae78-a93724ca2006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:52.957084 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3dc057-2d83-4a0d-ae78-a93724ca2006 admin admin] PATH_INFO: `/v3/projects/91fe5079c1bd49329fdd29401e8b7504/users/ecff02dd499145acb25dc4c26e863ae4/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:52.971660 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3dc057-2d83-4a0d-ae78-a93724ca2006 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91fe5079c1bd49329fdd29401e8b7504, user_id=ecff02dd499145acb25dc4c26e863ae4, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:52.974363 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3dc057-2d83-4a0d-ae78-a93724ca2006 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:53.034019 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 779/1573] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:18:52 2022] POST /identity/v3/projects => generated 393 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:18:53.034839 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ba3f3-7142-4599-a5df-9e185ae26419 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:53.067381 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 795/1574] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:18:52 2022] PUT /identity/v3/projects/91fe5079c1bd49329fdd29401e8b7504/users/ecff02dd499145acb25dc4c26e863ae4/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:18:53.068338 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3dc057-2d83-4a0d-ae78-a93724ca2006 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:53.095384 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ba3f3-7142-4599-a5df-9e185ae26419 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:53.128436 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3dc057-2d83-4a0d-ae78-a93724ca2006 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:53.133297 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d8eb93-700b-4c5b-a314-3cf922b64a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:53.133947 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8eb93-700b-4c5b-a314-3cf922b64a4a admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:53.134222 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8eb93-700b-4c5b-a314-3cf922b64a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:53.135117 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8eb93-700b-4c5b-a314-3cf922b64a4a admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:53.135802 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d8eb93-700b-4c5b-a314-3cf922b64a4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:53.137711 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d8eb93-700b-4c5b-a314-3cf922b64a4a admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:53.149035 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5542f891-9e5f-4b80-b760-d8aff3a0dc35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:53.149706 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542f891-9e5f-4b80-b760-d8aff3a0dc35 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:53.149994 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542f891-9e5f-4b80-b760-d8aff3a0dc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:53.150891 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542f891-9e5f-4b80-b760-d8aff3a0dc35 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:53.151569 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5542f891-9e5f-4b80-b760-d8aff3a0dc35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:53.153491 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5542f891-9e5f-4b80-b760-d8aff3a0dc35 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:53.246042 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 796/1575] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:18:53 2022] POST /identity/v3/projects => generated 377 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:18:53.246849 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d8eb93-700b-4c5b-a314-3cf922b64a4a admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:53.288906 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 780/1576] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:18:53 2022] POST /identity/v3/projects => generated 389 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:18:53.288906 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18a6a6-c46d-4bc5-b267-92f7ecd75172 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:53.288906 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18a6a6-c46d-4bc5-b267-92f7ecd75172 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:53.288906 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18a6a6-c46d-4bc5-b267-92f7ecd75172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:53.308036 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d8eb93-700b-4c5b-a314-3cf922b64a4a admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:53.316728 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-fb18a6a6-c46d-4bc5-b267-92f7ecd75172 None None] MFA Rules not processed for user `2b48a79dad444a76b72424de6f57b166`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:18:53.317912 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-fb18a6a6-c46d-4bc5-b267-92f7ecd75172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:18:53.366618 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907307c8-c600-4e62-b368-3bf0ee5eab1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:53.367288 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907307c8-c600-4e62-b368-3bf0ee5eab1b admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:53.367567 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907307c8-c600-4e62-b368-3bf0ee5eab1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:53.367960 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907307c8-c600-4e62-b368-3bf0ee5eab1b admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:53.368831 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907307c8-c600-4e62-b368-3bf0ee5eab1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:53.371350 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907307c8-c600-4e62-b368-3bf0ee5eab1b admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:53.384159 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 781/1577] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:18:53 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:18:53.385024 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18a6a6-c46d-4bc5-b267-92f7ecd75172 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:53.395110 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18a6a6-c46d-4bc5-b267-92f7ecd75172 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:53.399749 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f745c3-8cb6-40a1-8348-e42fc17adb5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:53.400457 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f745c3-8cb6-40a1-8348-e42fc17adb5e admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:53.400741 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f745c3-8cb6-40a1-8348-e42fc17adb5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:53.401017 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f745c3-8cb6-40a1-8348-e42fc17adb5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:53.401701 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f745c3-8cb6-40a1-8348-e42fc17adb5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:53.403699 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f745c3-8cb6-40a1-8348-e42fc17adb5e admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:53.439408 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 797/1578] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:18:53 2022] POST /identity/v3/users => generated 289 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:18:53.440335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907307c8-c600-4e62-b368-3bf0ee5eab1b admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:53.450818 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907307c8-c600-4e62-b368-3bf0ee5eab1b admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:53.458213 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41cdcd-3eb7-4d0c-8ffa-81e965dcd176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:53.458993 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41cdcd-3eb7-4d0c-8ffa-81e965dcd176 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:53.459394 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41cdcd-3eb7-4d0c-8ffa-81e965dcd176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:53.459737 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41cdcd-3eb7-4d0c-8ffa-81e965dcd176 admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:53.460570 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f41cdcd-3eb7-4d0c-8ffa-81e965dcd176 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:18:53.460881 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f41cdcd-3eb7-4d0c-8ffa-81e965dcd176 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:53.463015 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f41cdcd-3eb7-4d0c-8ffa-81e965dcd176 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:53.475808 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 798/1579] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 10 03:18:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:18:53.476632 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41cdcd-3eb7-4d0c-8ffa-81e965dcd176 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:53.486782 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41cdcd-3eb7-4d0c-8ffa-81e965dcd176 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:53.491424 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa2d264-cde4-4627-8e41-172d9a2f532a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:53.492816 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 782/1580] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:18:53 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:18:53.492932 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2d264-cde4-4627-8e41-172d9a2f532a admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:53.492932 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2d264-cde4-4627-8e41-172d9a2f532a admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:53.492932 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2d264-cde4-4627-8e41-172d9a2f532a admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:53.493188 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ebdf7e-797d-40fb-8181-2b570e6ce6e9 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:53.493188 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ebdf7e-797d-40fb-8181-2b570e6ce6e9 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:53.493405 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa2d264-cde4-4627-8e41-172d9a2f532a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:53.493504 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ebdf7e-797d-40fb-8181-2b570e6ce6e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:53.497402 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa2d264-cde4-4627-8e41-172d9a2f532a admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:53.519738 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-04ebdf7e-797d-40fb-8181-2b570e6ce6e9 None None] MFA Rules not processed for user `ecff02dd499145acb25dc4c26e863ae4`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:18:53.520977 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-04ebdf7e-797d-40fb-8181-2b570e6ce6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:18:53.563067 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 799/1581] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:18:53 2022] POST /identity/v3/users => generated 297 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:18:53.563888 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa2d264-cde4-4627-8e41-172d9a2f532a admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:53.573290 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa2d264-cde4-4627-8e41-172d9a2f532a admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:53.583682 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 783/1582] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:18:53 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:18:53.584650 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ebdf7e-797d-40fb-8181-2b570e6ce6e9 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:53.628699 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35ce415-b6b9-466c-ad2f-5e7e7a9ca0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:53.629370 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ce415-b6b9-466c-ad2f-5e7e7a9ca0e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:53.629664 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ce415-b6b9-466c-ad2f-5e7e7a9ca0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:53.629928 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ce415-b6b9-466c-ad2f-5e7e7a9ca0e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:53.630614 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35ce415-b6b9-466c-ad2f-5e7e7a9ca0e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:53.632552 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35ce415-b6b9-466c-ad2f-5e7e7a9ca0e5 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:53.644718 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ebdf7e-797d-40fb-8181-2b570e6ce6e9 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:53.649317 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e6f17-8ed9-4ba6-a0cb-0eca15b4682a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:53.652406 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e6f17-8ed9-4ba6-a0cb-0eca15b4682a admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:53.652406 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e6f17-8ed9-4ba6-a0cb-0eca15b4682a admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:53.652406 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e6f17-8ed9-4ba6-a0cb-0eca15b4682a admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:53.652406 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669e6f17-8ed9-4ba6-a0cb-0eca15b4682a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:53.653699 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669e6f17-8ed9-4ba6-a0cb-0eca15b4682a admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:53.735536 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 800/1583] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:18:53 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:18:53.736415 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35ce415-b6b9-466c-ad2f-5e7e7a9ca0e5 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:53.746655 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35ce415-b6b9-466c-ad2f-5e7e7a9ca0e5 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:53.751561 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150d2ea-8761-4370-b441-2696cb65e3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:53.752220 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150d2ea-8761-4370-b441-2696cb65e3f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:53.752499 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150d2ea-8761-4370-b441-2696cb65e3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:53.752773 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150d2ea-8761-4370-b441-2696cb65e3f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:53.753473 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f150d2ea-8761-4370-b441-2696cb65e3f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:53.755409 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f150d2ea-8761-4370-b441-2696cb65e3f2 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:53.765313 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 784/1584] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:18:53 2022] POST /identity/v3/users => generated 295 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:18:53.765313 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e6f17-8ed9-4ba6-a0cb-0eca15b4682a admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:53.774542 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e6f17-8ed9-4ba6-a0cb-0eca15b4682a admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:53.779750 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec411a7a-372a-4d19-95f5-e346bcb102c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:53.780444 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec411a7a-372a-4d19-95f5-e346bcb102c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:53.780726 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec411a7a-372a-4d19-95f5-e346bcb102c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:53.781002 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec411a7a-372a-4d19-95f5-e346bcb102c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:53.781727 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec411a7a-372a-4d19-95f5-e346bcb102c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:53.783317 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec411a7a-372a-4d19-95f5-e346bcb102c5 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:53.794616 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 785/1585] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:18:53.795430 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec411a7a-372a-4d19-95f5-e346bcb102c5 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:53.804772 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec411a7a-372a-4d19-95f5-e346bcb102c5 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:53.809346 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b7961-c9fc-474d-a8e9-4bfa1892c077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:53.809967 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b7961-c9fc-474d-a8e9-4bfa1892c077 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:53.810252 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b7961-c9fc-474d-a8e9-4bfa1892c077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:53.810533 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b7961-c9fc-474d-a8e9-4bfa1892c077 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:53.811208 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6b7961-c9fc-474d-a8e9-4bfa1892c077 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:53.813205 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6b7961-c9fc-474d-a8e9-4bfa1892c077 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:53.874098 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 801/1586] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:18:53 2022] POST /identity/v3/projects => generated 363 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:18:53.875142 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150d2ea-8761-4370-b441-2696cb65e3f2 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:53.910201 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 786/1587] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:18:53 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:18:53.910201 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b7961-c9fc-474d-a8e9-4bfa1892c077 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:53.934799 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150d2ea-8761-4370-b441-2696cb65e3f2 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:53.971207 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b7961-c9fc-474d-a8e9-4bfa1892c077 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:53.976130 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c69dab-25ed-4c21-b90e-34435ee55247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:53.976801 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c69dab-25ed-4c21-b90e-34435ee55247 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:53.977086 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c69dab-25ed-4c21-b90e-34435ee55247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:53.977363 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c69dab-25ed-4c21-b90e-34435ee55247 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:53.978103 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c69dab-25ed-4c21-b90e-34435ee55247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:53.979704 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c69dab-25ed-4c21-b90e-34435ee55247 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:53.989097 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88a4bb5-5a58-452b-8a30-b1bafa4456dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:53.989451 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 787/1588] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:18:53.989769 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a4bb5-5a58-452b-8a30-b1bafa4456dc admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:53.990091 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a4bb5-5a58-452b-8a30-b1bafa4456dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:53.990252 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c69dab-25ed-4c21-b90e-34435ee55247 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:53.990364 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a4bb5-5a58-452b-8a30-b1bafa4456dc admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:53.991071 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88a4bb5-5a58-452b-8a30-b1bafa4456dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:53.993048 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88a4bb5-5a58-452b-8a30-b1bafa4456dc admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:54.044221 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c69dab-25ed-4c21-b90e-34435ee55247 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:54.047785 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19900c0-79e5-4ed7-8706-6ba0343fb3b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:54.048504 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19900c0-79e5-4ed7-8706-6ba0343fb3b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:54.048789 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19900c0-79e5-4ed7-8706-6ba0343fb3b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:54.049063 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19900c0-79e5-4ed7-8706-6ba0343fb3b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:54.070343 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 802/1589] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:18:53 2022] POST /identity/v3/users => generated 292 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:18:54.070343 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88a4bb5-5a58-452b-8a30-b1bafa4456dc admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:54.078219 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88a4bb5-5a58-452b-8a30-b1bafa4456dc admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:54.083656 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0eea28-aff4-4829-8966-a4ded9d94625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:54.084336 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0eea28-aff4-4829-8966-a4ded9d94625 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:54.084626 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0eea28-aff4-4829-8966-a4ded9d94625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:54.084898 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0eea28-aff4-4829-8966-a4ded9d94625 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:54.085619 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0eea28-aff4-4829-8966-a4ded9d94625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:54.087213 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0eea28-aff4-4829-8966-a4ded9d94625 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:54.102410 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 803/1590] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:18:54.102410 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0eea28-aff4-4829-8966-a4ded9d94625 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:54.107678 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19900c0-79e5-4ed7-8706-6ba0343fb3b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:54.111395 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19900c0-79e5-4ed7-8706-6ba0343fb3b1 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:54.112714 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0eea28-aff4-4829-8966-a4ded9d94625 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:54.118402 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803fa2ff-a4f5-4e2e-821d-ecf8b715860a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:54.119066 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 788/1591] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:18:53 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:18:54.119347 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803fa2ff-a4f5-4e2e-821d-ecf8b715860a admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:54.119638 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803fa2ff-a4f5-4e2e-821d-ecf8b715860a admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:54.119915 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803fa2ff-a4f5-4e2e-821d-ecf8b715860a admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:54.120145 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19900c0-79e5-4ed7-8706-6ba0343fb3b1 service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:54.120854 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803fa2ff-a4f5-4e2e-821d-ecf8b715860a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:54.122616 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803fa2ff-a4f5-4e2e-821d-ecf8b715860a admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:54.130741 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19900c0-79e5-4ed7-8706-6ba0343fb3b1 service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:54.135811 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 804/1592] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:18:54.138892 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b5e3c-07d8-465b-a8aa-37253db99584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:54.139004 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803fa2ff-a4f5-4e2e-821d-ecf8b715860a admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:54.139112 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b5e3c-07d8-465b-a8aa-37253db99584 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:54.139112 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b5e3c-07d8-465b-a8aa-37253db99584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:54.139112 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b5e3c-07d8-465b-a8aa-37253db99584 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:54.139112 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8b5e3c-07d8-465b-a8aa-37253db99584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:54.140938 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8b5e3c-07d8-465b-a8aa-37253db99584 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:54.149544 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803fa2ff-a4f5-4e2e-821d-ecf8b715860a admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:54.152203 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 789/1593] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:18:54.153215 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b5e3c-07d8-465b-a8aa-37253db99584 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:54.157284 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98571cbc-ebd9-4372-8c6e-a190f5984bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:54.157941 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98571cbc-ebd9-4372-8c6e-a190f5984bc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:54.158222 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98571cbc-ebd9-4372-8c6e-a190f5984bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:54.158533 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98571cbc-ebd9-4372-8c6e-a190f5984bc8 admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:54.159215 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98571cbc-ebd9-4372-8c6e-a190f5984bc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:54.161165 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98571cbc-ebd9-4372-8c6e-a190f5984bc8 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:54.165994 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b5e3c-07d8-465b-a8aa-37253db99584 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:54.171907 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f043b6ee-03f5-4dd3-a5d0-29c084398c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:54.172762 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043b6ee-03f5-4dd3-a5d0-29c084398c55 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:54.173125 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043b6ee-03f5-4dd3-a5d0-29c084398c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:54.173489 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043b6ee-03f5-4dd3-a5d0-29c084398c55 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:54.174229 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f043b6ee-03f5-4dd3-a5d0-29c084398c55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:54.176211 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f043b6ee-03f5-4dd3-a5d0-29c084398c55 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:54.265510 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 805/1594] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:18:54 2022] POST /identity/v3/users => generated 288 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:18:54.265510 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98571cbc-ebd9-4372-8c6e-a190f5984bc8 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:54.273115 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98571cbc-ebd9-4372-8c6e-a190f5984bc8 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:54.278441 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca0616a-7b4d-4e30-b773-669f8dcbd261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:54.279102 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca0616a-7b4d-4e30-b773-669f8dcbd261 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:54.279386 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca0616a-7b4d-4e30-b773-669f8dcbd261 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:54.279667 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca0616a-7b4d-4e30-b773-669f8dcbd261 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:54.280430 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca0616a-7b4d-4e30-b773-669f8dcbd261 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:54.282076 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca0616a-7b4d-4e30-b773-669f8dcbd261 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:54.291957 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 790/1595] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:18:54 2022] POST /identity/v3/users => generated 293 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:18:54.293797 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f043b6ee-03f5-4dd3-a5d0-29c084398c55 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:54.293965 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 806/1596] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:18:54.294968 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca0616a-7b4d-4e30-b773-669f8dcbd261 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:54.305853 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f043b6ee-03f5-4dd3-a5d0-29c084398c55 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:54.307906 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca0616a-7b4d-4e30-b773-669f8dcbd261 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:54.311652 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b7e2c-3436-428f-a865-a65450413f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:54.312337 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b7e2c-3436-428f-a865-a65450413f12 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:54.312625 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b7e2c-3436-428f-a865-a65450413f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:54.312906 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b7e2c-3436-428f-a865-a65450413f12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:54.313572 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8499b7b3-ee78-46d4-9c05-8dffa88116bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:54.313710 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03b7e2c-3436-428f-a865-a65450413f12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:54.314409 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499b7b3-ee78-46d4-9c05-8dffa88116bb admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:54.314780 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499b7b3-ee78-46d4-9c05-8dffa88116bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:54.315144 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499b7b3-ee78-46d4-9c05-8dffa88116bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:54.315256 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03b7e2c-3436-428f-a865-a65450413f12 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:54.316060 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8499b7b3-ee78-46d4-9c05-8dffa88116bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:54.317862 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8499b7b3-ee78-46d4-9c05-8dffa88116bb admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:54.330690 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 791/1597] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:18:54.330690 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b7e2c-3436-428f-a865-a65450413f12 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:54.330975 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 807/1598] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:18:54.331555 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8499b7b3-ee78-46d4-9c05-8dffa88116bb admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:54.340263 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b7e2c-3436-428f-a865-a65450413f12 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:54.343157 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8499b7b3-ee78-46d4-9c05-8dffa88116bb admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:54.345388 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e20f27-28af-4554-b622-aa4699af8cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:54.346141 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e20f27-28af-4554-b622-aa4699af8cee admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:54.346431 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e20f27-28af-4554-b622-aa4699af8cee admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:54.346717 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e20f27-28af-4554-b622-aa4699af8cee admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:54.347451 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e20f27-28af-4554-b622-aa4699af8cee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:54.348774 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d4baef-67c4-4f83-8d6b-c7f3270da600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:54.349334 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e20f27-28af-4554-b622-aa4699af8cee admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:54.349893 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4baef-67c4-4f83-8d6b-c7f3270da600 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:54.350273 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4baef-67c4-4f83-8d6b-c7f3270da600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:54.350641 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4baef-67c4-4f83-8d6b-c7f3270da600 admin admin] PATH_INFO: `/v3/projects/9244cbe8f30144d984cfc43e3cbb5f4a/users/2637ea3672264d8c85cd8c32c1f38423/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:54.361725 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 792/1599] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:18:54.362540 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e20f27-28af-4554-b622-aa4699af8cee admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:54.371322 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d4baef-67c4-4f83-8d6b-c7f3270da600 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9244cbe8f30144d984cfc43e3cbb5f4a, user_id=2637ea3672264d8c85cd8c32c1f38423, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:54.373621 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e20f27-28af-4554-b622-aa4699af8cee admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:54.375003 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d4baef-67c4-4f83-8d6b-c7f3270da600 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:54.379403 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a71843b-66e9-4fa9-8375-12c0d84b2c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:54.380460 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71843b-66e9-4fa9-8375-12c0d84b2c75 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:54.380835 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71843b-66e9-4fa9-8375-12c0d84b2c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:54.381216 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71843b-66e9-4fa9-8375-12c0d84b2c75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:54.382015 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a71843b-66e9-4fa9-8375-12c0d84b2c75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:54.383746 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a71843b-66e9-4fa9-8375-12c0d84b2c75 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:54.394895 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 793/1600] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:18:54.396476 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a71843b-66e9-4fa9-8375-12c0d84b2c75 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:54.407425 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a71843b-66e9-4fa9-8375-12c0d84b2c75 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:54.412271 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4a110b-457f-4d47-8dce-8c32d9127e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:54.412958 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a110b-457f-4d47-8dce-8c32d9127e06 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:54.413240 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a110b-457f-4d47-8dce-8c32d9127e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:54.413512 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a110b-457f-4d47-8dce-8c32d9127e06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:54.414239 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4a110b-457f-4d47-8dce-8c32d9127e06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:54.416747 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4a110b-457f-4d47-8dce-8c32d9127e06 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:54.427090 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 794/1601] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:18:54.428034 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4a110b-457f-4d47-8dce-8c32d9127e06 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:54.437405 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4a110b-457f-4d47-8dce-8c32d9127e06 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:54.442216 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca9b38d-1d5d-4e12-94e1-805e9603c2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:54.443110 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9b38d-1d5d-4e12-94e1-805e9603c2c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:54.443398 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9b38d-1d5d-4e12-94e1-805e9603c2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:54.443678 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9b38d-1d5d-4e12-94e1-805e9603c2c2 admin admin] PATH_INFO: `/v3/projects/d8e319a149db44fb8bb71f3066c82956/users/e309fb66a98b407d8b7533207e6a6dfc/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:54.459021 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca9b38d-1d5d-4e12-94e1-805e9603c2c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8e319a149db44fb8bb71f3066c82956, user_id=e309fb66a98b407d8b7533207e6a6dfc, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:54.460254 dv-cinder-830094-4-smb devstack@keystone.service[80198]: WARNING py.warnings [None req-0ca9b38d-1d5d-4e12-94e1-805e9603c2c2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 03:18:54.460254 dv-cinder-830094-4-smb devstack@keystone.service[80198]: warnings.warn(msg) May 10 03:18:54.460254 dv-cinder-830094-4-smb devstack@keystone.service[80198]: May 10 03:18:54.462226 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca9b38d-1d5d-4e12-94e1-805e9603c2c2 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:54.506270 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 808/1602] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:18:54 2022] PUT /identity/v3/projects/9244cbe8f30144d984cfc43e3cbb5f4a/users/2637ea3672264d8c85cd8c32c1f38423/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:18:54.507257 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d4baef-67c4-4f83-8d6b-c7f3270da600 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:54.571372 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 795/1603] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:18:54 2022] PUT /identity/v3/projects/d8e319a149db44fb8bb71f3066c82956/users/e309fb66a98b407d8b7533207e6a6dfc/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:18:54.573115 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca9b38d-1d5d-4e12-94e1-805e9603c2c2 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:54.580105 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d4baef-67c4-4f83-8d6b-c7f3270da600 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:54.638825 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca9b38d-1d5d-4e12-94e1-805e9603c2c2 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:54.643638 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0a6f5d-b72f-470b-8a86-8a674a43d2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:54.644559 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a6f5d-b72f-470b-8a86-8a674a43d2c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:54.644890 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a6f5d-b72f-470b-8a86-8a674a43d2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:54.645169 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a6f5d-b72f-470b-8a86-8a674a43d2c7 admin admin] PATH_INFO: `/v3/projects/813036cfbb6e4f1b93bbf75a982aa96f/users/a14e317d371c4f9f994a568798c00e90/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:54.646711 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b34942b-dadc-49f7-8732-8492d3083244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:54.647373 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34942b-dadc-49f7-8732-8492d3083244 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:54.647650 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34942b-dadc-49f7-8732-8492d3083244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:54.647922 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34942b-dadc-49f7-8732-8492d3083244 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:54.648700 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b34942b-dadc-49f7-8732-8492d3083244 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:54.650822 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b34942b-dadc-49f7-8732-8492d3083244 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:54.660830 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0a6f5d-b72f-470b-8a86-8a674a43d2c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=813036cfbb6e4f1b93bbf75a982aa96f, user_id=a14e317d371c4f9f994a568798c00e90, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:54.661275 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 809/1604] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:18:54.662232 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b34942b-dadc-49f7-8732-8492d3083244 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:54.663546 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0a6f5d-b72f-470b-8a86-8a674a43d2c7 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:54.672388 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b34942b-dadc-49f7-8732-8492d3083244 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:54.676939 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c917a5f0-be81-43dd-a0fd-7dbdecdd8a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:54.677833 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917a5f0-be81-43dd-a0fd-7dbdecdd8a91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:54.678113 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917a5f0-be81-43dd-a0fd-7dbdecdd8a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:54.678392 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917a5f0-be81-43dd-a0fd-7dbdecdd8a91 admin admin] PATH_INFO: `/v3/projects/4af328ed59384b70b2312c150a124746/users/9dff947a164641e7b32c639bebbffe36/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:54.692622 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c917a5f0-be81-43dd-a0fd-7dbdecdd8a91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4af328ed59384b70b2312c150a124746, user_id=9dff947a164641e7b32c639bebbffe36, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:54.695330 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c917a5f0-be81-43dd-a0fd-7dbdecdd8a91 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:54.770122 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 796/1605] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:18:54 2022] PUT /identity/v3/projects/813036cfbb6e4f1b93bbf75a982aa96f/users/a14e317d371c4f9f994a568798c00e90/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:18:54.771003 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0a6f5d-b72f-470b-8a86-8a674a43d2c7 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:54.798945 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 810/1606] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:18:54 2022] PUT /identity/v3/projects/4af328ed59384b70b2312c150a124746/users/9dff947a164641e7b32c639bebbffe36/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:18:54.803933 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c917a5f0-be81-43dd-a0fd-7dbdecdd8a91 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:54.845681 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0a6f5d-b72f-470b-8a86-8a674a43d2c7 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:54.866897 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c917a5f0-be81-43dd-a0fd-7dbdecdd8a91 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:54.872623 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc91137-5de6-4a20-9f80-d589142633db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:54.873294 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc91137-5de6-4a20-9f80-d589142633db admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:54.873577 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc91137-5de6-4a20-9f80-d589142633db admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:54.873867 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc91137-5de6-4a20-9f80-d589142633db admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:54.874588 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc91137-5de6-4a20-9f80-d589142633db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:54.876223 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc91137-5de6-4a20-9f80-d589142633db admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:54.886582 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 811/1607] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:18:54.887969 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf24c08-f75b-4145-96dd-1a37c2b2b03d None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:54.888276 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf24c08-f75b-4145-96dd-1a37c2b2b03d None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:54.888555 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf24c08-f75b-4145-96dd-1a37c2b2b03d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:54.905461 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a2a521-c6a3-47b8-ac57-6518fa825bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:54.906284 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2a521-c6a3-47b8-ac57-6518fa825bb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:54.906559 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2a521-c6a3-47b8-ac57-6518fa825bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:54.906829 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2a521-c6a3-47b8-ac57-6518fa825bb7 admin admin] PATH_INFO: `/v3/projects/5b3c27bc5d96416587869ace001f6cf8/users/e79ceedbbbed45448fc9f36906b7d3ff/roles/43105000610f402ca2486e7648018cca` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:54.906958 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-baf24c08-f75b-4145-96dd-1a37c2b2b03d None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:18:54.908420 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-baf24c08-f75b-4145-96dd-1a37c2b2b03d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:18:54.917248 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 812/1608] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:18:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:18:54.918331 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9af8e-40f6-45b1-8e4e-9a7f66c34b1b None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:54.918617 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9af8e-40f6-45b1-8e4e-9a7f66c34b1b None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:54.918905 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9af8e-40f6-45b1-8e4e-9a7f66c34b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:54.924265 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a2a521-c6a3-47b8-ac57-6518fa825bb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b3c27bc5d96416587869ace001f6cf8, user_id=e79ceedbbbed45448fc9f36906b7d3ff, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:54.927356 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a2a521-c6a3-47b8-ac57-6518fa825bb7 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:54.937583 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-69a9af8e-40f6-45b1-8e4e-9a7f66c34b1b None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:18:54.938793 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-69a9af8e-40f6-45b1-8e4e-9a7f66c34b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:18:54.953862 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 813/1609] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:18:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:18:54.954679 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9af8e-40f6-45b1-8e4e-9a7f66c34b1b None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:54.964897 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9af8e-40f6-45b1-8e4e-9a7f66c34b1b None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:54.969513 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7f0cff-25f8-4b66-80cd-3e62a0019df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:54.970372 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f0cff-25f8-4b66-80cd-3e62a0019df8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:54.970647 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f0cff-25f8-4b66-80cd-3e62a0019df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:54.970915 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f0cff-25f8-4b66-80cd-3e62a0019df8 admin admin] PATH_INFO: `/v3/projects/7ce1d1101cc34b40aecd1bae052707a8/users/90f8f0a58bf64bd7af1c132f31a20a58/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:54.986156 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7f0cff-25f8-4b66-80cd-3e62a0019df8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ce1d1101cc34b40aecd1bae052707a8, user_id=90f8f0a58bf64bd7af1c132f31a20a58, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:54.988974 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7f0cff-25f8-4b66-80cd-3e62a0019df8 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:55.009170 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 797/1610] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:18:54 2022] PUT /identity/v3/projects/5b3c27bc5d96416587869ace001f6cf8/users/e79ceedbbbed45448fc9f36906b7d3ff/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:18:55.013394 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e53184-fad6-45bb-bcb8-cd0ff67f1dc7 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:55.013394 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e53184-fad6-45bb-bcb8-cd0ff67f1dc7 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:55.013394 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e53184-fad6-45bb-bcb8-cd0ff67f1dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:55.028080 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-72e53184-fad6-45bb-bcb8-cd0ff67f1dc7 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:18:55.029299 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-72e53184-fad6-45bb-bcb8-cd0ff67f1dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:18:55.088306 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 798/1611] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:18:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:18:55.089690 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748809cf-7cf9-4882-8d3b-cd2a12eb4c4b None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:55.090041 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748809cf-7cf9-4882-8d3b-cd2a12eb4c4b None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:55.090433 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748809cf-7cf9-4882-8d3b-cd2a12eb4c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:55.109116 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-748809cf-7cf9-4882-8d3b-cd2a12eb4c4b None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:18:55.110325 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-748809cf-7cf9-4882-8d3b-cd2a12eb4c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:18:55.121619 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 799/1612] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:18:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:18:55.121619 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748809cf-7cf9-4882-8d3b-cd2a12eb4c4b None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:55.125167 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 814/1613] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:18:54 2022] PUT /identity/v3/projects/7ce1d1101cc34b40aecd1bae052707a8/users/90f8f0a58bf64bd7af1c132f31a20a58/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:18:55.126067 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7f0cff-25f8-4b66-80cd-3e62a0019df8 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:55.139471 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748809cf-7cf9-4882-8d3b-cd2a12eb4c4b None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:55.190987 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7f0cff-25f8-4b66-80cd-3e62a0019df8 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:55.203443 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d1c31-f440-415d-874e-1d316aab3247 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:55.203643 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c64800-142d-475e-993d-431284c39cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:55.204376 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d1c31-f440-415d-874e-1d316aab3247 service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:55.204480 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c64800-142d-475e-993d-431284c39cbe admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:55.204751 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c64800-142d-475e-993d-431284c39cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:55.204858 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d1c31-f440-415d-874e-1d316aab3247 service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:55.205032 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c64800-142d-475e-993d-431284c39cbe admin admin] PATH_INFO: `/v3/projects/0b7c607953b94c02977d60c0b0536e24/users/9407e88fdbd74ba196ffd9fd221e15f5/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:55.205359 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d1c31-f440-415d-874e-1d316aab3247 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:55.216701 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743d1c31-f440-415d-874e-1d316aab3247 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:55.218400 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743d1c31-f440-415d-874e-1d316aab3247 service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:55.220293 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c64800-142d-475e-993d-431284c39cbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b7c607953b94c02977d60c0b0536e24, user_id=9407e88fdbd74ba196ffd9fd221e15f5, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:55.222911 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c64800-142d-475e-993d-431284c39cbe admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:55.229768 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 815/1614] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:18:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:18:55.231685 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d1c31-f440-415d-874e-1d316aab3247 service neutron] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:55.239780 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d1c31-f440-415d-874e-1d316aab3247 service neutron] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:55.249477 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfe9102-1a86-404a-99c5-7cc133d868ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:55.249477 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfe9102-1a86-404a-99c5-7cc133d868ec service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:55.249477 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfe9102-1a86-404a-99c5-7cc133d868ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:55.249477 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfe9102-1a86-404a-99c5-7cc133d868ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:55.254550 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfe9102-1a86-404a-99c5-7cc133d868ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:55.256061 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfe9102-1a86-404a-99c5-7cc133d868ec service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:55.266001 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 816/1615] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:18:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:18:55.266763 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfe9102-1a86-404a-99c5-7cc133d868ec service neutron] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:55.276250 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfe9102-1a86-404a-99c5-7cc133d868ec service neutron] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:55.282032 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b58c61-0851-4afe-a248-c7f09f12d185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:55.282770 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b58c61-0851-4afe-a248-c7f09f12d185 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:55.283051 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b58c61-0851-4afe-a248-c7f09f12d185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:55.283347 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b58c61-0851-4afe-a248-c7f09f12d185 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:55.284193 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b58c61-0851-4afe-a248-c7f09f12d185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:55.285658 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b58c61-0851-4afe-a248-c7f09f12d185 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:55.296843 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 817/1616] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:18:55.297666 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b58c61-0851-4afe-a248-c7f09f12d185 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:55.308449 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 800/1617] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:18:55 2022] PUT /identity/v3/projects/0b7c607953b94c02977d60c0b0536e24/users/9407e88fdbd74ba196ffd9fd221e15f5/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:18:55.309233 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b58c61-0851-4afe-a248-c7f09f12d185 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:55.309722 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c64800-142d-475e-993d-431284c39cbe admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:55.368583 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c64800-142d-475e-993d-431284c39cbe admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:55.370281 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147e531d-fa95-4565-a17c-550562e758ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:55.370985 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e531d-fa95-4565-a17c-550562e758ca service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:55.371327 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e531d-fa95-4565-a17c-550562e758ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:55.371594 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e531d-fa95-4565-a17c-550562e758ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:55.373327 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee3fdf-595d-4876-a820-4fadb8e7f766 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:55.374038 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee3fdf-595d-4876-a820-4fadb8e7f766 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:55.374325 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee3fdf-595d-4876-a820-4fadb8e7f766 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:55.374607 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee3fdf-595d-4876-a820-4fadb8e7f766 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:55.437017 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147e531d-fa95-4565-a17c-550562e758ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:55.438932 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147e531d-fa95-4565-a17c-550562e758ca service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:55.454715 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cee3fdf-595d-4876-a820-4fadb8e7f766 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:55.457087 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cee3fdf-595d-4876-a820-4fadb8e7f766 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:55.457676 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 818/1618] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:18:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:18:55.459125 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd7288-a0f9-425f-9f18-50afc9b7cfcf None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:55.459454 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd7288-a0f9-425f-9f18-50afc9b7cfcf None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:55.459833 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd7288-a0f9-425f-9f18-50afc9b7cfcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:55.469438 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 801/1619] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:18:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:18:55.470314 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee3fdf-595d-4876-a820-4fadb8e7f766 service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:55.480713 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee3fdf-595d-4876-a820-4fadb8e7f766 service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:55.486788 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fae10c-f962-4ecd-a345-77cefdaa960d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:55.487751 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fae10c-f962-4ecd-a345-77cefdaa960d admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:55.488073 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fae10c-f962-4ecd-a345-77cefdaa960d admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:55.488423 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fae10c-f962-4ecd-a345-77cefdaa960d admin admin] PATH_INFO: `/v3/projects/5b3c27bc5d96416587869ace001f6cf8/users/e79ceedbbbed45448fc9f36906b7d3ff/roles/43105000610f402ca2486e7648018cca` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:55.489062 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-3bfd7288-a0f9-425f-9f18-50afc9b7cfcf None None] MFA Rules not processed for user `90f8f0a58bf64bd7af1c132f31a20a58`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:18:55.490399 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-3bfd7288-a0f9-425f-9f18-50afc9b7cfcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:18:55.490543 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fae10c-f962-4ecd-a345-77cefdaa960d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b3c27bc5d96416587869ace001f6cf8, user_id=e79ceedbbbed45448fc9f36906b7d3ff, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:55.493248 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fae10c-f962-4ecd-a345-77cefdaa960d admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:55.513258 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 802/1620] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:18:55 2022] PUT /identity/v3/projects/5b3c27bc5d96416587869ace001f6cf8/users/e79ceedbbbed45448fc9f36906b7d3ff/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:18:55.513258 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abfce83-ff65-4f7b-9dab-49acecb52d60 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:55.513258 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abfce83-ff65-4f7b-9dab-49acecb52d60 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:55.513258 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abfce83-ff65-4f7b-9dab-49acecb52d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:55.532317 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-2abfce83-ff65-4f7b-9dab-49acecb52d60 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:18:55.533588 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-2abfce83-ff65-4f7b-9dab-49acecb52d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:18:55.566735 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 819/1621] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:18:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:18:55.568202 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce90c2-7b51-49da-9c98-cf5921dc9854 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:55.568429 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce90c2-7b51-49da-9c98-cf5921dc9854 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:55.568707 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce90c2-7b51-49da-9c98-cf5921dc9854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:55.597033 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-b7ce90c2-7b51-49da-9c98-cf5921dc9854 None None] MFA Rules not processed for user `e79ceedbbbed45448fc9f36906b7d3ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:18:55.598335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-b7ce90c2-7b51-49da-9c98-cf5921dc9854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:18:55.602256 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 803/1622] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:18:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:18:55.607392 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f53a1e-c374-407b-8a19-d4bee9bc6485 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:55.607688 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f53a1e-c374-407b-8a19-d4bee9bc6485 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:55.607970 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f53a1e-c374-407b-8a19-d4bee9bc6485 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:55.615087 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 804/1623] 10.222.0.65 () {54 vars in 961 bytes} [Tue May 10 03:18:55 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:18:55.616628 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf6a6f-09f4-43c4-9ea2-6bfb19691587 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:55.616925 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf6a6f-09f4-43c4-9ea2-6bfb19691587 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:55.617201 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf6a6f-09f4-43c4-9ea2-6bfb19691587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:55.640035 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-b8bf6a6f-09f4-43c4-9ea2-6bfb19691587 None None] MFA Rules not processed for user `9b7ccdccba0b4f9e86817946f22dbe28`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:18:55.642572 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-b8bf6a6f-09f4-43c4-9ea2-6bfb19691587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:18:55.675715 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 820/1624] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:18:55 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:18:55.676688 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce90c2-7b51-49da-9c98-cf5921dc9854 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:55.684705 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-b7ce90c2-7b51-49da-9c98-cf5921dc9854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:18:55.718008 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 805/1625] 10.222.0.65 () {58 vars in 1058 bytes} [Tue May 10 03:18:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:18:55.719188 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf6a6f-09f4-43c4-9ea2-6bfb19691587 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:55.745417 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce90c2-7b51-49da-9c98-cf5921dc9854 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:55.751193 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e74e1c-12c6-430e-a04c-a25a8fd8b6e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:55.751983 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e74e1c-12c6-430e-a04c-a25a8fd8b6e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:55.753157 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e74e1c-12c6-430e-a04c-a25a8fd8b6e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:55.753548 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e74e1c-12c6-430e-a04c-a25a8fd8b6e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:55.763643 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e74e1c-12c6-430e-a04c-a25a8fd8b6e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:55.765274 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e74e1c-12c6-430e-a04c-a25a8fd8b6e3 service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:55.776449 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 821/1626] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:18:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:18:55.777516 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e74e1c-12c6-430e-a04c-a25a8fd8b6e3 service neutron] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:55.792446 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf6a6f-09f4-43c4-9ea2-6bfb19691587 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:55.794019 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e74e1c-12c6-430e-a04c-a25a8fd8b6e3 service neutron] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:55.801744 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d035d-a1ae-4784-b377-89626d5e1770 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b7ccdccba0b4f9e86817946f22dbe28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:55.802699 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d035d-a1ae-4784-b377-89626d5e1770 service nova] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:55.803133 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d035d-a1ae-4784-b377-89626d5e1770 service nova] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:55.803916 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d035d-a1ae-4784-b377-89626d5e1770 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:55.804079 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d5703-342e-47e7-b4dd-a6dd24b949fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:55.804634 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d5703-342e-47e7-b4dd-a6dd24b949fc service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:55.804926 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d5703-342e-47e7-b4dd-a6dd24b949fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:55.805194 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d5703-342e-47e7-b4dd-a6dd24b949fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:55.826396 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240d5703-342e-47e7-b4dd-a6dd24b949fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:55.827640 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240d5703-342e-47e7-b4dd-a6dd24b949fc service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:55.839127 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 806/1627] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:18:55 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:18:55.875782 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501d035d-a1ae-4784-b377-89626d5e1770 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:55.875782 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501d035d-a1ae-4784-b377-89626d5e1770 service nova] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:55.885458 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 822/1628] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:18:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:18:56.148560 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c1b5c-d4de-4e24-a231-cfdfb31ef925 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:56.148852 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c1b5c-d4de-4e24-a231-cfdfb31ef925 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:56.149133 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c1b5c-d4de-4e24-a231-cfdfb31ef925 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:56.151247 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 807/1629] 10.222.0.65 () {54 vars in 912 bytes} [Tue May 10 03:18:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:18:56.156546 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98864c07-7998-46c8-b7cc-46c2fadbfbad None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:56.157199 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98864c07-7998-46c8-b7cc-46c2fadbfbad None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:56.158123 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98864c07-7998-46c8-b7cc-46c2fadbfbad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:56.178643 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-98864c07-7998-46c8-b7cc-46c2fadbfbad None None] MFA Rules not processed for user `9b7ccdccba0b4f9e86817946f22dbe28`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:18:56.179937 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-98864c07-7998-46c8-b7cc-46c2fadbfbad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:18:56.190016 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 823/1630] 10.222.0.65 () {58 vars in 1009 bytes} [Tue May 10 03:18:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:18:56.208275 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c1b5c-d4de-4e24-a231-cfdfb31ef925 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:56.231575 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c1b5c-d4de-4e24-a231-cfdfb31ef925 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:56.239937 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2358d217-3a84-4ef9-bbac-31459fec383a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:56.240644 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358d217-3a84-4ef9-bbac-31459fec383a service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:56.240931 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358d217-3a84-4ef9-bbac-31459fec383a service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:56.241629 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358d217-3a84-4ef9-bbac-31459fec383a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:56.264077 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2358d217-3a84-4ef9-bbac-31459fec383a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:56.264077 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2358d217-3a84-4ef9-bbac-31459fec383a service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:56.271892 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 808/1631] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:18:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:18:56.737788 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c979628-1f3d-440b-a737-3fc998d4d254 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:56.738155 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c979628-1f3d-440b-a737-3fc998d4d254 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:56.738509 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c979628-1f3d-440b-a737-3fc998d4d254 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:56.740487 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 824/1632] 10.222.0.65 () {54 vars in 961 bytes} [Tue May 10 03:18:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:18:56.746553 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816e1a7-9380-4171-9275-bea65614d11a None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:56.747362 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816e1a7-9380-4171-9275-bea65614d11a None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:56.747773 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816e1a7-9380-4171-9275-bea65614d11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:56.794223 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-4816e1a7-9380-4171-9275-bea65614d11a None None] MFA Rules not processed for user `9b7ccdccba0b4f9e86817946f22dbe28`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:18:56.800731 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-4816e1a7-9380-4171-9275-bea65614d11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:18:56.810386 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 809/1633] 10.222.0.65 () {58 vars in 1058 bytes} [Tue May 10 03:18:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:18:56.815952 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711c611-eeba-4178-ac30-2dfa29d841a8 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:56.816499 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711c611-eeba-4178-ac30-2dfa29d841a8 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:56.816879 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711c611-eeba-4178-ac30-2dfa29d841a8 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:56.818395 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 825/1634] 10.222.0.65 () {54 vars in 912 bytes} [Tue May 10 03:18:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:18:56.851887 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc44c26-d5b9-407f-8e19-b22d7ac1f748 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:56.852212 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc44c26-d5b9-407f-8e19-b22d7ac1f748 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:56.852494 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc44c26-d5b9-407f-8e19-b22d7ac1f748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:56.887346 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-cdc44c26-d5b9-407f-8e19-b22d7ac1f748 None None] MFA Rules not processed for user `9b7ccdccba0b4f9e86817946f22dbe28`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:18:56.888908 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-cdc44c26-d5b9-407f-8e19-b22d7ac1f748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:18:56.900745 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 810/1635] 10.222.0.65 () {58 vars in 1009 bytes} [Tue May 10 03:18:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:18:56.921395 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711c611-eeba-4178-ac30-2dfa29d841a8 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:56.946078 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711c611-eeba-4178-ac30-2dfa29d841a8 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:56.953547 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd41f0a-09ef-44b5-9b75-9f2301c886dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:56.954400 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd41f0a-09ef-44b5-9b75-9f2301c886dc service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:56.954900 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd41f0a-09ef-44b5-9b75-9f2301c886dc service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:56.955566 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd41f0a-09ef-44b5-9b75-9f2301c886dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:56.967986 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd41f0a-09ef-44b5-9b75-9f2301c886dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:56.969441 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd41f0a-09ef-44b5-9b75-9f2301c886dc service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:56.982557 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 826/1636] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:18:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:18:57.599363 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7421efe-025c-4162-bfc9-66dadd4e00a4 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:57.599721 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7421efe-025c-4162-bfc9-66dadd4e00a4 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:57.599970 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7421efe-025c-4162-bfc9-66dadd4e00a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:57.653105 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-f7421efe-025c-4162-bfc9-66dadd4e00a4 None None] MFA Rules not processed for user `2637ea3672264d8c85cd8c32c1f38423`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:18:57.655255 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-f7421efe-025c-4162-bfc9-66dadd4e00a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:18:57.749579 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 811/1637] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:18:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:18:57.765162 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a22bc52-e772-4460-b0fb-808af2e559f1 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:57.765434 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a22bc52-e772-4460-b0fb-808af2e559f1 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:57.765709 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a22bc52-e772-4460-b0fb-808af2e559f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:57.778412 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7421efe-025c-4162-bfc9-66dadd4e00a4 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:57.791472 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-3a22bc52-e772-4460-b0fb-808af2e559f1 None None] MFA Rules not processed for user `2637ea3672264d8c85cd8c32c1f38423`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:18:57.793052 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-3a22bc52-e772-4460-b0fb-808af2e559f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:18:57.797936 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7421efe-025c-4162-bfc9-66dadd4e00a4 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:57.806600 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 827/1638] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:18:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:18:57.811843 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8238cc-3afd-4a52-89df-ac36486fb0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:57.815644 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a22bc52-e772-4460-b0fb-808af2e559f1 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:57.817557 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8238cc-3afd-4a52-89df-ac36486fb0ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:57.818385 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8238cc-3afd-4a52-89df-ac36486fb0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:57.819453 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8238cc-3afd-4a52-89df-ac36486fb0ee admin admin] PATH_INFO: `/v3/users/2b48a79dad444a76b72424de6f57b166` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:57.822993 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8238cc-3afd-4a52-89df-ac36486fb0ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b48a79dad444a76b72424de6f57b166)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:57.828331 dv-cinder-830094-4-smb devstack@keystone.service[80198]: WARNING py.warnings [None req-8e8238cc-3afd-4a52-89df-ac36486fb0ee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 03:18:57.828331 dv-cinder-830094-4-smb devstack@keystone.service[80198]: warnings.warn(msg) May 10 03:18:57.828331 dv-cinder-830094-4-smb devstack@keystone.service[80198]: May 10 03:18:57.829641 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8238cc-3afd-4a52-89df-ac36486fb0ee admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:57.835482 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a22bc52-e772-4460-b0fb-808af2e559f1 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:57.843436 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbe9867-90eb-460c-b3b8-069fac1d7bff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b7ccdccba0b4f9e86817946f22dbe28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:57.844241 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe9867-90eb-460c-b3b8-069fac1d7bff service nova] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:57.844597 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe9867-90eb-460c-b3b8-069fac1d7bff service nova] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:57.844948 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe9867-90eb-460c-b3b8-069fac1d7bff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:57.854107 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbe9867-90eb-460c-b3b8-069fac1d7bff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:57.856151 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbe9867-90eb-460c-b3b8-069fac1d7bff service nova] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:57.868290 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 828/1639] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:18:57 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:18:58.130215 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8e8238cc-3afd-4a52-89df-ac36486fb0ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b48a79dad444a76b72424de6f57b166'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:18:58.130986 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8e8238cc-3afd-4a52-89df-ac36486fb0ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b48a79dad444a76b72424de6f57b166'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:18:58.144156 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8e8238cc-3afd-4a52-89df-ac36486fb0ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b48a79dad444a76b72424de6f57b166'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:18:58.279316 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8e8238cc-3afd-4a52-89df-ac36486fb0ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b48a79dad444a76b72424de6f57b166'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:18:58.279316 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8e8238cc-3afd-4a52-89df-ac36486fb0ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b48a79dad444a76b72424de6f57b166'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:18:58.329407 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 812/1640] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:18:57 2022] DELETE /identity/v3/users/2b48a79dad444a76b72424de6f57b166 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:18:58.335274 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3216ca-1b74-4cc9-a833-4a48b45a5581 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:58.335950 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3216ca-1b74-4cc9-a833-4a48b45a5581 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:58.336933 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3216ca-1b74-4cc9-a833-4a48b45a5581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:58.366317 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-ca3216ca-1b74-4cc9-a833-4a48b45a5581 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:18:58.367874 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-ca3216ca-1b74-4cc9-a833-4a48b45a5581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:18:58.478073 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 829/1641] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:18:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:18:58.495575 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8238cc-3afd-4a52-89df-ac36486fb0ee admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:58.505235 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-8e8238cc-3afd-4a52-89df-ac36486fb0ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:18:58.593001 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8238cc-3afd-4a52-89df-ac36486fb0ee admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:58.602325 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8115eaed-cc89-4ac7-bd4b-06248f347079 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:58.602761 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115eaed-cc89-4ac7-bd4b-06248f347079 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:58.603591 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115eaed-cc89-4ac7-bd4b-06248f347079 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:58.603873 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115eaed-cc89-4ac7-bd4b-06248f347079 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:58.624558 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8115eaed-cc89-4ac7-bd4b-06248f347079 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:58.627349 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8115eaed-cc89-4ac7-bd4b-06248f347079 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:58.641341 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 813/1642] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:18:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:18:58.822049 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d7c79-2479-4c01-a422-6cc08936378e None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:58.822543 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d7c79-2479-4c01-a422-6cc08936378e None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:58.822989 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d7c79-2479-4c01-a422-6cc08936378e None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:58.824836 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 830/1643] 10.222.0.65 () {54 vars in 912 bytes} [Tue May 10 03:18:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:18:58.836308 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f9593-e39f-414a-828c-bad67a61967b None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:58.836308 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f9593-e39f-414a-828c-bad67a61967b None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:58.836914 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f9593-e39f-414a-828c-bad67a61967b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:58.908562 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-4b0f9593-e39f-414a-828c-bad67a61967b None None] MFA Rules not processed for user `ccfba74826234915bc989fede9bde3e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:18:58.910287 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-4b0f9593-e39f-414a-828c-bad67a61967b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:18:58.928625 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 814/1644] 10.222.0.65 () {58 vars in 1009 bytes} [Tue May 10 03:18:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:18:58.977869 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d7c79-2479-4c01-a422-6cc08936378e None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:18:58.981794 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-d32d7c79-2479-4c01-a422-6cc08936378e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:18:58.998940 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d7c79-2479-4c01-a422-6cc08936378e None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:18:59.004458 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c209295-56f9-4bf1-a240-4f375cd2527b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:18:59.005421 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c209295-56f9-4bf1-a240-4f375cd2527b service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:18:59.005868 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c209295-56f9-4bf1-a240-4f375cd2527b service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:18:59.006294 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c209295-56f9-4bf1-a240-4f375cd2527b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:18:59.016402 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c209295-56f9-4bf1-a240-4f375cd2527b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:18:59.018986 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c209295-56f9-4bf1-a240-4f375cd2527b service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:18:59.034673 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 831/1645] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:18:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:19:00.123909 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095779a5-0ab5-4a41-82c3-dd510dbdb870 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:00.123909 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095779a5-0ab5-4a41-82c3-dd510dbdb870 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:00.123909 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095779a5-0ab5-4a41-82c3-dd510dbdb870 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:00.123909 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 815/1646] 10.222.0.65 () {54 vars in 960 bytes} [Tue May 10 03:18:59 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:19:00.132136 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88c982-48fa-4122-889d-997d070d3d9a None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:00.132136 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88c982-48fa-4122-889d-997d070d3d9a None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:00.132136 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88c982-48fa-4122-889d-997d070d3d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:00.153389 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095779a5-0ab5-4a41-82c3-dd510dbdb870 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:00.153389 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-095779a5-0ab5-4a41-82c3-dd510dbdb870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:00.154394 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-8d88c982-48fa-4122-889d-997d070d3d9a None None] MFA Rules not processed for user `f646147bdad8476ba0ab9da5d9c50b55`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:00.154394 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-8d88c982-48fa-4122-889d-997d070d3d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:00.155171 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095779a5-0ab5-4a41-82c3-dd510dbdb870 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:00.155171 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3a5f03-4de1-40b1-b5d2-577c63fcda02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:00.155171 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a5f03-4de1-40b1-b5d2-577c63fcda02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:00.155171 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a5f03-4de1-40b1-b5d2-577c63fcda02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:00.156470 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a5f03-4de1-40b1-b5d2-577c63fcda02 admin admin] PATH_INFO: `/v3/projects/35ca140de3264740a72971dd222962c7` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:00.156470 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3a5f03-4de1-40b1-b5d2-577c63fcda02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35ca140de3264740a72971dd222962c7)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:00.156470 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3a5f03-4de1-40b1-b5d2-577c63fcda02 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:00.207688 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 832/1647] 10.222.0.65 () {58 vars in 1057 bytes} [Tue May 10 03:19:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:19:00.216806 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88c982-48fa-4122-889d-997d070d3d9a None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:00.227672 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88c982-48fa-4122-889d-997d070d3d9a None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:00.235401 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0325cfd-c114-4458-bf2d-2bd59ebc2e76 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f646147bdad8476ba0ab9da5d9c50b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:00.236853 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0325cfd-c114-4458-bf2d-2bd59ebc2e76 service placement] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:00.237491 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0325cfd-c114-4458-bf2d-2bd59ebc2e76 service placement] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:00.237959 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0325cfd-c114-4458-bf2d-2bd59ebc2e76 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:00.240332 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-b0325cfd-c114-4458-bf2d-2bd59ebc2e76 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:00.260712 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0325cfd-c114-4458-bf2d-2bd59ebc2e76 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:00.262995 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0325cfd-c114-4458-bf2d-2bd59ebc2e76 service placement] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:00.279557 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-ca3a5f03-4de1-40b1-b5d2-577c63fcda02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35ca140de3264740a72971dd222962c7', 'request_id': 'req-ca3a5f03-4de1-40b1-b5d2-577c63fcda02'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:00.285546 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 833/1648] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:19:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:19:00.295752 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-ca3a5f03-4de1-40b1-b5d2-577c63fcda02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35ca140de3264740a72971dd222962c7', 'request_id': 'req-ca3a5f03-4de1-40b1-b5d2-577c63fcda02'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:00.307749 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-ca3a5f03-4de1-40b1-b5d2-577c63fcda02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35ca140de3264740a72971dd222962c7', 'request_id': 'req-ca3a5f03-4de1-40b1-b5d2-577c63fcda02'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:00.422739 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-ca3a5f03-4de1-40b1-b5d2-577c63fcda02 admin admin] The token cache is being invalidate because project 35ca140de3264740a72971dd222962c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:19:00.423121 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-ca3a5f03-4de1-40b1-b5d2-577c63fcda02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:00.424199 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-ca3a5f03-4de1-40b1-b5d2-577c63fcda02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:00.430088 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 816/1649] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:19:00 2022] DELETE /identity/v3/projects/35ca140de3264740a72971dd222962c7 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:19:00.434250 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0325cfd-c114-4458-bf2d-2bd59ebc2e76 service placement] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:00.464884 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0325cfd-c114-4458-bf2d-2bd59ebc2e76 service placement] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:00.588421 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97996e1-3f53-4851-97cb-1666138fa92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:00.589930 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97996e1-3f53-4851-97cb-1666138fa92f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:00.589930 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97996e1-3f53-4851-97cb-1666138fa92f admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:00.589930 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97996e1-3f53-4851-97cb-1666138fa92f admin admin] PATH_INFO: `/v3/users/e79ceedbbbed45448fc9f36906b7d3ff` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:00.595495 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97996e1-3f53-4851-97cb-1666138fa92f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e79ceedbbbed45448fc9f36906b7d3ff)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:00.598771 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97996e1-3f53-4851-97cb-1666138fa92f admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:00.861005 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-d97996e1-3f53-4851-97cb-1666138fa92f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e79ceedbbbed45448fc9f36906b7d3ff'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:00.877660 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-d97996e1-3f53-4851-97cb-1666138fa92f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e79ceedbbbed45448fc9f36906b7d3ff'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:00.916479 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-d97996e1-3f53-4851-97cb-1666138fa92f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e79ceedbbbed45448fc9f36906b7d3ff'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:00.916479 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-d97996e1-3f53-4851-97cb-1666138fa92f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e79ceedbbbed45448fc9f36906b7d3ff'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:00.917225 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-d97996e1-3f53-4851-97cb-1666138fa92f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e79ceedbbbed45448fc9f36906b7d3ff'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:01.045645 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 834/1650] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:19:00 2022] DELETE /identity/v3/users/e79ceedbbbed45448fc9f36906b7d3ff => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:19:02.565384 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3a5f03-4de1-40b1-b5d2-577c63fcda02 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:02.567778 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-ca3a5f03-4de1-40b1-b5d2-577c63fcda02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:02.589948 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3a5f03-4de1-40b1-b5d2-577c63fcda02 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:02.767145 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be832f2e-040a-4208-9e42-bd99076c48b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:02.771666 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be832f2e-040a-4208-9e42-bd99076c48b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:02.771959 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be832f2e-040a-4208-9e42-bd99076c48b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:02.772263 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be832f2e-040a-4208-9e42-bd99076c48b3 admin admin] PATH_INFO: `/v3/projects/5b3c27bc5d96416587869ace001f6cf8` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:02.774146 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be832f2e-040a-4208-9e42-bd99076c48b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b3c27bc5d96416587869ace001f6cf8)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:02.779365 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be832f2e-040a-4208-9e42-bd99076c48b3 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:02.973261 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-be832f2e-040a-4208-9e42-bd99076c48b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b3c27bc5d96416587869ace001f6cf8', 'request_id': 'req-be832f2e-040a-4208-9e42-bd99076c48b3'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:02.982869 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-be832f2e-040a-4208-9e42-bd99076c48b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b3c27bc5d96416587869ace001f6cf8', 'request_id': 'req-be832f2e-040a-4208-9e42-bd99076c48b3'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:03.004586 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-be832f2e-040a-4208-9e42-bd99076c48b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b3c27bc5d96416587869ace001f6cf8', 'request_id': 'req-be832f2e-040a-4208-9e42-bd99076c48b3'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:03.124917 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-be832f2e-040a-4208-9e42-bd99076c48b3 admin admin] The token cache is being invalidate because project 5b3c27bc5d96416587869ace001f6cf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:19:03.125272 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-be832f2e-040a-4208-9e42-bd99076c48b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:03.126153 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-be832f2e-040a-4208-9e42-bd99076c48b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:03.158934 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 817/1651] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:19:02 2022] DELETE /identity/v3/projects/5b3c27bc5d96416587869ace001f6cf8 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:19:03.165945 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e37627-b8c4-4334-ab15-57c2ed087d84 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:03.167219 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e37627-b8c4-4334-ab15-57c2ed087d84 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:03.167754 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e37627-b8c4-4334-ab15-57c2ed087d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:03.233865 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-65e37627-b8c4-4334-ab15-57c2ed087d84 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:03.235633 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-65e37627-b8c4-4334-ab15-57c2ed087d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:03.531473 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c450f5b-fa8e-433d-82f7-94da6d0ebc9f None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:03.531778 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 835/1652] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:19:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:19:03.532070 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c450f5b-fa8e-433d-82f7-94da6d0ebc9f None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:03.532355 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c450f5b-fa8e-433d-82f7-94da6d0ebc9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:03.593944 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-4c450f5b-fa8e-433d-82f7-94da6d0ebc9f None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:03.595221 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-4c450f5b-fa8e-433d-82f7-94da6d0ebc9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:03.625832 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e37627-b8c4-4334-ab15-57c2ed087d84 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:03.626264 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-65e37627-b8c4-4334-ab15-57c2ed087d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:03.647594 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 818/1653] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:19:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:19:03.652414 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c450f5b-fa8e-433d-82f7-94da6d0ebc9f None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:03.654610 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e37627-b8c4-4334-ab15-57c2ed087d84 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:03.671726 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d3b7e8-6b63-454f-ab43-52ddc5c8f040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:03.672929 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c450f5b-fa8e-433d-82f7-94da6d0ebc9f None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:03.673049 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d3b7e8-6b63-454f-ab43-52ddc5c8f040 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:03.673854 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d3b7e8-6b63-454f-ab43-52ddc5c8f040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:03.675121 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d3b7e8-6b63-454f-ab43-52ddc5c8f040 admin admin] PATH_INFO: `/v3/users/90f8f0a58bf64bd7af1c132f31a20a58` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:03.678093 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce79942-83a3-455b-8d11-69c15dfd340b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:03.678236 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d3b7e8-6b63-454f-ab43-52ddc5c8f040 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90f8f0a58bf64bd7af1c132f31a20a58)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:03.679157 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce79942-83a3-455b-8d11-69c15dfd340b admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:03.679650 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce79942-83a3-455b-8d11-69c15dfd340b admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:03.680169 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce79942-83a3-455b-8d11-69c15dfd340b admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:03.686184 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d3b7e8-6b63-454f-ab43-52ddc5c8f040 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:03.689132 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce79942-83a3-455b-8d11-69c15dfd340b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:19:03.689584 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce79942-83a3-455b-8d11-69c15dfd340b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:03.691504 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce79942-83a3-455b-8d11-69c15dfd340b admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:03.714566 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 819/1654] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 10 03:19:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:19:03.730376 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce79942-83a3-455b-8d11-69c15dfd340b admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:03.754308 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce79942-83a3-455b-8d11-69c15dfd340b admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:03.768354 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3a9c58-8aea-40f8-9a84-30b436de0fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:03.769259 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a9c58-8aea-40f8-9a84-30b436de0fe2 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:03.769684 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a9c58-8aea-40f8-9a84-30b436de0fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:03.770139 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a9c58-8aea-40f8-9a84-30b436de0fe2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:03.771010 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3a9c58-8aea-40f8-9a84-30b436de0fe2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:03.773245 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3a9c58-8aea-40f8-9a84-30b436de0fe2 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:03.983800 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 820/1655] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:19:03 2022] POST /identity/v3/projects => generated 365 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:19:03.985390 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3a9c58-8aea-40f8-9a84-30b436de0fe2 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:03.997226 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-25d3b7e8-6b63-454f-ab43-52ddc5c8f040 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90f8f0a58bf64bd7af1c132f31a20a58'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:04.010875 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-25d3b7e8-6b63-454f-ab43-52ddc5c8f040 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90f8f0a58bf64bd7af1c132f31a20a58'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:04.041545 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-25d3b7e8-6b63-454f-ab43-52ddc5c8f040 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90f8f0a58bf64bd7af1c132f31a20a58'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:04.042975 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-25d3b7e8-6b63-454f-ab43-52ddc5c8f040 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90f8f0a58bf64bd7af1c132f31a20a58'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:04.044355 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-25d3b7e8-6b63-454f-ab43-52ddc5c8f040 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90f8f0a58bf64bd7af1c132f31a20a58'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:04.135845 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 836/1656] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:19:03 2022] DELETE /identity/v3/users/90f8f0a58bf64bd7af1c132f31a20a58 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:19:04.137542 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a663d5-ab25-45c4-a671-2a2144477865 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:04.137973 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a663d5-ab25-45c4-a671-2a2144477865 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:04.138412 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a663d5-ab25-45c4-a671-2a2144477865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:04.155183 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3a9c58-8aea-40f8-9a84-30b436de0fe2 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:04.193246 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-c8a663d5-ab25-45c4-a671-2a2144477865 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:04.194496 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-c8a663d5-ab25-45c4-a671-2a2144477865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:04.336902 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1505f9e-9ba9-459b-93d8-0f9cf3829010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:04.338247 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1505f9e-9ba9-459b-93d8-0f9cf3829010 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:04.338545 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1505f9e-9ba9-459b-93d8-0f9cf3829010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:04.339269 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1505f9e-9ba9-459b-93d8-0f9cf3829010 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:04.339525 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1505f9e-9ba9-459b-93d8-0f9cf3829010 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:04.347677 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1505f9e-9ba9-459b-93d8-0f9cf3829010 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:04.371499 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 837/1657] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:19:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:19:04.428964 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a663d5-ab25-45c4-a671-2a2144477865 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:04.430731 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-c8a663d5-ab25-45c4-a671-2a2144477865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:04.472022 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 821/1658] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:19:03 2022] POST /identity/v3/users => generated 283 bytes in 488 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:19:04.473879 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1505f9e-9ba9-459b-93d8-0f9cf3829010 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:04.482133 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-f1505f9e-9ba9-459b-93d8-0f9cf3829010 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:04.522938 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1505f9e-9ba9-459b-93d8-0f9cf3829010 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:04.540195 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0408b62b-82e7-4e56-a878-03580e17c367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:04.545160 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408b62b-82e7-4e56-a878-03580e17c367 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:04.545474 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408b62b-82e7-4e56-a878-03580e17c367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:04.545760 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408b62b-82e7-4e56-a878-03580e17c367 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:04.547892 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0408b62b-82e7-4e56-a878-03580e17c367 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:04.561708 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0408b62b-82e7-4e56-a878-03580e17c367 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:04.578229 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a663d5-ab25-45c4-a671-2a2144477865 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:04.586081 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ff513-1c0e-4ec7-a7b0-55bd05fc6985 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:04.586810 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ff513-1c0e-4ec7-a7b0-55bd05fc6985 service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:04.587122 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ff513-1c0e-4ec7-a7b0-55bd05fc6985 service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:04.587405 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ff513-1c0e-4ec7-a7b0-55bd05fc6985 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:04.594125 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 822/1659] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:19:04 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:19:04.598546 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0408b62b-82e7-4e56-a878-03580e17c367 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:04.625324 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98ff513-1c0e-4ec7-a7b0-55bd05fc6985 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:04.626822 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98ff513-1c0e-4ec7-a7b0-55bd05fc6985 service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:04.641033 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0408b62b-82e7-4e56-a878-03580e17c367 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:04.647271 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 838/1660] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:19:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:19:04.655638 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23219ba-941a-4d2a-b914-255b60f72514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:04.656547 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23219ba-941a-4d2a-b914-255b60f72514 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:04.657758 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23219ba-941a-4d2a-b914-255b60f72514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:04.658873 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23219ba-941a-4d2a-b914-255b60f72514 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:04.660557 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23219ba-941a-4d2a-b914-255b60f72514 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:04.668570 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23219ba-941a-4d2a-b914-255b60f72514 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:04.708451 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 823/1661] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:19:04 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:19:04.715693 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ff513-1c0e-4ec7-a7b0-55bd05fc6985 service neutron] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:04.725750 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ff513-1c0e-4ec7-a7b0-55bd05fc6985 service neutron] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:04.749698 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e53c32-80a5-414e-82c0-21540dc2024d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:04.750911 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e53c32-80a5-414e-82c0-21540dc2024d admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:04.751383 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e53c32-80a5-414e-82c0-21540dc2024d admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:04.751845 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e53c32-80a5-414e-82c0-21540dc2024d admin admin] PATH_INFO: `/v3/projects/ae801ca20a8249f2b505c3e9e07a4ffc/users/fe5d7c0a27784430a2938a35d74a2839/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:04.773862 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e53c32-80a5-414e-82c0-21540dc2024d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae801ca20a8249f2b505c3e9e07a4ffc, user_id=fe5d7c0a27784430a2938a35d74a2839, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:04.782589 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e53c32-80a5-414e-82c0-21540dc2024d admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:04.882986 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 839/1662] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:19:04 2022] PUT /identity/v3/projects/ae801ca20a8249f2b505c3e9e07a4ffc/users/fe5d7c0a27784430a2938a35d74a2839/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:19:04.894134 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508a898-96ca-46ce-a2a6-ca7fe199ee2c None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:04.894468 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508a898-96ca-46ce-a2a6-ca7fe199ee2c None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:04.894752 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508a898-96ca-46ce-a2a6-ca7fe199ee2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:04.978937 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-d508a898-96ca-46ce-a2a6-ca7fe199ee2c None None] MFA Rules not processed for user `fe5d7c0a27784430a2938a35d74a2839`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:04.982403 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-d508a898-96ca-46ce-a2a6-ca7fe199ee2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:05.169426 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 824/1663] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:19:04 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:19:05.172760 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e53c32-80a5-414e-82c0-21540dc2024d admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:05.258752 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e53c32-80a5-414e-82c0-21540dc2024d admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:05.265579 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d9610d-7b7d-47a2-a6de-ea6b43a549b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:05.266880 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9610d-7b7d-47a2-a6de-ea6b43a549b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:05.277334 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9610d-7b7d-47a2-a6de-ea6b43a549b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:05.281261 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9610d-7b7d-47a2-a6de-ea6b43a549b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:05.281261 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d9610d-7b7d-47a2-a6de-ea6b43a549b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:05.281261 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d9610d-7b7d-47a2-a6de-ea6b43a549b8 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:05.407498 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 840/1664] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:19:05 2022] POST /identity/v3/projects => generated 365 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:19:05.407797 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d508a898-96ca-46ce-a2a6-ca7fe199ee2c None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:05.423667 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d508a898-96ca-46ce-a2a6-ca7fe199ee2c None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:05.612333 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791ddea6-1f04-40ea-bc9c-96bff472fd5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:05.615725 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ddea6-1f04-40ea-bc9c-96bff472fd5f admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:05.616301 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ddea6-1f04-40ea-bc9c-96bff472fd5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:05.616923 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ddea6-1f04-40ea-bc9c-96bff472fd5f admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:05.631556 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791ddea6-1f04-40ea-bc9c-96bff472fd5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:05.633877 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791ddea6-1f04-40ea-bc9c-96bff472fd5f admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:05.701378 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1cba5-e42f-46b1-800d-367e18b8e64d None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:05.702021 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1cba5-e42f-46b1-800d-367e18b8e64d None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:05.703019 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1cba5-e42f-46b1-800d-367e18b8e64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:05.735593 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 825/1665] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:19:05 2022] POST /identity/v3/users => generated 289 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:19:05.737024 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791ddea6-1f04-40ea-bc9c-96bff472fd5f admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:05.778618 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-03e1cba5-e42f-46b1-800d-367e18b8e64d None None] MFA Rules not processed for user `6ebfab3ff0b24f4aaabb8c6bb0ad10c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:05.781535 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791ddea6-1f04-40ea-bc9c-96bff472fd5f admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:05.783726 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-03e1cba5-e42f-46b1-800d-367e18b8e64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:05.802092 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ab8903-c8ca-4f57-a4c8-f0a3e80ef530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:05.802726 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab8903-c8ca-4f57-a4c8-f0a3e80ef530 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:05.808265 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab8903-c8ca-4f57-a4c8-f0a3e80ef530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:05.808636 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab8903-c8ca-4f57-a4c8-f0a3e80ef530 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:05.809445 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ab8903-c8ca-4f57-a4c8-f0a3e80ef530 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:05.811102 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ab8903-c8ca-4f57-a4c8-f0a3e80ef530 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:05.857955 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 826/1666] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:19:05.866041 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ab8903-c8ca-4f57-a4c8-f0a3e80ef530 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:05.895928 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ab8903-c8ca-4f57-a4c8-f0a3e80ef530 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:05.906984 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2539982b-1a6b-4218-84c2-c49f5b83f1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:05.910655 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2539982b-1a6b-4218-84c2-c49f5b83f1d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:05.910961 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2539982b-1a6b-4218-84c2-c49f5b83f1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:05.912478 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2539982b-1a6b-4218-84c2-c49f5b83f1d1 admin admin] PATH_INFO: `/v3/projects/eab985b4f7474f449b0ae0634bcf3b18/users/fc00b2e995bf4615af5d5d7e4a759155/roles/43105000610f402ca2486e7648018cca` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:05.934038 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 841/1667] 10.222.0.65 () {58 vars in 1009 bytes} [Tue May 10 03:19:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:19:05.970414 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2539982b-1a6b-4218-84c2-c49f5b83f1d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eab985b4f7474f449b0ae0634bcf3b18, user_id=fc00b2e995bf4615af5d5d7e4a759155, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:05.970414 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2539982b-1a6b-4218-84c2-c49f5b83f1d1 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:06.088439 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 827/1668] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:19:05 2022] PUT /identity/v3/projects/eab985b4f7474f449b0ae0634bcf3b18/users/fc00b2e995bf4615af5d5d7e4a759155/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:19:06.091657 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1cba5-e42f-46b1-800d-367e18b8e64d None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:06.110787 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1cba5-e42f-46b1-800d-367e18b8e64d None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:06.230647 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803192ea-5069-4ddc-b091-4363b4e9037f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:06.231563 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803192ea-5069-4ddc-b091-4363b4e9037f admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:06.231996 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803192ea-5069-4ddc-b091-4363b4e9037f admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:06.232465 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803192ea-5069-4ddc-b091-4363b4e9037f admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:06.233418 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803192ea-5069-4ddc-b091-4363b4e9037f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:06.235451 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803192ea-5069-4ddc-b091-4363b4e9037f admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:06.249521 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 842/1669] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:19:06.253860 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2539982b-1a6b-4218-84c2-c49f5b83f1d1 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:06.265786 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2539982b-1a6b-4218-84c2-c49f5b83f1d1 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:06.273531 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e07db-06ba-4b98-aa38-95ec07599436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:06.275125 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e07db-06ba-4b98-aa38-95ec07599436 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:06.275413 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e07db-06ba-4b98-aa38-95ec07599436 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:06.275693 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e07db-06ba-4b98-aa38-95ec07599436 admin admin] PATH_INFO: `/v3/projects/eab985b4f7474f449b0ae0634bcf3b18/users/fc00b2e995bf4615af5d5d7e4a759155/roles/43105000610f402ca2486e7648018cca` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:06.281882 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3e07db-06ba-4b98-aa38-95ec07599436 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eab985b4f7474f449b0ae0634bcf3b18, user_id=fc00b2e995bf4615af5d5d7e4a759155, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:06.285719 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3e07db-06ba-4b98-aa38-95ec07599436 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:06.310973 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 828/1670] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:19:06 2022] PUT /identity/v3/projects/eab985b4f7474f449b0ae0634bcf3b18/users/fc00b2e995bf4615af5d5d7e4a759155/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:19:06.323032 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38c4cb-9349-47eb-870f-3bb292cc17dc None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:06.323591 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38c4cb-9349-47eb-870f-3bb292cc17dc None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:06.323591 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38c4cb-9349-47eb-870f-3bb292cc17dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:06.385744 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-2a38c4cb-9349-47eb-870f-3bb292cc17dc None None] MFA Rules not processed for user `fc00b2e995bf4615af5d5d7e4a759155`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:06.385744 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-2a38c4cb-9349-47eb-870f-3bb292cc17dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:06.458173 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e07db-06ba-4b98-aa38-95ec07599436 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:06.460061 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-3e3e07db-06ba-4b98-aa38-95ec07599436 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:06.546643 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 843/1671] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:19:06 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:19:06.558310 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38c4cb-9349-47eb-870f-3bb292cc17dc None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:06.559661 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-2a38c4cb-9349-47eb-870f-3bb292cc17dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:06.655719 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e07db-06ba-4b98-aa38-95ec07599436 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:06.666593 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a347435-d78d-445f-9626-ffa86839e97e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1cb8ad43a234233ad602f451f0f8ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:06.668142 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a347435-d78d-445f-9626-ffa86839e97e service swift] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:06.668465 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a347435-d78d-445f-9626-ffa86839e97e service swift] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:06.668585 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38c4cb-9349-47eb-870f-3bb292cc17dc None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:06.668744 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a347435-d78d-445f-9626-ffa86839e97e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:06.677524 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881f01c-ab03-4f47-aa9f-8434bf6f1e51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:06.678212 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881f01c-ab03-4f47-aa9f-8434bf6f1e51 service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:06.678495 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881f01c-ab03-4f47-aa9f-8434bf6f1e51 service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:06.678767 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881f01c-ab03-4f47-aa9f-8434bf6f1e51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:06.699209 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3881f01c-ab03-4f47-aa9f-8434bf6f1e51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:06.701180 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3881f01c-ab03-4f47-aa9f-8434bf6f1e51 service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:06.736924 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 844/1672] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:19:06 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:19:06.737888 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881f01c-ab03-4f47-aa9f-8434bf6f1e51 service cinder] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:06.740967 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-3881f01c-ab03-4f47-aa9f-8434bf6f1e51 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:06.813558 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a347435-d78d-445f-9626-ffa86839e97e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:06.815111 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a347435-d78d-445f-9626-ffa86839e97e service swift] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:06.848666 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 829/1673] 10.222.0.65 () {60 vars in 1384 bytes} [Tue May 10 03:19:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 03:19:06.921742 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881f01c-ab03-4f47-aa9f-8434bf6f1e51 service cinder] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:06.948892 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f957f-4e3b-434d-ab54-e3f5f2dee9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:06.949831 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f957f-4e3b-434d-ab54-e3f5f2dee9d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:06.950188 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f957f-4e3b-434d-ab54-e3f5f2dee9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:06.950505 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f957f-4e3b-434d-ab54-e3f5f2dee9d6 admin admin] PATH_INFO: `/v3/projects/7ce1d1101cc34b40aecd1bae052707a8` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:06.952021 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9f957f-4e3b-434d-ab54-e3f5f2dee9d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ce1d1101cc34b40aecd1bae052707a8)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:06.953047 dv-cinder-830094-4-smb devstack@keystone.service[80197]: WARNING py.warnings [None req-8d9f957f-4e3b-434d-ab54-e3f5f2dee9d6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 03:19:06.953047 dv-cinder-830094-4-smb devstack@keystone.service[80197]: warnings.warn(msg) May 10 03:19:06.953047 dv-cinder-830094-4-smb devstack@keystone.service[80197]: May 10 03:19:06.954242 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9f957f-4e3b-434d-ab54-e3f5f2dee9d6 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:07.075657 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a347435-d78d-445f-9626-ffa86839e97e service swift] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:07.090035 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a347435-d78d-445f-9626-ffa86839e97e service swift] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:07.100989 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e32a616-bc4b-487b-ad3e-a95d3f6716f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:07.104392 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32a616-bc4b-487b-ad3e-a95d3f6716f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:07.104675 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32a616-bc4b-487b-ad3e-a95d3f6716f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:07.104953 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32a616-bc4b-487b-ad3e-a95d3f6716f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:07.220846 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-8d9f957f-4e3b-434d-ab54-e3f5f2dee9d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ce1d1101cc34b40aecd1bae052707a8', 'request_id': 'req-8d9f957f-4e3b-434d-ab54-e3f5f2dee9d6'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:07.244393 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-8d9f957f-4e3b-434d-ab54-e3f5f2dee9d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ce1d1101cc34b40aecd1bae052707a8', 'request_id': 'req-8d9f957f-4e3b-434d-ab54-e3f5f2dee9d6'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:07.282055 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-8d9f957f-4e3b-434d-ab54-e3f5f2dee9d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ce1d1101cc34b40aecd1bae052707a8', 'request_id': 'req-8d9f957f-4e3b-434d-ab54-e3f5f2dee9d6'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:07.322528 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e32a616-bc4b-487b-ad3e-a95d3f6716f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:07.325230 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e32a616-bc4b-487b-ad3e-a95d3f6716f8 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:07.345238 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 830/1674] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:19:07 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:19:07.354161 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e32a616-bc4b-487b-ad3e-a95d3f6716f8 service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:07.358180 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-1e32a616-bc4b-487b-ad3e-a95d3f6716f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:07.391517 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e32a616-bc4b-487b-ad3e-a95d3f6716f8 service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:07.438974 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-8d9f957f-4e3b-434d-ab54-e3f5f2dee9d6 admin admin] The token cache is being invalidate because project 7ce1d1101cc34b40aecd1bae052707a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:19:07.439931 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-8d9f957f-4e3b-434d-ab54-e3f5f2dee9d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:07.440597 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-8d9f957f-4e3b-434d-ab54-e3f5f2dee9d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:07.447497 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 845/1675] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:19:06 2022] DELETE /identity/v3/projects/7ce1d1101cc34b40aecd1bae052707a8 => generated 0 bytes in 710 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:19:07.453059 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1e74e-711a-416f-815d-413f0c6cfaa7 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:07.453355 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1e74e-711a-416f-815d-413f0c6cfaa7 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:07.453640 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1e74e-711a-416f-815d-413f0c6cfaa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:07.519697 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-c4f1e74e-711a-416f-815d-413f0c6cfaa7 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:07.521152 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-c4f1e74e-711a-416f-815d-413f0c6cfaa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:07.601998 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5d3723-f9ef-4894-9681-dd0a046f9cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:07.602995 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d3723-f9ef-4894-9681-dd0a046f9cd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:07.603356 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d3723-f9ef-4894-9681-dd0a046f9cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:07.603712 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d3723-f9ef-4894-9681-dd0a046f9cd4 admin admin] PATH_INFO: `/v3/users/ecff02dd499145acb25dc4c26e863ae4` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:07.605314 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5d3723-f9ef-4894-9681-dd0a046f9cd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecff02dd499145acb25dc4c26e863ae4)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:07.608188 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5d3723-f9ef-4894-9681-dd0a046f9cd4 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:07.696334 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 846/1676] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:19:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:19:07.698742 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48368a1d-bcd4-445b-9411-402fb77e799e None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:07.699043 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48368a1d-bcd4-445b-9411-402fb77e799e None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:07.704049 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48368a1d-bcd4-445b-9411-402fb77e799e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:07.741310 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-48368a1d-bcd4-445b-9411-402fb77e799e None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:07.742819 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-48368a1d-bcd4-445b-9411-402fb77e799e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:07.769948 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 847/1677] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:19:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:19:07.775419 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48368a1d-bcd4-445b-9411-402fb77e799e None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:07.804754 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48368a1d-bcd4-445b-9411-402fb77e799e None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:07.820564 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015a6036-0c45-4c0d-948b-ddc9333d1e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:07.820564 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a6036-0c45-4c0d-948b-ddc9333d1e9e admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:07.820842 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a6036-0c45-4c0d-948b-ddc9333d1e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:07.821024 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a6036-0c45-4c0d-948b-ddc9333d1e9e admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:07.821840 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015a6036-0c45-4c0d-948b-ddc9333d1e9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:19:07.822230 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015a6036-0c45-4c0d-948b-ddc9333d1e9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:07.824107 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015a6036-0c45-4c0d-948b-ddc9333d1e9e admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:07.841163 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-5f5d3723-f9ef-4894-9681-dd0a046f9cd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecff02dd499145acb25dc4c26e863ae4'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:07.847699 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-5f5d3723-f9ef-4894-9681-dd0a046f9cd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecff02dd499145acb25dc4c26e863ae4'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:07.857497 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-5f5d3723-f9ef-4894-9681-dd0a046f9cd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecff02dd499145acb25dc4c26e863ae4'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:07.858696 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 848/1678] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 10 03:19:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:19:07.859633 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015a6036-0c45-4c0d-948b-ddc9333d1e9e admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:07.886693 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015a6036-0c45-4c0d-948b-ddc9333d1e9e admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:07.892757 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a220ffb0-c339-4e50-8ba5-4893e7f21307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:07.893190 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220ffb0-c339-4e50-8ba5-4893e7f21307 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:07.893494 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220ffb0-c339-4e50-8ba5-4893e7f21307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:07.893854 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220ffb0-c339-4e50-8ba5-4893e7f21307 admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:07.894772 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a220ffb0-c339-4e50-8ba5-4893e7f21307 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:07.896744 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a220ffb0-c339-4e50-8ba5-4893e7f21307 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:07.950200 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-5f5d3723-f9ef-4894-9681-dd0a046f9cd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecff02dd499145acb25dc4c26e863ae4'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:07.951974 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-5f5d3723-f9ef-4894-9681-dd0a046f9cd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecff02dd499145acb25dc4c26e863ae4'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:08.045668 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 831/1679] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:19:07 2022] DELETE /identity/v3/users/ecff02dd499145acb25dc4c26e863ae4 => generated 0 bytes in 690 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:19:08.050741 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 849/1680] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:19:07 2022] POST /identity/v3/projects => generated 373 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:19:08.052977 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606930df-22bb-4e90-b2f1-2ec5ead32389 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:08.052977 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606930df-22bb-4e90-b2f1-2ec5ead32389 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:08.052977 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606930df-22bb-4e90-b2f1-2ec5ead32389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:08.054656 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a220ffb0-c339-4e50-8ba5-4893e7f21307 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:08.059525 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-a220ffb0-c339-4e50-8ba5-4893e7f21307 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:08.129432 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-606930df-22bb-4e90-b2f1-2ec5ead32389 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:08.130721 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-606930df-22bb-4e90-b2f1-2ec5ead32389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:08.239613 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a220ffb0-c339-4e50-8ba5-4893e7f21307 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:08.260306 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfbb66b-39f7-45dd-85a5-d0cb89fce677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:08.260947 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfbb66b-39f7-45dd-85a5-d0cb89fce677 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:08.261228 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfbb66b-39f7-45dd-85a5-d0cb89fce677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:08.261499 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfbb66b-39f7-45dd-85a5-d0cb89fce677 admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:08.262199 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfbb66b-39f7-45dd-85a5-d0cb89fce677 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:08.275289 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfbb66b-39f7-45dd-85a5-d0cb89fce677 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:08.319431 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 832/1681] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:19:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:19:08.365887 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606930df-22bb-4e90-b2f1-2ec5ead32389 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:08.366482 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-606930df-22bb-4e90-b2f1-2ec5ead32389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:08.484804 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606930df-22bb-4e90-b2f1-2ec5ead32389 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:08.494717 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b8ebf-3b74-4286-81b4-0882a6b5ebde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:08.505528 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b8ebf-3b74-4286-81b4-0882a6b5ebde service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:08.505528 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b8ebf-3b74-4286-81b4-0882a6b5ebde service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:08.505528 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b8ebf-3b74-4286-81b4-0882a6b5ebde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:08.506649 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629b8ebf-3b74-4286-81b4-0882a6b5ebde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:08.508554 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629b8ebf-3b74-4286-81b4-0882a6b5ebde service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:08.520511 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 833/1682] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:19:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:19:08.606730 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 850/1683] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:19:08 2022] POST /identity/v3/users => generated 287 bytes in 550 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:19:08.624881 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b8ebf-3b74-4286-81b4-0882a6b5ebde service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:08.624881 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b8ebf-3b74-4286-81b4-0882a6b5ebde service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:08.648844 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92333aef-5e02-4afd-ae48-fa818b8e2b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:08.650159 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92333aef-5e02-4afd-ae48-fa818b8e2b91 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:08.651749 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92333aef-5e02-4afd-ae48-fa818b8e2b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:08.652248 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92333aef-5e02-4afd-ae48-fa818b8e2b91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:08.653013 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92333aef-5e02-4afd-ae48-fa818b8e2b91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:08.654662 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92333aef-5e02-4afd-ae48-fa818b8e2b91 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:08.698032 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 834/1684] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:19:08 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:19:08.701151 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfbb66b-39f7-45dd-85a5-d0cb89fce677 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:08.724654 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfbb66b-39f7-45dd-85a5-d0cb89fce677 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:08.738142 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481d9c73-6091-48a3-8ad9-708eb606ab4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:08.738847 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d9c73-6091-48a3-8ad9-708eb606ab4a admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:08.739134 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d9c73-6091-48a3-8ad9-708eb606ab4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:08.739414 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d9c73-6091-48a3-8ad9-708eb606ab4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:08.740202 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481d9c73-6091-48a3-8ad9-708eb606ab4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:08.741822 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481d9c73-6091-48a3-8ad9-708eb606ab4a admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:08.801120 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92333aef-5e02-4afd-ae48-fa818b8e2b91 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:08.802468 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 851/1685] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:19:08 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:19:08.815079 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92333aef-5e02-4afd-ae48-fa818b8e2b91 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:08.849275 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f0b3b5-e8d2-4d3c-b39b-86c01a25e2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:08.849899 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0b3b5-e8d2-4d3c-b39b-86c01a25e2a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:08.850292 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0b3b5-e8d2-4d3c-b39b-86c01a25e2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:08.850400 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0b3b5-e8d2-4d3c-b39b-86c01a25e2a6 admin admin] PATH_INFO: `/v3/projects/fd5235dda759486499f7eddfd9d70cd8/users/f7fa3ec2328646e1bc8e340ce53383c3/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:08.885955 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f0b3b5-e8d2-4d3c-b39b-86c01a25e2a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd5235dda759486499f7eddfd9d70cd8, user_id=f7fa3ec2328646e1bc8e340ce53383c3, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:08.888752 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f0b3b5-e8d2-4d3c-b39b-86c01a25e2a6 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:08.984801 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 835/1686] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:19:08 2022] PUT /identity/v3/projects/fd5235dda759486499f7eddfd9d70cd8/users/f7fa3ec2328646e1bc8e340ce53383c3/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:19:08.985701 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab763c6-afac-4d55-8379-437475050d8a None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:08.986003 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab763c6-afac-4d55-8379-437475050d8a None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:08.986283 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab763c6-afac-4d55-8379-437475050d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:09.046294 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-eab763c6-afac-4d55-8379-437475050d8a None None] MFA Rules not processed for user `f7fa3ec2328646e1bc8e340ce53383c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:09.047894 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-eab763c6-afac-4d55-8379-437475050d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:09.272798 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f0b3b5-e8d2-4d3c-b39b-86c01a25e2a6 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:09.284068 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 852/1687] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:19:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:19:09.403177 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f0b3b5-e8d2-4d3c-b39b-86c01a25e2a6 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:09.409348 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca2c24-fa57-48bf-ba0e-a1fcac64a027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:09.410805 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca2c24-fa57-48bf-ba0e-a1fcac64a027 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:09.411591 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca2c24-fa57-48bf-ba0e-a1fcac64a027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:09.412223 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca2c24-fa57-48bf-ba0e-a1fcac64a027 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:09.413823 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bca2c24-fa57-48bf-ba0e-a1fcac64a027 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:09.418152 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bca2c24-fa57-48bf-ba0e-a1fcac64a027 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:09.561850 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 836/1688] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:19:09 2022] POST /identity/v3/projects => generated 371 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:19:09.566855 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab763c6-afac-4d55-8379-437475050d8a None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:09.581544 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab763c6-afac-4d55-8379-437475050d8a None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:09.740735 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56cf5f9-a207-48b0-9677-7779eeb0f26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:09.744193 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56cf5f9-a207-48b0-9677-7779eeb0f26b admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:09.745158 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56cf5f9-a207-48b0-9677-7779eeb0f26b admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:09.746140 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56cf5f9-a207-48b0-9677-7779eeb0f26b admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:09.747156 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56cf5f9-a207-48b0-9677-7779eeb0f26b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:09.760114 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56cf5f9-a207-48b0-9677-7779eeb0f26b admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:09.856943 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca2c24-fa57-48bf-ba0e-a1fcac64a027 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:09.865129 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 853/1689] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:19:09 2022] POST /identity/v3/users => generated 292 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:19:09.879463 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca2c24-fa57-48bf-ba0e-a1fcac64a027 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:09.895462 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2f42d9-9032-4546-ba81-04acf2884f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:09.896752 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f42d9-9032-4546-ba81-04acf2884f1e admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:09.897218 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f42d9-9032-4546-ba81-04acf2884f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:09.897795 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f42d9-9032-4546-ba81-04acf2884f1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:09.903357 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2f42d9-9032-4546-ba81-04acf2884f1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:09.906943 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2f42d9-9032-4546-ba81-04acf2884f1e admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:09.944536 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56cf5f9-a207-48b0-9677-7779eeb0f26b admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:09.954796 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 837/1690] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:19:09.960597 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56cf5f9-a207-48b0-9677-7779eeb0f26b admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:09.976691 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb065c-3aef-46b1-8ae4-a0b47a419f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:09.978366 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb065c-3aef-46b1-8ae4-a0b47a419f1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:09.978691 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb065c-3aef-46b1-8ae4-a0b47a419f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:09.978975 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb065c-3aef-46b1-8ae4-a0b47a419f1c admin admin] PATH_INFO: `/v3/projects/dc5ada9a861543459f206ef69a9b34ed/users/38fcef954b8a4c70855d94a17c0f08b2/roles/43105000610f402ca2486e7648018cca` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:10.012213 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccb065c-3aef-46b1-8ae4-a0b47a419f1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc5ada9a861543459f206ef69a9b34ed, user_id=38fcef954b8a4c70855d94a17c0f08b2, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:10.015228 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccb065c-3aef-46b1-8ae4-a0b47a419f1c admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:10.140817 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 854/1691] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:19:09 2022] PUT /identity/v3/projects/dc5ada9a861543459f206ef69a9b34ed/users/38fcef954b8a4c70855d94a17c0f08b2/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:19:10.144879 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2f42d9-9032-4546-ba81-04acf2884f1e admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:10.175630 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2f42d9-9032-4546-ba81-04acf2884f1e admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:10.203048 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f36d1-a8b0-4b1b-ae42-522410bb1176 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:10.203337 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f36d1-a8b0-4b1b-ae42-522410bb1176 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:10.203618 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f36d1-a8b0-4b1b-ae42-522410bb1176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:10.381700 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-a73f36d1-a8b0-4b1b-ae42-522410bb1176 None None] MFA Rules not processed for user `a14e317d371c4f9f994a568798c00e90`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:10.390004 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-a73f36d1-a8b0-4b1b-ae42-522410bb1176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:10.517994 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ed48c0-dd25-481c-b3f2-1ab155dcf71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:10.518680 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed48c0-dd25-481c-b3f2-1ab155dcf71b admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:10.518880 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed48c0-dd25-481c-b3f2-1ab155dcf71b admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:10.519249 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed48c0-dd25-481c-b3f2-1ab155dcf71b admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:10.521960 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ed48c0-dd25-481c-b3f2-1ab155dcf71b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:10.525755 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ed48c0-dd25-481c-b3f2-1ab155dcf71b admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:10.591024 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 838/1692] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:19:10 2022] GET /identity/v3/roles => generated 1420 bytes in 444 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:19:10.592100 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ed48c0-dd25-481c-b3f2-1ab155dcf71b admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:10.655330 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ed48c0-dd25-481c-b3f2-1ab155dcf71b admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:10.685551 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ac4ef-858f-45eb-9db1-4a96c63b6e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:10.685551 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ac4ef-858f-45eb-9db1-4a96c63b6e61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:10.685551 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ac4ef-858f-45eb-9db1-4a96c63b6e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:10.685551 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ac4ef-858f-45eb-9db1-4a96c63b6e61 admin admin] PATH_INFO: `/v3/projects/dc5ada9a861543459f206ef69a9b34ed/users/38fcef954b8a4c70855d94a17c0f08b2/roles/43105000610f402ca2486e7648018cca` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:10.693221 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66ac4ef-858f-45eb-9db1-4a96c63b6e61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc5ada9a861543459f206ef69a9b34ed, user_id=38fcef954b8a4c70855d94a17c0f08b2, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:10.696273 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66ac4ef-858f-45eb-9db1-4a96c63b6e61 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:10.746474 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 855/1693] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:19:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 544 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:19:10.753990 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f36d1-a8b0-4b1b-ae42-522410bb1176 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:10.761913 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-a73f36d1-a8b0-4b1b-ae42-522410bb1176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:10.779678 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 839/1694] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:19:10 2022] PUT /identity/v3/projects/dc5ada9a861543459f206ef69a9b34ed/users/38fcef954b8a4c70855d94a17c0f08b2/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:19:10.811626 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a05e22-0ed0-494f-9ad9-c08fef7c1154 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:10.811626 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a05e22-0ed0-494f-9ad9-c08fef7c1154 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:10.811626 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a05e22-0ed0-494f-9ad9-c08fef7c1154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:10.925027 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-48a05e22-0ed0-494f-9ad9-c08fef7c1154 None None] MFA Rules not processed for user `38fcef954b8a4c70855d94a17c0f08b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:10.926282 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-48a05e22-0ed0-494f-9ad9-c08fef7c1154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:11.110206 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f36d1-a8b0-4b1b-ae42-522410bb1176 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:11.257442 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 840/1695] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:19:10 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 457 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:19:11.262082 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7228f8-3271-4448-b366-aa3028d8651c None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:11.262082 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7228f8-3271-4448-b366-aa3028d8651c None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:11.262259 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7228f8-3271-4448-b366-aa3028d8651c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:11.283197 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf69cf9c-020f-4334-b611-a2262eca963a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b7ccdccba0b4f9e86817946f22dbe28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:11.284485 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69cf9c-020f-4334-b611-a2262eca963a service nova] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:11.285001 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69cf9c-020f-4334-b611-a2262eca963a service nova] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:11.285541 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69cf9c-020f-4334-b611-a2262eca963a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:11.344105 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-4b7228f8-3271-4448-b366-aa3028d8651c None None] MFA Rules not processed for user `ccfba74826234915bc989fede9bde3e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:11.345589 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-4b7228f8-3271-4448-b366-aa3028d8651c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:11.386043 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf69cf9c-020f-4334-b611-a2262eca963a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:11.390561 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf69cf9c-020f-4334-b611-a2262eca963a service nova] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:11.427390 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 856/1696] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:19:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 675 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:19:11.429622 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf69cf9c-020f-4334-b611-a2262eca963a service nova] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:11.433617 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-bf69cf9c-020f-4334-b611-a2262eca963a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:11.504819 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 841/1697] 10.222.0.61 () {58 vars in 1015 bytes} [Tue May 10 03:19:11 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:19:11.601322 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf69cf9c-020f-4334-b611-a2262eca963a service nova] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:11.614337 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1249a4-1058-44b1-ba01-ec3b447c3474 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:11.615236 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1249a4-1058-44b1-ba01-ec3b447c3474 service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:11.615846 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1249a4-1058-44b1-ba01-ec3b447c3474 service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:11.616230 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1249a4-1058-44b1-ba01-ec3b447c3474 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:11.624592 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7228f8-3271-4448-b366-aa3028d8651c None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:11.634861 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7228f8-3271-4448-b366-aa3028d8651c None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:11.638213 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1249a4-1058-44b1-ba01-ec3b447c3474 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:11.641289 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1249a4-1058-44b1-ba01-ec3b447c3474 service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:11.664743 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aa7c85-cd18-44ed-a9cd-a266445cad60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:11.666019 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa7c85-cd18-44ed-a9cd-a266445cad60 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:11.666308 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa7c85-cd18-44ed-a9cd-a266445cad60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:11.666587 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa7c85-cd18-44ed-a9cd-a266445cad60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:11.696700 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 857/1698] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:19:11 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:19:11.711786 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aa7c85-cd18-44ed-a9cd-a266445cad60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:11.713616 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aa7c85-cd18-44ed-a9cd-a266445cad60 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:11.749649 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 842/1699] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:19:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:19:12.266279 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1249a4-1058-44b1-ba01-ec3b447c3474 service cinder] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:12.269081 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-af1249a4-1058-44b1-ba01-ec3b447c3474 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:12.523604 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1249a4-1058-44b1-ba01-ec3b447c3474 service cinder] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:12.542142 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3030f6b8-0a2a-414b-ae20-27a6a9c76bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:12.542852 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3030f6b8-0a2a-414b-ae20-27a6a9c76bed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:12.543145 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3030f6b8-0a2a-414b-ae20-27a6a9c76bed admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:12.543428 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3030f6b8-0a2a-414b-ae20-27a6a9c76bed admin admin] PATH_INFO: `/v3/projects/91fe5079c1bd49329fdd29401e8b7504` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:12.551988 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3030f6b8-0a2a-414b-ae20-27a6a9c76bed admin admin] RBAC: Authorizing `identity:delete_project(project_id=91fe5079c1bd49329fdd29401e8b7504)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:12.562533 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3030f6b8-0a2a-414b-ae20-27a6a9c76bed admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:12.833542 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-3030f6b8-0a2a-414b-ae20-27a6a9c76bed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91fe5079c1bd49329fdd29401e8b7504', 'request_id': 'req-3030f6b8-0a2a-414b-ae20-27a6a9c76bed'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:12.882129 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-3030f6b8-0a2a-414b-ae20-27a6a9c76bed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91fe5079c1bd49329fdd29401e8b7504', 'request_id': 'req-3030f6b8-0a2a-414b-ae20-27a6a9c76bed'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:12.921217 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-3030f6b8-0a2a-414b-ae20-27a6a9c76bed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91fe5079c1bd49329fdd29401e8b7504', 'request_id': 'req-3030f6b8-0a2a-414b-ae20-27a6a9c76bed'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:13.070740 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-3030f6b8-0a2a-414b-ae20-27a6a9c76bed admin admin] The token cache is being invalidate because project 91fe5079c1bd49329fdd29401e8b7504 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:19:13.070740 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-3030f6b8-0a2a-414b-ae20-27a6a9c76bed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:13.070740 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-3030f6b8-0a2a-414b-ae20-27a6a9c76bed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:13.084708 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 858/1700] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:19:12 2022] DELETE /identity/v3/projects/91fe5079c1bd49329fdd29401e8b7504 => generated 0 bytes in 819 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:19:13.090945 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f8ba5-66bd-4ff4-b678-3a576fe85dcd None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:13.091527 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f8ba5-66bd-4ff4-b678-3a576fe85dcd None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:13.091527 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f8ba5-66bd-4ff4-b678-3a576fe85dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:13.190811 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-2f2f8ba5-66bd-4ff4-b678-3a576fe85dcd None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:13.204901 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-2f2f8ba5-66bd-4ff4-b678-3a576fe85dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:13.364981 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e247a10-a5b5-4b3a-8c01-99de962d03e1 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:13.365628 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e247a10-a5b5-4b3a-8c01-99de962d03e1 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:13.368449 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e247a10-a5b5-4b3a-8c01-99de962d03e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:13.460223 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 843/1701] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:19:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:19:13.463828 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f8ba5-66bd-4ff4-b678-3a576fe85dcd None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:13.468524 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-2f2f8ba5-66bd-4ff4-b678-3a576fe85dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:13.482395 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-2e247a10-a5b5-4b3a-8c01-99de962d03e1 None None] MFA Rules not processed for user `9dff947a164641e7b32c639bebbffe36`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:13.484039 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-2e247a10-a5b5-4b3a-8c01-99de962d03e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:13.507273 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f8ba5-66bd-4ff4-b678-3a576fe85dcd None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:13.528633 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ea08b-cde0-49a8-b0e3-45ae573e30a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:13.529558 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ea08b-cde0-49a8-b0e3-45ae573e30a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:13.529844 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ea08b-cde0-49a8-b0e3-45ae573e30a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:13.530126 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ea08b-cde0-49a8-b0e3-45ae573e30a8 admin admin] PATH_INFO: `/v3/users/f7fa3ec2328646e1bc8e340ce53383c3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:13.533827 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0ea08b-cde0-49a8-b0e3-45ae573e30a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7fa3ec2328646e1bc8e340ce53383c3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:13.545142 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0ea08b-cde0-49a8-b0e3-45ae573e30a8 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:13.670187 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 859/1702] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:19:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:19:13.672095 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1137d97-fb17-420d-a60a-568fbff26480 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:13.676765 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1137d97-fb17-420d-a60a-568fbff26480 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:13.682368 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1137d97-fb17-420d-a60a-568fbff26480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:13.746253 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-e1137d97-fb17-420d-a60a-568fbff26480 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:13.748187 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-e1137d97-fb17-420d-a60a-568fbff26480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:13.763969 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 860/1703] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:19:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:19:13.765241 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1137d97-fb17-420d-a60a-568fbff26480 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:13.766819 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-e1137d97-fb17-420d-a60a-568fbff26480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:13.845095 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-9c0ea08b-cde0-49a8-b0e3-45ae573e30a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7fa3ec2328646e1bc8e340ce53383c3'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:13.845819 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-9c0ea08b-cde0-49a8-b0e3-45ae573e30a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7fa3ec2328646e1bc8e340ce53383c3'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:13.900724 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-9c0ea08b-cde0-49a8-b0e3-45ae573e30a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7fa3ec2328646e1bc8e340ce53383c3'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:14.010385 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-9c0ea08b-cde0-49a8-b0e3-45ae573e30a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7fa3ec2328646e1bc8e340ce53383c3'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:14.011028 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-9c0ea08b-cde0-49a8-b0e3-45ae573e30a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7fa3ec2328646e1bc8e340ce53383c3'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:14.110969 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 844/1704] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:19:13 2022] DELETE /identity/v3/users/f7fa3ec2328646e1bc8e340ce53383c3 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:19:14.116540 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ea08b-cde0-49a8-b0e3-45ae573e30a8 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:14.118826 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-9c0ea08b-cde0-49a8-b0e3-45ae573e30a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:14.138431 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1137d97-fb17-420d-a60a-568fbff26480 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:14.396846 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53afed29-f113-4cc9-a667-12fe18231c1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b7ccdccba0b4f9e86817946f22dbe28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:14.397534 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53afed29-f113-4cc9-a667-12fe18231c1e service nova] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:14.397795 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53afed29-f113-4cc9-a667-12fe18231c1e service nova] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:14.398259 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53afed29-f113-4cc9-a667-12fe18231c1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:14.401541 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-53afed29-f113-4cc9-a667-12fe18231c1e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:14.405347 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ea08b-cde0-49a8-b0e3-45ae573e30a8 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:14.424435 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bcabc9-2ea4-4ee5-a096-28b66f40a508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:14.426561 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bcabc9-2ea4-4ee5-a096-28b66f40a508 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:14.427707 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bcabc9-2ea4-4ee5-a096-28b66f40a508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:14.428663 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bcabc9-2ea4-4ee5-a096-28b66f40a508 admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:14.432444 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bcabc9-2ea4-4ee5-a096-28b66f40a508 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:19:14.433629 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bcabc9-2ea4-4ee5-a096-28b66f40a508 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:14.437593 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bcabc9-2ea4-4ee5-a096-28b66f40a508 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:14.515950 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 845/1705] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 10 03:19:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:19:14.515950 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28282fb3-61d0-458f-8ab0-1a003cded4de None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:14.515950 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28282fb3-61d0-458f-8ab0-1a003cded4de None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:14.515950 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28282fb3-61d0-458f-8ab0-1a003cded4de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:14.569920 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53afed29-f113-4cc9-a667-12fe18231c1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:14.570780 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53afed29-f113-4cc9-a667-12fe18231c1e service nova] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:14.583667 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-28282fb3-61d0-458f-8ab0-1a003cded4de None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:14.588169 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-28282fb3-61d0-458f-8ab0-1a003cded4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:14.599867 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 861/1706] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:19:13 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 835 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:19:14.600737 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53afed29-f113-4cc9-a667-12fe18231c1e service nova] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:14.615770 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 846/1707] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:19:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:19:14.631293 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28282fb3-61d0-458f-8ab0-1a003cded4de None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:14.636099 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-28282fb3-61d0-458f-8ab0-1a003cded4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:14.649376 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53afed29-f113-4cc9-a667-12fe18231c1e service nova] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:14.656121 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f9baa2-7b29-4d1b-a158-e3fc522412ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:14.656121 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f9baa2-7b29-4d1b-a158-e3fc522412ae admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:14.656121 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f9baa2-7b29-4d1b-a158-e3fc522412ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:14.656121 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f9baa2-7b29-4d1b-a158-e3fc522412ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:14.656460 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f9baa2-7b29-4d1b-a158-e3fc522412ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:14.658356 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f9baa2-7b29-4d1b-a158-e3fc522412ae admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:14.782699 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 862/1708] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:19:14 2022] POST /identity/v3/projects => generated 357 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:19:14.789126 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f9baa2-7b29-4d1b-a158-e3fc522412ae admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:14.894916 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28282fb3-61d0-458f-8ab0-1a003cded4de None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:14.965328 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f9baa2-7b29-4d1b-a158-e3fc522412ae admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:14.977004 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29b9b7c-2de6-49b1-ba47-b8eb690d92c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:14.978305 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b9b7c-2de6-49b1-ba47-b8eb690d92c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:14.978590 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b9b7c-2de6-49b1-ba47-b8eb690d92c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:14.978867 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b9b7c-2de6-49b1-ba47-b8eb690d92c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:14.979578 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29b9b7c-2de6-49b1-ba47-b8eb690d92c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:14.981613 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29b9b7c-2de6-49b1-ba47-b8eb690d92c3 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:14.990734 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf3ebb0-40e3-41d6-a75d-8db92cba89b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:14.991721 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf3ebb0-40e3-41d6-a75d-8db92cba89b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:14.994379 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf3ebb0-40e3-41d6-a75d-8db92cba89b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:14.994379 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf3ebb0-40e3-41d6-a75d-8db92cba89b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:15.023612 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf3ebb0-40e3-41d6-a75d-8db92cba89b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:15.025172 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf3ebb0-40e3-41d6-a75d-8db92cba89b1 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:15.048733 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 847/1709] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:19:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:19:15.094011 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 863/1710] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:19:14 2022] POST /identity/v3/users => generated 279 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:19:15.098917 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf3ebb0-40e3-41d6-a75d-8db92cba89b1 service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:15.113536 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf3ebb0-40e3-41d6-a75d-8db92cba89b1 service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:15.127243 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca134cd-e205-4dba-98b4-72af5c58b1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:15.128072 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca134cd-e205-4dba-98b4-72af5c58b1ef admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:15.128370 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca134cd-e205-4dba-98b4-72af5c58b1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:15.128716 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca134cd-e205-4dba-98b4-72af5c58b1ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:15.129472 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca134cd-e205-4dba-98b4-72af5c58b1ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:15.133846 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca134cd-e205-4dba-98b4-72af5c58b1ef admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:15.177263 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 848/1711] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:19:15.181516 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29b9b7c-2de6-49b1-ba47-b8eb690d92c3 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:15.192536 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29b9b7c-2de6-49b1-ba47-b8eb690d92c3 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:15.213962 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f4c28a-aee6-4eff-ab36-8323712d046d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:15.214651 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4c28a-aee6-4eff-ab36-8323712d046d admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:15.214936 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4c28a-aee6-4eff-ab36-8323712d046d admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:15.215214 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4c28a-aee6-4eff-ab36-8323712d046d admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:15.215967 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f4c28a-aee6-4eff-ab36-8323712d046d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:15.217605 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f4c28a-aee6-4eff-ab36-8323712d046d admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:15.252369 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca134cd-e205-4dba-98b4-72af5c58b1ef admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:15.263014 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca134cd-e205-4dba-98b4-72af5c58b1ef admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:15.266132 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 864/1712] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:19:15.277998 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4043a2ec-bccc-48b8-bcc7-703743fd8c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:15.280046 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043a2ec-bccc-48b8-bcc7-703743fd8c3f admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:15.282463 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043a2ec-bccc-48b8-bcc7-703743fd8c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:15.282940 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043a2ec-bccc-48b8-bcc7-703743fd8c3f admin admin] PATH_INFO: `/v3/projects/d53c5194a9674c75b5d36f4c17cec8da/users/8e79a8defc17460690846cc81f6c2679/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:15.326918 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4043a2ec-bccc-48b8-bcc7-703743fd8c3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d53c5194a9674c75b5d36f4c17cec8da, user_id=8e79a8defc17460690846cc81f6c2679, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:15.333213 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4043a2ec-bccc-48b8-bcc7-703743fd8c3f admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:15.469810 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 849/1713] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:19:15 2022] PUT /identity/v3/projects/d53c5194a9674c75b5d36f4c17cec8da/users/8e79a8defc17460690846cc81f6c2679/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:19:15.482249 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115fa89-526d-401d-b5d5-e7e3a42fd6ab None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:15.483052 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115fa89-526d-401d-b5d5-e7e3a42fd6ab None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:15.483518 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115fa89-526d-401d-b5d5-e7e3a42fd6ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:15.564461 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-f115fa89-526d-401d-b5d5-e7e3a42fd6ab None None] MFA Rules not processed for user `8e79a8defc17460690846cc81f6c2679`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:15.566313 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-f115fa89-526d-401d-b5d5-e7e3a42fd6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:15.796385 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 865/1714] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:19:15 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:19:15.803206 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4043a2ec-bccc-48b8-bcc7-703743fd8c3f admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:15.952157 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4043a2ec-bccc-48b8-bcc7-703743fd8c3f admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:15.961194 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a997253f-69f5-4a2c-982d-83b51a90e183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:15.963113 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a997253f-69f5-4a2c-982d-83b51a90e183 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:15.963732 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a997253f-69f5-4a2c-982d-83b51a90e183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:15.964244 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a997253f-69f5-4a2c-982d-83b51a90e183 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:15.965209 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a997253f-69f5-4a2c-982d-83b51a90e183 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:15.968883 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a997253f-69f5-4a2c-982d-83b51a90e183 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:16.097349 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 850/1715] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:19:15 2022] POST /identity/v3/projects => generated 353 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:19:16.101477 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115fa89-526d-401d-b5d5-e7e3a42fd6ab None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:16.130572 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115fa89-526d-401d-b5d5-e7e3a42fd6ab None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:16.152991 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a997253f-69f5-4a2c-982d-83b51a90e183 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:16.155245 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-a997253f-69f5-4a2c-982d-83b51a90e183 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:16.330365 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81341c0f-7365-43e3-8cfd-db964961abca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:16.332743 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81341c0f-7365-43e3-8cfd-db964961abca admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:16.333294 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81341c0f-7365-43e3-8cfd-db964961abca admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:16.335078 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81341c0f-7365-43e3-8cfd-db964961abca admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:16.336154 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81341c0f-7365-43e3-8cfd-db964961abca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:16.339524 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81341c0f-7365-43e3-8cfd-db964961abca admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:16.374948 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a997253f-69f5-4a2c-982d-83b51a90e183 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:16.407325 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a8129-ff3f-4a28-818c-defbd7fbc05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:16.409164 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a8129-ff3f-4a28-818c-defbd7fbc05b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:16.410517 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a8129-ff3f-4a28-818c-defbd7fbc05b admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:16.411551 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a8129-ff3f-4a28-818c-defbd7fbc05b admin admin] PATH_INFO: `/v3/projects/fd5235dda759486499f7eddfd9d70cd8` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:16.415531 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a8129-ff3f-4a28-818c-defbd7fbc05b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd5235dda759486499f7eddfd9d70cd8)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:16.425461 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a8129-ff3f-4a28-818c-defbd7fbc05b admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:16.467449 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 866/1716] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:19:16 2022] POST /identity/v3/users => generated 283 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:19:16.469130 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81341c0f-7365-43e3-8cfd-db964961abca admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:16.537571 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81341c0f-7365-43e3-8cfd-db964961abca admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:16.551954 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d283bae8-446d-4211-bd17-73b958550d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:16.552959 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283bae8-446d-4211-bd17-73b958550d35 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:16.553393 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283bae8-446d-4211-bd17-73b958550d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:16.553861 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283bae8-446d-4211-bd17-73b958550d35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:16.554723 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d283bae8-446d-4211-bd17-73b958550d35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:16.556727 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d283bae8-446d-4211-bd17-73b958550d35 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:16.585345 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 867/1717] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:19:16 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:19:16.588843 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d283bae8-446d-4211-bd17-73b958550d35 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:16.612142 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d283bae8-446d-4211-bd17-73b958550d35 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:16.629294 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d9a94-1e0b-4bf3-a1f0-1d0cb33b6d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:16.629294 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d9a94-1e0b-4bf3-a1f0-1d0cb33b6d5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:16.629294 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d9a94-1e0b-4bf3-a1f0-1d0cb33b6d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:16.629294 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d9a94-1e0b-4bf3-a1f0-1d0cb33b6d5c admin admin] PATH_INFO: `/v3/projects/f1b4eff54254442caf4b6c03736e558c/users/f30a52f63fbc4555883a8f94f7fd1c67/roles/43105000610f402ca2486e7648018cca` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:16.660316 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4d9a94-1e0b-4bf3-a1f0-1d0cb33b6d5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1b4eff54254442caf4b6c03736e558c, user_id=f30a52f63fbc4555883a8f94f7fd1c67, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:16.663980 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4d9a94-1e0b-4bf3-a1f0-1d0cb33b6d5c admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:16.703213 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-bd3a8129-ff3f-4a28-818c-defbd7fbc05b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd5235dda759486499f7eddfd9d70cd8', 'request_id': 'req-bd3a8129-ff3f-4a28-818c-defbd7fbc05b'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:16.721313 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-bd3a8129-ff3f-4a28-818c-defbd7fbc05b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd5235dda759486499f7eddfd9d70cd8', 'request_id': 'req-bd3a8129-ff3f-4a28-818c-defbd7fbc05b'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:16.746739 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-bd3a8129-ff3f-4a28-818c-defbd7fbc05b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd5235dda759486499f7eddfd9d70cd8', 'request_id': 'req-bd3a8129-ff3f-4a28-818c-defbd7fbc05b'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:16.801382 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 868/1718] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:19:16 2022] PUT /identity/v3/projects/f1b4eff54254442caf4b6c03736e558c/users/f30a52f63fbc4555883a8f94f7fd1c67/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:19:16.802632 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d9a94-1e0b-4bf3-a1f0-1d0cb33b6d5c admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:16.859416 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-bd3a8129-ff3f-4a28-818c-defbd7fbc05b admin admin] The token cache is being invalidate because project fd5235dda759486499f7eddfd9d70cd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:19:16.859728 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-bd3a8129-ff3f-4a28-818c-defbd7fbc05b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:16.863542 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-bd3a8129-ff3f-4a28-818c-defbd7fbc05b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:16.867874 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 851/1719] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:19:16 2022] DELETE /identity/v3/projects/fd5235dda759486499f7eddfd9d70cd8 => generated 0 bytes in 718 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:19:16.872507 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a8129-ff3f-4a28-818c-defbd7fbc05b admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:16.879116 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-bd3a8129-ff3f-4a28-818c-defbd7fbc05b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:17.010785 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d9a94-1e0b-4bf3-a1f0-1d0cb33b6d5c admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:17.029726 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c84424-22c6-45fd-804e-2ce200044807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:17.034196 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c84424-22c6-45fd-804e-2ce200044807 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:17.037270 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c84424-22c6-45fd-804e-2ce200044807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:17.037557 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c84424-22c6-45fd-804e-2ce200044807 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:17.041887 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c84424-22c6-45fd-804e-2ce200044807 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:17.045407 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c84424-22c6-45fd-804e-2ce200044807 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:17.073016 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 869/1720] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:19:16 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:19:17.077523 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c84424-22c6-45fd-804e-2ce200044807 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:17.080715 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-47c84424-22c6-45fd-804e-2ce200044807 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:17.090740 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a8129-ff3f-4a28-818c-defbd7fbc05b admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:17.095757 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba1a4b-dea8-4955-8607-39bfb02fe8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:17.097222 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba1a4b-dea8-4955-8607-39bfb02fe8e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:17.097563 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba1a4b-dea8-4955-8607-39bfb02fe8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:17.097910 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba1a4b-dea8-4955-8607-39bfb02fe8e6 admin admin] PATH_INFO: `/v3/users/38fcef954b8a4c70855d94a17c0f08b2` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:17.099795 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ba1a4b-dea8-4955-8607-39bfb02fe8e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38fcef954b8a4c70855d94a17c0f08b2)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:17.101924 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ba1a4b-dea8-4955-8607-39bfb02fe8e6 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:17.141040 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c84424-22c6-45fd-804e-2ce200044807 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:17.154835 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b9a25-c7ff-4bd9-a3a2-90210b15557e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:17.158772 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b9a25-c7ff-4bd9-a3a2-90210b15557e admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:17.158772 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b9a25-c7ff-4bd9-a3a2-90210b15557e admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:17.158772 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b9a25-c7ff-4bd9-a3a2-90210b15557e admin admin] PATH_INFO: `/v3/projects/f1b4eff54254442caf4b6c03736e558c/users/f30a52f63fbc4555883a8f94f7fd1c67/roles/43105000610f402ca2486e7648018cca` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:17.177514 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606b9a25-c7ff-4bd9-a3a2-90210b15557e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1b4eff54254442caf4b6c03736e558c, user_id=f30a52f63fbc4555883a8f94f7fd1c67, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:17.183301 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606b9a25-c7ff-4bd9-a3a2-90210b15557e admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:17.217755 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 870/1721] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:19:17 2022] PUT /identity/v3/projects/f1b4eff54254442caf4b6c03736e558c/users/f30a52f63fbc4555883a8f94f7fd1c67/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:19:17.227923 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd76058-aa64-4bb0-8076-77283fba7f5a None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:17.229821 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd76058-aa64-4bb0-8076-77283fba7f5a None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:17.232404 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd76058-aa64-4bb0-8076-77283fba7f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:17.355269 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f3ba1a4b-dea8-4955-8607-39bfb02fe8e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38fcef954b8a4c70855d94a17c0f08b2'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:17.355269 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f3ba1a4b-dea8-4955-8607-39bfb02fe8e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38fcef954b8a4c70855d94a17c0f08b2'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:17.377189 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f3ba1a4b-dea8-4955-8607-39bfb02fe8e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38fcef954b8a4c70855d94a17c0f08b2'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:17.410970 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-6dd76058-aa64-4bb0-8076-77283fba7f5a None None] MFA Rules not processed for user `f30a52f63fbc4555883a8f94f7fd1c67`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:17.410970 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-6dd76058-aa64-4bb0-8076-77283fba7f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:17.484261 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f3ba1a4b-dea8-4955-8607-39bfb02fe8e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38fcef954b8a4c70855d94a17c0f08b2'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:17.485329 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f3ba1a4b-dea8-4955-8607-39bfb02fe8e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38fcef954b8a4c70855d94a17c0f08b2'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:17.522896 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 852/1722] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:19:16 2022] DELETE /identity/v3/users/38fcef954b8a4c70855d94a17c0f08b2 => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:19:17.605312 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 871/1723] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:19:17 2022] POST /identity/v3/auth/tokens => generated 3287 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:19:17.619378 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba1a4b-dea8-4955-8607-39bfb02fe8e6 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:17.621196 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-f3ba1a4b-dea8-4955-8607-39bfb02fe8e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:17.841450 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba1a4b-dea8-4955-8607-39bfb02fe8e6 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:17.847246 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca377f-5f2e-4f95-9313-9abbacd424ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:17.853046 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca377f-5f2e-4f95-9313-9abbacd424ee service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:17.853640 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca377f-5f2e-4f95-9313-9abbacd424ee service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:17.854214 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca377f-5f2e-4f95-9313-9abbacd424ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:18.000228 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abca377f-5f2e-4f95-9313-9abbacd424ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:18.002775 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abca377f-5f2e-4f95-9313-9abbacd424ee service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:18.023145 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 853/1724] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:19:17 2022] GET /identity/v3/auth/tokens => generated 3287 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:19:18.268114 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd76058-aa64-4bb0-8076-77283fba7f5a None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:18.489539 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd76058-aa64-4bb0-8076-77283fba7f5a None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:18.496806 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf01b82-c080-477f-88d3-31c5586d3401 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:18.498299 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf01b82-c080-477f-88d3-31c5586d3401 service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:18.498299 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf01b82-c080-477f-88d3-31c5586d3401 service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:18.498299 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf01b82-c080-477f-88d3-31c5586d3401 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:18.511368 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-faf01b82-c080-477f-88d3-31c5586d3401 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:18.665498 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf01b82-c080-477f-88d3-31c5586d3401 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:18.673100 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf01b82-c080-477f-88d3-31c5586d3401 service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:18.709863 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 872/1725] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:19:18 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:19:19.080040 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca377f-5f2e-4f95-9313-9abbacd424ee service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:19.081563 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-abca377f-5f2e-4f95-9313-9abbacd424ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:19.257704 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca377f-5f2e-4f95-9313-9abbacd424ee service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:19.267535 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91994d6-cd8a-4031-a308-64fd74d30e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:19.268476 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91994d6-cd8a-4031-a308-64fd74d30e38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:19.268764 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91994d6-cd8a-4031-a308-64fd74d30e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:19.269161 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91994d6-cd8a-4031-a308-64fd74d30e38 admin admin] PATH_INFO: `/v3/users/fe5d7c0a27784430a2938a35d74a2839` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:19.272924 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91994d6-cd8a-4031-a308-64fd74d30e38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe5d7c0a27784430a2938a35d74a2839)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:19.276881 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91994d6-cd8a-4031-a308-64fd74d30e38 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:19.462293 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c28a3c6-c99a-4cc9-a6b6-97452193d0c6 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:19.462910 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c28a3c6-c99a-4cc9-a6b6-97452193d0c6 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:19.463410 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c28a3c6-c99a-4cc9-a6b6-97452193d0c6 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:19.470740 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 873/1726] 10.222.0.65 () {54 vars in 921 bytes} [Tue May 10 03:19:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:19:19.561096 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde7827-b145-4f89-98e2-4606c88812da None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:19.561779 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde7827-b145-4f89-98e2-4606c88812da None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:19.562129 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde7827-b145-4f89-98e2-4606c88812da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:19.569435 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c91994d6-cd8a-4031-a308-64fd74d30e38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe5d7c0a27784430a2938a35d74a2839'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:19.572424 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c91994d6-cd8a-4031-a308-64fd74d30e38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe5d7c0a27784430a2938a35d74a2839'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:19.592329 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c91994d6-cd8a-4031-a308-64fd74d30e38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe5d7c0a27784430a2938a35d74a2839'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:19.604447 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-8bde7827-b145-4f89-98e2-4606c88812da None None] MFA Rules not processed for user `9b7ccdccba0b4f9e86817946f22dbe28`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:19.609780 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-8bde7827-b145-4f89-98e2-4606c88812da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:19.684393 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c91994d6-cd8a-4031-a308-64fd74d30e38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe5d7c0a27784430a2938a35d74a2839'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:19.685321 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c91994d6-cd8a-4031-a308-64fd74d30e38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe5d7c0a27784430a2938a35d74a2839'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:19.749786 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 854/1727] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:19:19 2022] DELETE /identity/v3/users/fe5d7c0a27784430a2938a35d74a2839 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:19:19.751597 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc66bdf-36b4-450e-ae25-8587117bcc27 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:19.752448 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc66bdf-36b4-450e-ae25-8587117bcc27 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:19.752448 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc66bdf-36b4-450e-ae25-8587117bcc27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:19.797660 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 874/1728] 10.222.0.65 () {58 vars in 1018 bytes} [Tue May 10 03:19:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:19:19.798441 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-0dc66bdf-36b4-450e-ae25-8587117bcc27 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:19.799099 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec21da2-2926-4b91-a74a-cb4e459ce2e5 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:19.799386 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec21da2-2926-4b91-a74a-cb4e459ce2e5 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:19.799663 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec21da2-2926-4b91-a74a-cb4e459ce2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:19.801511 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-0dc66bdf-36b4-450e-ae25-8587117bcc27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:19.828085 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-3ec21da2-2926-4b91-a74a-cb4e459ce2e5 None None] MFA Rules not processed for user `9dff947a164641e7b32c639bebbffe36`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:19.830159 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-3ec21da2-2926-4b91-a74a-cb4e459ce2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:19.940036 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 875/1729] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:19:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:19:19.954837 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 855/1730] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:19:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:19:19.993173 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec21da2-2926-4b91-a74a-cb4e459ce2e5 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:19.997989 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-3ec21da2-2926-4b91-a74a-cb4e459ce2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:20.018101 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d43484-0aac-4def-8650-d98d94f7b1f6 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:20.018625 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d43484-0aac-4def-8650-d98d94f7b1f6 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:20.019095 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d43484-0aac-4def-8650-d98d94f7b1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:20.128720 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-59d43484-0aac-4def-8650-d98d94f7b1f6 None None] MFA Rules not processed for user `e309fb66a98b407d8b7533207e6a6dfc`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:20.131291 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-59d43484-0aac-4def-8650-d98d94f7b1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:20.167865 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec21da2-2926-4b91-a74a-cb4e459ce2e5 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:20.174437 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331b755-f3bc-443c-93aa-e41d92e3e24b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:20.175392 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331b755-f3bc-443c-93aa-e41d92e3e24b service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:20.176267 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331b755-f3bc-443c-93aa-e41d92e3e24b service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:20.176768 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331b755-f3bc-443c-93aa-e41d92e3e24b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:20.213447 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0331b755-f3bc-443c-93aa-e41d92e3e24b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:20.215536 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0331b755-f3bc-443c-93aa-e41d92e3e24b service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:20.265890 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 876/1731] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:19:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:19:20.267041 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331b755-f3bc-443c-93aa-e41d92e3e24b service neutron] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:20.270632 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-0331b755-f3bc-443c-93aa-e41d92e3e24b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:20.276222 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 856/1732] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:19:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:19:20.277338 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d43484-0aac-4def-8650-d98d94f7b1f6 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:20.278914 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-59d43484-0aac-4def-8650-d98d94f7b1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:20.349289 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d43484-0aac-4def-8650-d98d94f7b1f6 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:20.355573 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b387b950-aa58-48d4-a4c9-7e50960b7a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:20.356555 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387b950-aa58-48d4-a4c9-7e50960b7a19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:20.356794 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387b950-aa58-48d4-a4c9-7e50960b7a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:20.357075 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387b950-aa58-48d4-a4c9-7e50960b7a19 admin admin] PATH_INFO: `/v3/projects/dc5ada9a861543459f206ef69a9b34ed` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:20.358300 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b387b950-aa58-48d4-a4c9-7e50960b7a19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc5ada9a861543459f206ef69a9b34ed)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:20.360258 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b387b950-aa58-48d4-a4c9-7e50960b7a19 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:20.508231 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331b755-f3bc-443c-93aa-e41d92e3e24b service neutron] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:20.517052 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f387b3d0-3642-49ca-a412-eaa918471305 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b7ccdccba0b4f9e86817946f22dbe28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:20.518252 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387b3d0-3642-49ca-a412-eaa918471305 service nova] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:20.518252 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387b3d0-3642-49ca-a412-eaa918471305 service nova] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:20.518640 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387b3d0-3642-49ca-a412-eaa918471305 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:20.531446 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f387b3d0-3642-49ca-a412-eaa918471305 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:20.533396 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f387b3d0-3642-49ca-a412-eaa918471305 service nova] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:20.551841 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 877/1733] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:19:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:19:20.553497 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b4efe-0af6-4a80-84cc-d6e6be00eeeb None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:20.553790 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b4efe-0af6-4a80-84cc-d6e6be00eeeb None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:20.554079 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b4efe-0af6-4a80-84cc-d6e6be00eeeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:20.585361 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-b387b950-aa58-48d4-a4c9-7e50960b7a19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc5ada9a861543459f206ef69a9b34ed', 'request_id': 'req-b387b950-aa58-48d4-a4c9-7e50960b7a19'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:20.585633 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-5a3b4efe-0af6-4a80-84cc-d6e6be00eeeb None None] MFA Rules not processed for user `e309fb66a98b407d8b7533207e6a6dfc`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:20.587022 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-5a3b4efe-0af6-4a80-84cc-d6e6be00eeeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:20.629608 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-b387b950-aa58-48d4-a4c9-7e50960b7a19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc5ada9a861543459f206ef69a9b34ed', 'request_id': 'req-b387b950-aa58-48d4-a4c9-7e50960b7a19'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:20.651647 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-b387b950-aa58-48d4-a4c9-7e50960b7a19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc5ada9a861543459f206ef69a9b34ed', 'request_id': 'req-b387b950-aa58-48d4-a4c9-7e50960b7a19'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:20.753900 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-b387b950-aa58-48d4-a4c9-7e50960b7a19 admin admin] The token cache is being invalidate because project dc5ada9a861543459f206ef69a9b34ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:19:20.755077 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-b387b950-aa58-48d4-a4c9-7e50960b7a19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:20.755463 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-b387b950-aa58-48d4-a4c9-7e50960b7a19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:20.765279 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 878/1735] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:19:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:19:20.765279 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660502e-a20a-4f3b-b557-dddd39005195 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:20.765279 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660502e-a20a-4f3b-b557-dddd39005195 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:20.765279 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660502e-a20a-4f3b-b557-dddd39005195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:20.765653 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 857/1735] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:19:20 2022] DELETE /identity/v3/projects/dc5ada9a861543459f206ef69a9b34ed => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:19:20.797739 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b387b950-aa58-48d4-a4c9-7e50960b7a19 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:20.799199 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-b387b950-aa58-48d4-a4c9-7e50960b7a19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:20.855511 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-1660502e-a20a-4f3b-b557-dddd39005195 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:20.858769 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-1660502e-a20a-4f3b-b557-dddd39005195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:21.070573 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b387b950-aa58-48d4-a4c9-7e50960b7a19 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:21.079366 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 879/1736] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:19:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:19:21.089092 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408e0c2-4834-4cb0-af06-3a8611e32b56 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:21.089329 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408e0c2-4834-4cb0-af06-3a8611e32b56 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:21.089582 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408e0c2-4834-4cb0-af06-3a8611e32b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:21.104124 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3383f75b-6d40-4af1-81fe-9d61a7ba55a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b7ccdccba0b4f9e86817946f22dbe28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:21.104893 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3383f75b-6d40-4af1-81fe-9d61a7ba55a9 service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:21.105258 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3383f75b-6d40-4af1-81fe-9d61a7ba55a9 service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:21.105511 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3383f75b-6d40-4af1-81fe-9d61a7ba55a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:21.107760 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-3383f75b-6d40-4af1-81fe-9d61a7ba55a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:21.128846 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3383f75b-6d40-4af1-81fe-9d61a7ba55a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:21.135018 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3383f75b-6d40-4af1-81fe-9d61a7ba55a9 service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:21.143772 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-9408e0c2-4834-4cb0-af06-3a8611e32b56 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:21.146373 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-9408e0c2-4834-4cb0-af06-3a8611e32b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:21.170729 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 880/1737] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:19:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:19:21.172082 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9408e0c2-4834-4cb0-af06-3a8611e32b56 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:21.175412 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 858/1738] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:19:20 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:19:21.192256 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9408e0c2-4834-4cb0-af06-3a8611e32b56 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:21.205452 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c86b2-c7fa-4e04-bc80-e38df28c53f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:21.206495 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c86b2-c7fa-4e04-bc80-e38df28c53f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:21.206886 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c86b2-c7fa-4e04-bc80-e38df28c53f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:21.207287 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c86b2-c7fa-4e04-bc80-e38df28c53f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:21.208176 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03c86b2-c7fa-4e04-bc80-e38df28c53f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:19:21.208591 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03c86b2-c7fa-4e04-bc80-e38df28c53f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:21.213024 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03c86b2-c7fa-4e04-bc80-e38df28c53f9 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:21.260203 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 881/1739] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 10 03:19:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:19:21.264346 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3383f75b-6d40-4af1-81fe-9d61a7ba55a9 service nova] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:21.305356 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3383f75b-6d40-4af1-81fe-9d61a7ba55a9 service nova] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:21.321287 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed973cdc-21f1-4ac5-a8bd-02ef4e1654ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:21.322216 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed973cdc-21f1-4ac5-a8bd-02ef4e1654ef admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:21.322643 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed973cdc-21f1-4ac5-a8bd-02ef4e1654ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:21.323059 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed973cdc-21f1-4ac5-a8bd-02ef4e1654ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:21.324154 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed973cdc-21f1-4ac5-a8bd-02ef4e1654ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:21.326601 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed973cdc-21f1-4ac5-a8bd-02ef4e1654ef admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:21.448740 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 859/1740] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:19:21 2022] POST /identity/v3/projects => generated 369 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:19:21.452657 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c86b2-c7fa-4e04-bc80-e38df28c53f9 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:21.470482 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c86b2-c7fa-4e04-bc80-e38df28c53f9 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:21.579266 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda0918-cd0c-4dfa-b97c-38cd713cb7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:21.580304 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda0918-cd0c-4dfa-b97c-38cd713cb7df admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:21.581103 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda0918-cd0c-4dfa-b97c-38cd713cb7df admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:21.581598 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda0918-cd0c-4dfa-b97c-38cd713cb7df admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:21.583508 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eda0918-cd0c-4dfa-b97c-38cd713cb7df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:21.586284 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eda0918-cd0c-4dfa-b97c-38cd713cb7df admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:21.713180 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 882/1741] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:19:21 2022] POST /identity/v3/users => generated 285 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:19:21.716851 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed973cdc-21f1-4ac5-a8bd-02ef4e1654ef admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:21.734267 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed973cdc-21f1-4ac5-a8bd-02ef4e1654ef admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:21.746793 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb95bc-5ea0-4453-9e30-43f0abd3ca2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:21.749081 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb95bc-5ea0-4453-9e30-43f0abd3ca2a admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:21.752569 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb95bc-5ea0-4453-9e30-43f0abd3ca2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:21.753483 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb95bc-5ea0-4453-9e30-43f0abd3ca2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:21.755969 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb95bc-5ea0-4453-9e30-43f0abd3ca2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:21.765020 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb95bc-5ea0-4453-9e30-43f0abd3ca2a admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:21.797875 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 860/1742] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:19:21 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:19:21.803034 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda0918-cd0c-4dfa-b97c-38cd713cb7df admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:21.825382 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda0918-cd0c-4dfa-b97c-38cd713cb7df admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:21.842064 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80efc900-f2fe-458c-96ef-b91a83b96cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:21.843218 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80efc900-f2fe-458c-96ef-b91a83b96cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:21.844560 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80efc900-f2fe-458c-96ef-b91a83b96cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:21.845875 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80efc900-f2fe-458c-96ef-b91a83b96cb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:21.848036 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80efc900-f2fe-458c-96ef-b91a83b96cb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:21.851383 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80efc900-f2fe-458c-96ef-b91a83b96cb4 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:21.915477 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 883/1743] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:19:21 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:19:21.919255 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb95bc-5ea0-4453-9e30-43f0abd3ca2a admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:21.934348 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb95bc-5ea0-4453-9e30-43f0abd3ca2a admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:21.966707 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c14d5f-78e9-4746-ac43-8ad39a7c395d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:21.970884 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c14d5f-78e9-4746-ac43-8ad39a7c395d admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:21.971172 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c14d5f-78e9-4746-ac43-8ad39a7c395d admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:21.974110 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c14d5f-78e9-4746-ac43-8ad39a7c395d admin admin] PATH_INFO: `/v3/projects/a9fc493f638644758a860e327ab59c95/users/379c78f5bc8e444783b93d87cfbccbb1/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:22.042282 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c14d5f-78e9-4746-ac43-8ad39a7c395d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9fc493f638644758a860e327ab59c95, user_id=379c78f5bc8e444783b93d87cfbccbb1, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:22.046305 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c14d5f-78e9-4746-ac43-8ad39a7c395d admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:22.125741 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84be8db-58e8-4249-a78a-2c4d87b1a172 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:22.126062 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84be8db-58e8-4249-a78a-2c4d87b1a172 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:22.126311 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84be8db-58e8-4249-a78a-2c4d87b1a172 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:22.128304 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 884/1744] 10.222.0.65 () {54 vars in 912 bytes} [Tue May 10 03:19:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:19:22.138499 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9c909-47e9-4c06-ba47-e8b91ea78624 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:22.139130 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9c909-47e9-4c06-ba47-e8b91ea78624 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:22.139509 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9c909-47e9-4c06-ba47-e8b91ea78624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:22.167151 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 861/1745] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:19:21 2022] PUT /identity/v3/projects/a9fc493f638644758a860e327ab59c95/users/379c78f5bc8e444783b93d87cfbccbb1/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:19:22.178018 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea9c0a8-63be-46c8-996d-819061a28f39 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:22.179272 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea9c0a8-63be-46c8-996d-819061a28f39 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:22.179885 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea9c0a8-63be-46c8-996d-819061a28f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:22.213177 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-3cb9c909-47e9-4c06-ba47-e8b91ea78624 None None] MFA Rules not processed for user `ccfba74826234915bc989fede9bde3e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:22.221858 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-3cb9c909-47e9-4c06-ba47-e8b91ea78624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:22.239706 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-8ea9c0a8-63be-46c8-996d-819061a28f39 None None] MFA Rules not processed for user `379c78f5bc8e444783b93d87cfbccbb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:22.242564 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-8ea9c0a8-63be-46c8-996d-819061a28f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:22.466076 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 885/1746] 10.222.0.65 () {58 vars in 1009 bytes} [Tue May 10 03:19:22 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:19:22.469277 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb9c909-47e9-4c06-ba47-e8b91ea78624 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:22.478063 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-3cb9c909-47e9-4c06-ba47-e8b91ea78624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:22.547821 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 862/1747] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:19:22 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:19:22.549260 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea9c0a8-63be-46c8-996d-819061a28f39 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:22.624675 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb9c909-47e9-4c06-ba47-e8b91ea78624 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:22.634355 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f1086-c115-4b2b-affa-aa7aaa19839b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:22.635583 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f1086-c115-4b2b-affa-aa7aaa19839b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:22.637858 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f1086-c115-4b2b-affa-aa7aaa19839b admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:22.638375 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f1086-c115-4b2b-affa-aa7aaa19839b admin admin] PATH_INFO: `/v3/projects/ae801ca20a8249f2b505c3e9e07a4ffc` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:22.640187 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877f1086-c115-4b2b-affa-aa7aaa19839b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae801ca20a8249f2b505c3e9e07a4ffc)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:22.646183 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877f1086-c115-4b2b-affa-aa7aaa19839b admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:22.781170 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea9c0a8-63be-46c8-996d-819061a28f39 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:22.796446 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d73efa6-5b5b-4ff5-abf8-03f81c104d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:22.797328 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73efa6-5b5b-4ff5-abf8-03f81c104d9c admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:22.798186 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73efa6-5b5b-4ff5-abf8-03f81c104d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:22.798647 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73efa6-5b5b-4ff5-abf8-03f81c104d9c admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:22.799584 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d73efa6-5b5b-4ff5-abf8-03f81c104d9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:22.803855 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d73efa6-5b5b-4ff5-abf8-03f81c104d9c admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:22.864711 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-877f1086-c115-4b2b-affa-aa7aaa19839b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae801ca20a8249f2b505c3e9e07a4ffc', 'request_id': 'req-877f1086-c115-4b2b-affa-aa7aaa19839b'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:22.874827 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-877f1086-c115-4b2b-affa-aa7aaa19839b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae801ca20a8249f2b505c3e9e07a4ffc', 'request_id': 'req-877f1086-c115-4b2b-affa-aa7aaa19839b'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:22.885183 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-877f1086-c115-4b2b-affa-aa7aaa19839b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae801ca20a8249f2b505c3e9e07a4ffc', 'request_id': 'req-877f1086-c115-4b2b-affa-aa7aaa19839b'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:22.952818 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 863/1748] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:19:22 2022] POST /identity/v3/projects => generated 369 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:19:22.954185 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d73efa6-5b5b-4ff5-abf8-03f81c104d9c admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:22.959010 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-1d73efa6-5b5b-4ff5-abf8-03f81c104d9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:22.985974 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-877f1086-c115-4b2b-affa-aa7aaa19839b admin admin] The token cache is being invalidate because project ae801ca20a8249f2b505c3e9e07a4ffc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:19:22.987298 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-877f1086-c115-4b2b-affa-aa7aaa19839b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:22.989996 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-877f1086-c115-4b2b-affa-aa7aaa19839b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:22.994627 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 886/1749] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:19:22 2022] DELETE /identity/v3/projects/ae801ca20a8249f2b505c3e9e07a4ffc => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:19:22.995895 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f1086-c115-4b2b-affa-aa7aaa19839b admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:22.997913 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-877f1086-c115-4b2b-affa-aa7aaa19839b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:23.033761 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d73efa6-5b5b-4ff5-abf8-03f81c104d9c admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:23.037849 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898d353c-ed95-455f-8272-2cd7f9ab03d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:23.038521 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d353c-ed95-455f-8272-2cd7f9ab03d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:23.038803 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d353c-ed95-455f-8272-2cd7f9ab03d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:23.039079 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d353c-ed95-455f-8272-2cd7f9ab03d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:23.043132 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-898d353c-ed95-455f-8272-2cd7f9ab03d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:23.069845 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898d353c-ed95-455f-8272-2cd7f9ab03d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:23.071868 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898d353c-ed95-455f-8272-2cd7f9ab03d9 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:23.082308 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 864/1750] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:19:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:19:23.082731 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898d353c-ed95-455f-8272-2cd7f9ab03d9 service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:23.084204 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-898d353c-ed95-455f-8272-2cd7f9ab03d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:23.185552 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f1086-c115-4b2b-affa-aa7aaa19839b admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:23.216822 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898d353c-ed95-455f-8272-2cd7f9ab03d9 service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:23.218611 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29996736-a266-4b9b-b83e-88e409876a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:23.219322 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29996736-a266-4b9b-b83e-88e409876a1c admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:23.220758 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29996736-a266-4b9b-b83e-88e409876a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:23.221055 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29996736-a266-4b9b-b83e-88e409876a1c admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:23.230867 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29996736-a266-4b9b-b83e-88e409876a1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:23.236178 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29996736-a266-4b9b-b83e-88e409876a1c admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:23.238567 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e232b9-ebed-44dc-9854-1010061c5afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:23.239692 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e232b9-ebed-44dc-9854-1010061c5afb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:23.241780 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e232b9-ebed-44dc-9854-1010061c5afb admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:23.242248 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e232b9-ebed-44dc-9854-1010061c5afb admin admin] PATH_INFO: `/v3/users/fc00b2e995bf4615af5d5d7e4a759155` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:23.247183 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e232b9-ebed-44dc-9854-1010061c5afb admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc00b2e995bf4615af5d5d7e4a759155)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:23.253972 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e232b9-ebed-44dc-9854-1010061c5afb admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:23.413489 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 887/1751] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:19:22 2022] POST /identity/v3/users => generated 291 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:19:23.413489 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57dc933-3254-4827-9d55-851bdf6351ec None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:23.415937 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57dc933-3254-4827-9d55-851bdf6351ec None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:23.416412 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57dc933-3254-4827-9d55-851bdf6351ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:23.491989 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-b57dc933-3254-4827-9d55-851bdf6351ec None None] MFA Rules not processed for user `a14e317d371c4f9f994a568798c00e90`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:23.493440 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-b57dc933-3254-4827-9d55-851bdf6351ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:23.585130 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-b1e232b9-ebed-44dc-9854-1010061c5afb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc00b2e995bf4615af5d5d7e4a759155'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:23.586232 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-b1e232b9-ebed-44dc-9854-1010061c5afb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc00b2e995bf4615af5d5d7e4a759155'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:23.595744 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 888/1752] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:19:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:19:23.597497 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f61a21-93b5-4cb3-a39a-79eba7e22f2e None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:23.597860 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f61a21-93b5-4cb3-a39a-79eba7e22f2e None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:23.598575 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f61a21-93b5-4cb3-a39a-79eba7e22f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:23.619267 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-b1e232b9-ebed-44dc-9854-1010061c5afb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc00b2e995bf4615af5d5d7e4a759155'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:23.645749 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-45f61a21-93b5-4cb3-a39a-79eba7e22f2e None None] MFA Rules not processed for user `9407e88fdbd74ba196ffd9fd221e15f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:23.647395 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-45f61a21-93b5-4cb3-a39a-79eba7e22f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:23.730048 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-b1e232b9-ebed-44dc-9854-1010061c5afb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc00b2e995bf4615af5d5d7e4a759155'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:23.731034 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-b1e232b9-ebed-44dc-9854-1010061c5afb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc00b2e995bf4615af5d5d7e4a759155'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:23.759701 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 889/1753] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:19:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:19:23.762565 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f61a21-93b5-4cb3-a39a-79eba7e22f2e None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:23.783243 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 865/1754] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:19:23 2022] DELETE /identity/v3/users/fc00b2e995bf4615af5d5d7e4a759155 => generated 0 bytes in 691 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:19:23.787654 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f61a21-93b5-4cb3-a39a-79eba7e22f2e None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:23.874032 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a2869-4f71-4571-8062-57fc9c14fa4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:23.874709 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a2869-4f71-4571-8062-57fc9c14fa4e admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:23.875055 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a2869-4f71-4571-8062-57fc9c14fa4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:23.875334 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a2869-4f71-4571-8062-57fc9c14fa4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:23.876401 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32a2869-4f71-4571-8062-57fc9c14fa4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:23.878967 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32a2869-4f71-4571-8062-57fc9c14fa4e admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:23.892342 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 890/1755] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:19:23 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:19:23.896518 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e232b9-ebed-44dc-9854-1010061c5afb admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:23.898048 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-b1e232b9-ebed-44dc-9854-1010061c5afb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:23.915610 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e232b9-ebed-44dc-9854-1010061c5afb admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:23.924245 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321de10-c23b-4b86-abf3-c8e93d2232b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:23.925112 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321de10-c23b-4b86-abf3-c8e93d2232b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:23.925402 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321de10-c23b-4b86-abf3-c8e93d2232b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:23.925723 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321de10-c23b-4b86-abf3-c8e93d2232b9 admin admin] PATH_INFO: `/v3/projects/20c0707768f54a41a2c825f528104cd6/users/6652ed0369dc4e828bcfd9afddac5283/roles/43105000610f402ca2486e7648018cca` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:23.960176 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1321de10-c23b-4b86-abf3-c8e93d2232b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20c0707768f54a41a2c825f528104cd6, user_id=6652ed0369dc4e828bcfd9afddac5283, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:23.964533 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1321de10-c23b-4b86-abf3-c8e93d2232b9 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:24.065326 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 866/1756] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:19:23 2022] PUT /identity/v3/projects/20c0707768f54a41a2c825f528104cd6/users/6652ed0369dc4e828bcfd9afddac5283/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:19:24.069334 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a2869-4f71-4571-8062-57fc9c14fa4e admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:24.084803 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a2869-4f71-4571-8062-57fc9c14fa4e admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:24.212291 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b8cf56-8a3d-44ba-a710-eb63f9403a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:24.213917 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b8cf56-8a3d-44ba-a710-eb63f9403a44 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:24.214402 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b8cf56-8a3d-44ba-a710-eb63f9403a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:24.214864 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b8cf56-8a3d-44ba-a710-eb63f9403a44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:24.215940 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b8cf56-8a3d-44ba-a710-eb63f9403a44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:24.217769 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b8cf56-8a3d-44ba-a710-eb63f9403a44 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:24.245857 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 891/1757] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:19:24 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:19:24.245958 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321de10-c23b-4b86-abf3-c8e93d2232b9 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:24.270665 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321de10-c23b-4b86-abf3-c8e93d2232b9 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:24.284707 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b667bc3e-4f5a-45e1-ac6c-16bec93e4fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:24.287128 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667bc3e-4f5a-45e1-ac6c-16bec93e4fa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:24.287886 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667bc3e-4f5a-45e1-ac6c-16bec93e4fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:24.288299 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667bc3e-4f5a-45e1-ac6c-16bec93e4fa3 admin admin] PATH_INFO: `/v3/projects/20c0707768f54a41a2c825f528104cd6/users/6652ed0369dc4e828bcfd9afddac5283/roles/43105000610f402ca2486e7648018cca` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:24.292253 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b667bc3e-4f5a-45e1-ac6c-16bec93e4fa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20c0707768f54a41a2c825f528104cd6, user_id=6652ed0369dc4e828bcfd9afddac5283, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:24.295136 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b667bc3e-4f5a-45e1-ac6c-16bec93e4fa3 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:24.338472 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 867/1758] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:19:24 2022] PUT /identity/v3/projects/20c0707768f54a41a2c825f528104cd6/users/6652ed0369dc4e828bcfd9afddac5283/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:19:24.354232 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d0d6a-4b77-448d-a26d-808c760cef7a None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:24.354531 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d0d6a-4b77-448d-a26d-808c760cef7a None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:24.354808 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d0d6a-4b77-448d-a26d-808c760cef7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:24.433965 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-458d0d6a-4b77-448d-a26d-808c760cef7a None None] MFA Rules not processed for user `6652ed0369dc4e828bcfd9afddac5283`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:24.435342 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-458d0d6a-4b77-448d-a26d-808c760cef7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:24.558788 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 892/1759] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:19:24 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:19:24.575008 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b667bc3e-4f5a-45e1-ac6c-16bec93e4fa3 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:24.577985 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-b667bc3e-4f5a-45e1-ac6c-16bec93e4fa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:24.773220 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b667bc3e-4f5a-45e1-ac6c-16bec93e4fa3 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:24.790136 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982ece7-9a5f-46a4-9b40-53d79f79fcf9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:24.791440 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982ece7-9a5f-46a4-9b40-53d79f79fcf9 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:24.792445 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982ece7-9a5f-46a4-9b40-53d79f79fcf9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:24.792852 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982ece7-9a5f-46a4-9b40-53d79f79fcf9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:24.818964 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4982ece7-9a5f-46a4-9b40-53d79f79fcf9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:24.820798 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4982ece7-9a5f-46a4-9b40-53d79f79fcf9 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:24.845554 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 868/1760] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:19:24 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:19:25.117848 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458d0d6a-4b77-448d-a26d-808c760cef7a None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:25.120757 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-458d0d6a-4b77-448d-a26d-808c760cef7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:25.316482 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458d0d6a-4b77-448d-a26d-808c760cef7a None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:25.329293 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab42728-879a-45f7-8090-80d372a34665 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b7ccdccba0b4f9e86817946f22dbe28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:25.330816 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab42728-879a-45f7-8090-80d372a34665 service nova] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:25.331401 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab42728-879a-45f7-8090-80d372a34665 service nova] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:25.332052 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab42728-879a-45f7-8090-80d372a34665 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:25.337407 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-8ab42728-879a-45f7-8090-80d372a34665 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:25.375603 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982ece7-9a5f-46a4-9b40-53d79f79fcf9 service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:25.377226 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-4982ece7-9a5f-46a4-9b40-53d79f79fcf9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:25.443609 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab42728-879a-45f7-8090-80d372a34665 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:25.448444 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab42728-879a-45f7-8090-80d372a34665 service nova] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:25.478619 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 893/1761] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:19:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:19:25.583170 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982ece7-9a5f-46a4-9b40-53d79f79fcf9 service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:25.605020 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c7a97-6655-4564-b50a-0ebb66e38eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:25.605967 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c7a97-6655-4564-b50a-0ebb66e38eca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:25.606253 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c7a97-6655-4564-b50a-0ebb66e38eca admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:25.606513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c7a97-6655-4564-b50a-0ebb66e38eca admin admin] PATH_INFO: `/v3/projects/eab985b4f7474f449b0ae0634bcf3b18` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:25.610360 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7c7a97-6655-4564-b50a-0ebb66e38eca admin admin] RBAC: Authorizing `identity:delete_project(project_id=eab985b4f7474f449b0ae0634bcf3b18)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:25.620050 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7c7a97-6655-4564-b50a-0ebb66e38eca admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:25.805903 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-1b7c7a97-6655-4564-b50a-0ebb66e38eca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eab985b4f7474f449b0ae0634bcf3b18', 'request_id': 'req-1b7c7a97-6655-4564-b50a-0ebb66e38eca'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:25.830369 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-1b7c7a97-6655-4564-b50a-0ebb66e38eca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eab985b4f7474f449b0ae0634bcf3b18', 'request_id': 'req-1b7c7a97-6655-4564-b50a-0ebb66e38eca'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:25.858270 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-1b7c7a97-6655-4564-b50a-0ebb66e38eca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eab985b4f7474f449b0ae0634bcf3b18', 'request_id': 'req-1b7c7a97-6655-4564-b50a-0ebb66e38eca'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:25.941811 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8feee-6b51-4ce0-9a69-3b084dd8190e None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:25.942113 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8feee-6b51-4ce0-9a69-3b084dd8190e None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:25.942393 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8feee-6b51-4ce0-9a69-3b084dd8190e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:25.974216 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-1b7c7a97-6655-4564-b50a-0ebb66e38eca admin admin] The token cache is being invalidate because project eab985b4f7474f449b0ae0634bcf3b18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:19:25.975974 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-1b7c7a97-6655-4564-b50a-0ebb66e38eca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:25.977956 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-1b7c7a97-6655-4564-b50a-0ebb66e38eca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:25.978370 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-17d8feee-6b51-4ce0-9a69-3b084dd8190e None None] MFA Rules not processed for user `e309fb66a98b407d8b7533207e6a6dfc`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:25.980282 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-17d8feee-6b51-4ce0-9a69-3b084dd8190e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:25.983553 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 869/1762] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:19:25 2022] DELETE /identity/v3/projects/eab985b4f7474f449b0ae0634bcf3b18 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:19:25.991359 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ffe5a-ab2d-418b-b04d-f63d3aa4fd68 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:25.998190 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ffe5a-ab2d-418b-b04d-f63d3aa4fd68 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:26.001748 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ffe5a-ab2d-418b-b04d-f63d3aa4fd68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:26.052437 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-949ffe5a-ab2d-418b-b04d-f63d3aa4fd68 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:26.053979 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-949ffe5a-ab2d-418b-b04d-f63d3aa4fd68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:26.165329 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 894/1763] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:19:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:19:26.189146 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 870/1764] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:19:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:19:26.198313 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3004c3-73d8-454b-9440-1758b53aea49 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:26.198774 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3004c3-73d8-454b-9440-1758b53aea49 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:26.199063 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3004c3-73d8-454b-9440-1758b53aea49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:26.243367 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-7a3004c3-73d8-454b-9440-1758b53aea49 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:26.246019 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-7a3004c3-73d8-454b-9440-1758b53aea49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:26.256042 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 895/1765] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:19:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:19:26.261071 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ffe5a-ab2d-418b-b04d-f63d3aa4fd68 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:26.272643 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ffe5a-ab2d-418b-b04d-f63d3aa4fd68 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:26.287129 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e61206c-a7fe-467f-a77b-af1325ce0069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:26.288357 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61206c-a7fe-467f-a77b-af1325ce0069 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:26.289133 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61206c-a7fe-467f-a77b-af1325ce0069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:26.290517 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61206c-a7fe-467f-a77b-af1325ce0069 admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:26.291438 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e61206c-a7fe-467f-a77b-af1325ce0069 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:19:26.291921 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e61206c-a7fe-467f-a77b-af1325ce0069 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:26.298849 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e61206c-a7fe-467f-a77b-af1325ce0069 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:26.318977 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 871/1766] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 10 03:19:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:19:26.324832 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3004c3-73d8-454b-9440-1758b53aea49 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:26.345570 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3004c3-73d8-454b-9440-1758b53aea49 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:26.356250 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5aca8-0f20-40b6-bfa2-1cf9baf85ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:26.357519 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5aca8-0f20-40b6-bfa2-1cf9baf85ac8 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:26.358728 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5aca8-0f20-40b6-bfa2-1cf9baf85ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:26.359209 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5aca8-0f20-40b6-bfa2-1cf9baf85ac8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:26.360699 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d5aca8-0f20-40b6-bfa2-1cf9baf85ac8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:26.388218 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d5aca8-0f20-40b6-bfa2-1cf9baf85ac8 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:26.570390 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 896/1767] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:19:26 2022] POST /identity/v3/projects => generated 379 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:19:26.575135 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e61206c-a7fe-467f-a77b-af1325ce0069 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:26.597394 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e61206c-a7fe-467f-a77b-af1325ce0069 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:26.907403 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e4a79-5944-4a9a-8efc-3b4e8adb70e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:26.908153 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e4a79-5944-4a9a-8efc-3b4e8adb70e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:26.908674 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e4a79-5944-4a9a-8efc-3b4e8adb70e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:26.909062 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e4a79-5944-4a9a-8efc-3b4e8adb70e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:26.909874 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198e4a79-5944-4a9a-8efc-3b4e8adb70e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:26.912870 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198e4a79-5944-4a9a-8efc-3b4e8adb70e3 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:27.115991 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5aca8-0f20-40b6-bfa2-1cf9baf85ac8 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:27.116136 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 872/1768] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:19:26 2022] POST /identity/v3/users => generated 290 bytes in 541 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:19:27.153521 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5aca8-0f20-40b6-bfa2-1cf9baf85ac8 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:27.170189 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f28e0-0a2e-421b-b74f-03063275b5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:27.171935 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f28e0-0a2e-421b-b74f-03063275b5dd admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:27.172479 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f28e0-0a2e-421b-b74f-03063275b5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:27.172928 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f28e0-0a2e-421b-b74f-03063275b5dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:27.176622 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34f28e0-0a2e-421b-b74f-03063275b5dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:27.179593 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34f28e0-0a2e-421b-b74f-03063275b5dd admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:27.218502 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 897/1769] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:19:27 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:19:27.224072 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e4a79-5944-4a9a-8efc-3b4e8adb70e3 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:27.239363 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e4a79-5944-4a9a-8efc-3b4e8adb70e3 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:27.249967 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b95d3e-89c2-43d4-9938-a9dd4f99b063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:27.251012 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b95d3e-89c2-43d4-9938-a9dd4f99b063 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:27.251492 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b95d3e-89c2-43d4-9938-a9dd4f99b063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:27.251767 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b95d3e-89c2-43d4-9938-a9dd4f99b063 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:27.252607 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b95d3e-89c2-43d4-9938-a9dd4f99b063 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:27.254282 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b95d3e-89c2-43d4-9938-a9dd4f99b063 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:27.287099 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 873/1770] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:19:27 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:19:27.294242 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f28e0-0a2e-421b-b74f-03063275b5dd admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:27.319128 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f28e0-0a2e-421b-b74f-03063275b5dd admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:27.338214 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480525d3-5c7c-421f-91d3-12a7b03a6233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:27.339610 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480525d3-5c7c-421f-91d3-12a7b03a6233 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:27.343385 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480525d3-5c7c-421f-91d3-12a7b03a6233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:27.345267 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480525d3-5c7c-421f-91d3-12a7b03a6233 admin admin] PATH_INFO: `/v3/projects/d88fe4a05ee5423d943d2b6c32efc6fe/users/7200652ebe9f4efea8f06746e7cada9d/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:27.365278 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480525d3-5c7c-421f-91d3-12a7b03a6233 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d88fe4a05ee5423d943d2b6c32efc6fe, user_id=7200652ebe9f4efea8f06746e7cada9d, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:27.368502 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480525d3-5c7c-421f-91d3-12a7b03a6233 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:28.171431 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 898/1771] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:19:27 2022] PUT /identity/v3/projects/d88fe4a05ee5423d943d2b6c32efc6fe/users/7200652ebe9f4efea8f06746e7cada9d/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 870 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:19:28.174660 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a7f67-97f8-46d5-908c-f229c75f14ce None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:28.175213 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a7f67-97f8-46d5-908c-f229c75f14ce None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:28.175352 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a7f67-97f8-46d5-908c-f229c75f14ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:28.224534 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-217a7f67-97f8-46d5-908c-f229c75f14ce None None] MFA Rules not processed for user `7200652ebe9f4efea8f06746e7cada9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:28.226795 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-217a7f67-97f8-46d5-908c-f229c75f14ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:28.369570 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 874/1772] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:19:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:19:28.374012 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480525d3-5c7c-421f-91d3-12a7b03a6233 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:28.470287 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480525d3-5c7c-421f-91d3-12a7b03a6233 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:28.482158 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed388d3b-76e1-40a1-aab4-efd47d1ee99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:28.482158 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed388d3b-76e1-40a1-aab4-efd47d1ee99f admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:28.482158 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed388d3b-76e1-40a1-aab4-efd47d1ee99f admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:28.482158 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed388d3b-76e1-40a1-aab4-efd47d1ee99f admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:28.482424 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed388d3b-76e1-40a1-aab4-efd47d1ee99f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:28.482520 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed388d3b-76e1-40a1-aab4-efd47d1ee99f admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:28.623525 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 899/1773] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:19:28 2022] POST /identity/v3/projects => generated 379 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:19:28.627891 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217a7f67-97f8-46d5-908c-f229c75f14ce None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:28.647909 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217a7f67-97f8-46d5-908c-f229c75f14ce None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:28.789146 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f279a-2ad2-4fe6-8f49-1c6223905121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:28.791097 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f279a-2ad2-4fe6-8f49-1c6223905121 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:28.794996 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f279a-2ad2-4fe6-8f49-1c6223905121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:28.795475 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f279a-2ad2-4fe6-8f49-1c6223905121 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:28.797020 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64f279a-2ad2-4fe6-8f49-1c6223905121 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:28.804560 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64f279a-2ad2-4fe6-8f49-1c6223905121 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:28.954340 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 875/1774] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:19:28 2022] POST /identity/v3/users => generated 296 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:19:28.959557 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed388d3b-76e1-40a1-aab4-efd47d1ee99f admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:28.984112 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed388d3b-76e1-40a1-aab4-efd47d1ee99f admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:28.994991 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10559d55-1637-4046-a162-23b69059fce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:28.996411 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10559d55-1637-4046-a162-23b69059fce6 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:28.996701 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10559d55-1637-4046-a162-23b69059fce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:28.996984 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10559d55-1637-4046-a162-23b69059fce6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:28.997859 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10559d55-1637-4046-a162-23b69059fce6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:28.999487 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10559d55-1637-4046-a162-23b69059fce6 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:29.014925 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 900/1775] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:19:28 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:19:29.019029 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f279a-2ad2-4fe6-8f49-1c6223905121 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:29.033964 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f279a-2ad2-4fe6-8f49-1c6223905121 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:29.044215 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0539178d-e471-42d4-947d-312b9562fca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:29.045165 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0539178d-e471-42d4-947d-312b9562fca7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:29.045628 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0539178d-e471-42d4-947d-312b9562fca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:29.046072 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0539178d-e471-42d4-947d-312b9562fca7 admin admin] PATH_INFO: `/v3/projects/99960eea2b4048939c2d206038520ad4/users/2429da00c2494cd7852c71ae2aa4a411/roles/43105000610f402ca2486e7648018cca` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:29.067157 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0539178d-e471-42d4-947d-312b9562fca7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99960eea2b4048939c2d206038520ad4, user_id=2429da00c2494cd7852c71ae2aa4a411, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:29.070171 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0539178d-e471-42d4-947d-312b9562fca7 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:29.192681 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 876/1776] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:19:29 2022] PUT /identity/v3/projects/99960eea2b4048939c2d206038520ad4/users/2429da00c2494cd7852c71ae2aa4a411/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:19:29.197143 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10559d55-1637-4046-a162-23b69059fce6 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:29.207716 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10559d55-1637-4046-a162-23b69059fce6 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:29.382425 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec6be1-82eb-4ab3-9f87-cd812fcae315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:29.383697 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec6be1-82eb-4ab3-9f87-cd812fcae315 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:29.384768 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec6be1-82eb-4ab3-9f87-cd812fcae315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:29.385130 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec6be1-82eb-4ab3-9f87-cd812fcae315 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:29.385952 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ec6be1-82eb-4ab3-9f87-cd812fcae315 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:29.387963 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ec6be1-82eb-4ab3-9f87-cd812fcae315 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:29.402828 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 901/1777] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:19:29 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:19:29.406828 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0539178d-e471-42d4-947d-312b9562fca7 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:29.439792 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0539178d-e471-42d4-947d-312b9562fca7 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:29.456078 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e6b4a6-4254-4df6-bade-f50030cbb611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:29.457459 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6b4a6-4254-4df6-bade-f50030cbb611 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:29.458013 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6b4a6-4254-4df6-bade-f50030cbb611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:29.458475 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6b4a6-4254-4df6-bade-f50030cbb611 admin admin] PATH_INFO: `/v3/projects/99960eea2b4048939c2d206038520ad4/users/2429da00c2494cd7852c71ae2aa4a411/roles/43105000610f402ca2486e7648018cca` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:29.464801 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e6b4a6-4254-4df6-bade-f50030cbb611 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99960eea2b4048939c2d206038520ad4, user_id=2429da00c2494cd7852c71ae2aa4a411, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:29.476846 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e6b4a6-4254-4df6-bade-f50030cbb611 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:29.522269 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 877/1778] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:19:29 2022] PUT /identity/v3/projects/99960eea2b4048939c2d206038520ad4/users/2429da00c2494cd7852c71ae2aa4a411/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:19:29.535485 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626a5d6-15b0-4cef-8048-5646cce3193a None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:29.535774 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626a5d6-15b0-4cef-8048-5646cce3193a None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:29.536319 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626a5d6-15b0-4cef-8048-5646cce3193a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:29.588431 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-7626a5d6-15b0-4cef-8048-5646cce3193a None None] MFA Rules not processed for user `2429da00c2494cd7852c71ae2aa4a411`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:29.590032 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-7626a5d6-15b0-4cef-8048-5646cce3193a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:29.866129 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 902/1779] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:19:29 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:19:29.877172 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e6b4a6-4254-4df6-bade-f50030cbb611 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:29.880839 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-a8e6b4a6-4254-4df6-bade-f50030cbb611 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:30.026590 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e6b4a6-4254-4df6-bade-f50030cbb611 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:30.033243 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f28423-8e3f-42fb-9d00-e17d6dd01f3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:30.034558 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f28423-8e3f-42fb-9d00-e17d6dd01f3b service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:30.035658 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f28423-8e3f-42fb-9d00-e17d6dd01f3b service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:30.036122 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f28423-8e3f-42fb-9d00-e17d6dd01f3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:30.074303 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f28423-8e3f-42fb-9d00-e17d6dd01f3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:30.077920 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f28423-8e3f-42fb-9d00-e17d6dd01f3b service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:30.090522 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 878/1780] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:19:29 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:19:30.806993 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cf447-a671-4a63-8281-689b292cd60e None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:30.806993 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cf447-a671-4a63-8281-689b292cd60e None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:30.806993 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cf447-a671-4a63-8281-689b292cd60e None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:30.806993 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 903/1781] 10.222.0.65 () {54 vars in 921 bytes} [Tue May 10 03:19:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:19:30.922590 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b3ee0-304f-48d7-affe-e465b09876ad None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:30.923021 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b3ee0-304f-48d7-affe-e465b09876ad None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:30.923142 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b3ee0-304f-48d7-affe-e465b09876ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:30.956720 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-c67b3ee0-304f-48d7-affe-e465b09876ad None None] MFA Rules not processed for user `9b7ccdccba0b4f9e86817946f22dbe28`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:30.959434 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-c67b3ee0-304f-48d7-affe-e465b09876ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:31.174344 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 879/1782] 10.222.0.65 () {58 vars in 1018 bytes} [Tue May 10 03:19:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:19:31.215855 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2847b13-a83f-49fc-9606-e37024c65a4e None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:31.216185 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2847b13-a83f-49fc-9606-e37024c65a4e None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:31.216637 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2847b13-a83f-49fc-9606-e37024c65a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:31.245244 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-d2847b13-a83f-49fc-9606-e37024c65a4e None None] MFA Rules not processed for user `9407e88fdbd74ba196ffd9fd221e15f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:31.250711 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-d2847b13-a83f-49fc-9606-e37024c65a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:31.319589 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67b3ee0-304f-48d7-affe-e465b09876ad None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:31.322723 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-c67b3ee0-304f-48d7-affe-e465b09876ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:31.362948 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67b3ee0-304f-48d7-affe-e465b09876ad None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:31.390037 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7b834e-86d0-45ab-964d-ae76c96d5790 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b7ccdccba0b4f9e86817946f22dbe28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:31.391285 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b834e-86d0-45ab-964d-ae76c96d5790 service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:31.391582 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b834e-86d0-45ab-964d-ae76c96d5790 service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:31.393055 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b834e-86d0-45ab-964d-ae76c96d5790 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:31.408956 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7b834e-86d0-45ab-964d-ae76c96d5790 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:31.411437 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7b834e-86d0-45ab-964d-ae76c96d5790 service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:31.428189 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 880/1783] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:19:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:19:31.432982 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 904/1784] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:19:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:19:31.493974 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7b834e-86d0-45ab-964d-ae76c96d5790 service nova] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:31.587266 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7b834e-86d0-45ab-964d-ae76c96d5790 service nova] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:31.598950 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903cbb71-b1f0-4825-a539-354cc457f3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:31.600689 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903cbb71-b1f0-4825-a539-354cc457f3bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:31.600689 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903cbb71-b1f0-4825-a539-354cc457f3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:31.600689 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903cbb71-b1f0-4825-a539-354cc457f3bc admin admin] PATH_INFO: `/v3/users/7200652ebe9f4efea8f06746e7cada9d` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:31.602558 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903cbb71-b1f0-4825-a539-354cc457f3bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=7200652ebe9f4efea8f06746e7cada9d)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:31.604574 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903cbb71-b1f0-4825-a539-354cc457f3bc admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:31.628981 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2847b13-a83f-49fc-9606-e37024c65a4e None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:31.630653 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-d2847b13-a83f-49fc-9606-e37024c65a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:31.652887 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2847b13-a83f-49fc-9606-e37024c65a4e None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:31.663990 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eebf9d-1903-44c0-9841-90731a47b3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:31.665655 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eebf9d-1903-44c0-9841-90731a47b3aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:31.665975 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eebf9d-1903-44c0-9841-90731a47b3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:31.666256 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eebf9d-1903-44c0-9841-90731a47b3aa admin admin] PATH_INFO: `/v3/users/379c78f5bc8e444783b93d87cfbccbb1` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:31.667676 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eebf9d-1903-44c0-9841-90731a47b3aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=379c78f5bc8e444783b93d87cfbccbb1)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:31.670497 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eebf9d-1903-44c0-9841-90731a47b3aa admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:31.871529 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-903cbb71-b1f0-4825-a539-354cc457f3bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7200652ebe9f4efea8f06746e7cada9d'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:31.874724 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-903cbb71-b1f0-4825-a539-354cc457f3bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7200652ebe9f4efea8f06746e7cada9d'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:31.883978 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-903cbb71-b1f0-4825-a539-354cc457f3bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7200652ebe9f4efea8f06746e7cada9d'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:31.993230 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-86eebf9d-1903-44c0-9841-90731a47b3aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '379c78f5bc8e444783b93d87cfbccbb1'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:32.008580 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-86eebf9d-1903-44c0-9841-90731a47b3aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '379c78f5bc8e444783b93d87cfbccbb1'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:32.015194 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-903cbb71-b1f0-4825-a539-354cc457f3bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7200652ebe9f4efea8f06746e7cada9d'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:32.016587 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-903cbb71-b1f0-4825-a539-354cc457f3bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7200652ebe9f4efea8f06746e7cada9d'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:32.029866 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-86eebf9d-1903-44c0-9841-90731a47b3aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '379c78f5bc8e444783b93d87cfbccbb1'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:32.031472 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-86eebf9d-1903-44c0-9841-90731a47b3aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '379c78f5bc8e444783b93d87cfbccbb1'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:32.032315 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-86eebf9d-1903-44c0-9841-90731a47b3aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '379c78f5bc8e444783b93d87cfbccbb1'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:32.047606 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 881/1785] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:19:31 2022] DELETE /identity/v3/users/7200652ebe9f4efea8f06746e7cada9d => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:19:32.052157 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c842c54-5812-4415-9202-91fb1050d8f8 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:32.052613 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c842c54-5812-4415-9202-91fb1050d8f8 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:32.052895 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c842c54-5812-4415-9202-91fb1050d8f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:32.074387 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-9c842c54-5812-4415-9202-91fb1050d8f8 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:32.076060 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-9c842c54-5812-4415-9202-91fb1050d8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:32.111175 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 905/1786] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:19:31 2022] DELETE /identity/v3/users/379c78f5bc8e444783b93d87cfbccbb1 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:19:32.119168 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e9ef3c-bf39-43f8-97dc-acf8ad0a38bf None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:32.120461 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e9ef3c-bf39-43f8-97dc-acf8ad0a38bf None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:32.120893 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e9ef3c-bf39-43f8-97dc-acf8ad0a38bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:32.144485 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-c1e9ef3c-bf39-43f8-97dc-acf8ad0a38bf None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:32.146078 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-c1e9ef3c-bf39-43f8-97dc-acf8ad0a38bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:32.197214 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 882/1787] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:19:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:19:32.233584 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c842c54-5812-4415-9202-91fb1050d8f8 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:32.235572 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-9c842c54-5812-4415-9202-91fb1050d8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:32.244137 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 906/1788] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:19:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:19:32.260046 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e9ef3c-bf39-43f8-97dc-acf8ad0a38bf None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:32.262233 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-c1e9ef3c-bf39-43f8-97dc-acf8ad0a38bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:32.363787 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c842c54-5812-4415-9202-91fb1050d8f8 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:32.381781 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e9ef3c-bf39-43f8-97dc-acf8ad0a38bf None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:32.387911 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf6a7f-2c5e-465c-bff3-c587c7630c63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:32.389145 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf6a7f-2c5e-465c-bff3-c587c7630c63 service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:32.389756 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf6a7f-2c5e-465c-bff3-c587c7630c63 service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:32.390231 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf6a7f-2c5e-465c-bff3-c587c7630c63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:32.402745 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf6a7f-2c5e-465c-bff3-c587c7630c63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:32.405359 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf6a7f-2c5e-465c-bff3-c587c7630c63 service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:32.423531 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 907/1789] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:19:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:19:32.431701 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82908e5-fb05-4e9d-bd51-98e8ab0c2750 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:32.435675 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82908e5-fb05-4e9d-bd51-98e8ab0c2750 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:32.435675 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82908e5-fb05-4e9d-bd51-98e8ab0c2750 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:32.435675 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82908e5-fb05-4e9d-bd51-98e8ab0c2750 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:32.443010 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82908e5-fb05-4e9d-bd51-98e8ab0c2750 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:32.444807 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82908e5-fb05-4e9d-bd51-98e8ab0c2750 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:32.456813 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 883/1790] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:19:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:19:33.737164 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf6a7f-2c5e-465c-bff3-c587c7630c63 service neutron] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:33.738805 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-31bf6a7f-2c5e-465c-bff3-c587c7630c63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:33.760023 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf6a7f-2c5e-465c-bff3-c587c7630c63 service neutron] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:33.765380 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c39e0f7-48f3-4f7b-9269-9e7d2d2e81f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:33.766792 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c39e0f7-48f3-4f7b-9269-9e7d2d2e81f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:33.767318 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c39e0f7-48f3-4f7b-9269-9e7d2d2e81f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:33.767925 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c39e0f7-48f3-4f7b-9269-9e7d2d2e81f2 admin admin] PATH_INFO: `/v3/projects/d88fe4a05ee5423d943d2b6c32efc6fe` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:33.769513 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c39e0f7-48f3-4f7b-9269-9e7d2d2e81f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d88fe4a05ee5423d943d2b6c32efc6fe)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:33.773270 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c39e0f7-48f3-4f7b-9269-9e7d2d2e81f2 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:33.988146 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-2c39e0f7-48f3-4f7b-9269-9e7d2d2e81f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd88fe4a05ee5423d943d2b6c32efc6fe', 'request_id': 'req-2c39e0f7-48f3-4f7b-9269-9e7d2d2e81f2'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:33.996693 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-2c39e0f7-48f3-4f7b-9269-9e7d2d2e81f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd88fe4a05ee5423d943d2b6c32efc6fe', 'request_id': 'req-2c39e0f7-48f3-4f7b-9269-9e7d2d2e81f2'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:34.028328 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-2c39e0f7-48f3-4f7b-9269-9e7d2d2e81f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd88fe4a05ee5423d943d2b6c32efc6fe', 'request_id': 'req-2c39e0f7-48f3-4f7b-9269-9e7d2d2e81f2'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:34.069871 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82908e5-fb05-4e9d-bd51-98e8ab0c2750 service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:34.072031 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-a82908e5-fb05-4e9d-bd51-98e8ab0c2750 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:34.093891 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82908e5-fb05-4e9d-bd51-98e8ab0c2750 service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:34.137908 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-2c39e0f7-48f3-4f7b-9269-9e7d2d2e81f2 admin admin] The token cache is being invalidate because project d88fe4a05ee5423d943d2b6c32efc6fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:19:34.138778 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-2c39e0f7-48f3-4f7b-9269-9e7d2d2e81f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:34.139392 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-2c39e0f7-48f3-4f7b-9269-9e7d2d2e81f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:34.141590 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 908/1791] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:19:33 2022] DELETE /identity/v3/projects/d88fe4a05ee5423d943d2b6c32efc6fe => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:19:34.145855 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c39e0f7-48f3-4f7b-9269-9e7d2d2e81f2 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:34.147427 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-2c39e0f7-48f3-4f7b-9269-9e7d2d2e81f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:34.232856 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e567a846-bc74-40c3-a1a6-0b4dd77a3886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:34.233755 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567a846-bc74-40c3-a1a6-0b4dd77a3886 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:34.234042 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567a846-bc74-40c3-a1a6-0b4dd77a3886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:34.234317 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567a846-bc74-40c3-a1a6-0b4dd77a3886 admin admin] PATH_INFO: `/v3/projects/a9fc493f638644758a860e327ab59c95` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:34.237737 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e567a846-bc74-40c3-a1a6-0b4dd77a3886 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9fc493f638644758a860e327ab59c95)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:34.240538 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e567a846-bc74-40c3-a1a6-0b4dd77a3886 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:34.267983 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c39e0f7-48f3-4f7b-9269-9e7d2d2e81f2 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:34.282486 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf4394d-a116-424b-aa08-e64bd3b39192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:34.282486 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf4394d-a116-424b-aa08-e64bd3b39192 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:34.282486 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf4394d-a116-424b-aa08-e64bd3b39192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:34.282486 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf4394d-a116-424b-aa08-e64bd3b39192 admin admin] PATH_INFO: `/v3/users/2429da00c2494cd7852c71ae2aa4a411` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:34.283678 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf4394d-a116-424b-aa08-e64bd3b39192 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2429da00c2494cd7852c71ae2aa4a411)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:34.285872 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf4394d-a116-424b-aa08-e64bd3b39192 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:34.622568 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-3bf4394d-a116-424b-aa08-e64bd3b39192 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2429da00c2494cd7852c71ae2aa4a411'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:34.630084 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-3bf4394d-a116-424b-aa08-e64bd3b39192 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2429da00c2494cd7852c71ae2aa4a411'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:34.645983 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-3bf4394d-a116-424b-aa08-e64bd3b39192 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2429da00c2494cd7852c71ae2aa4a411'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:34.646995 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-3bf4394d-a116-424b-aa08-e64bd3b39192 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2429da00c2494cd7852c71ae2aa4a411'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:34.647932 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-3bf4394d-a116-424b-aa08-e64bd3b39192 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2429da00c2494cd7852c71ae2aa4a411'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:34.724336 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e567a846-bc74-40c3-a1a6-0b4dd77a3886 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9fc493f638644758a860e327ab59c95', 'request_id': 'req-e567a846-bc74-40c3-a1a6-0b4dd77a3886'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:34.748811 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e567a846-bc74-40c3-a1a6-0b4dd77a3886 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9fc493f638644758a860e327ab59c95', 'request_id': 'req-e567a846-bc74-40c3-a1a6-0b4dd77a3886'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:34.761713 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 909/1792] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:19:34 2022] DELETE /identity/v3/users/2429da00c2494cd7852c71ae2aa4a411 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:19:34.781153 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e567a846-bc74-40c3-a1a6-0b4dd77a3886 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9fc493f638644758a860e327ab59c95', 'request_id': 'req-e567a846-bc74-40c3-a1a6-0b4dd77a3886'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:34.906192 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e567a846-bc74-40c3-a1a6-0b4dd77a3886 admin admin] The token cache is being invalidate because project a9fc493f638644758a860e327ab59c95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:19:34.906748 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e567a846-bc74-40c3-a1a6-0b4dd77a3886 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:34.907640 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e567a846-bc74-40c3-a1a6-0b4dd77a3886 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:34.915834 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 884/1793] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:19:34 2022] DELETE /identity/v3/projects/a9fc493f638644758a860e327ab59c95 => generated 0 bytes in 840 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:19:34.916200 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf4394d-a116-424b-aa08-e64bd3b39192 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:34.916967 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-3bf4394d-a116-424b-aa08-e64bd3b39192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:35.093968 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf4394d-a116-424b-aa08-e64bd3b39192 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:35.105142 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baecaa37-a945-48b5-9af3-fb9f04f177a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:35.106041 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baecaa37-a945-48b5-9af3-fb9f04f177a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:35.106328 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baecaa37-a945-48b5-9af3-fb9f04f177a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:35.106605 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baecaa37-a945-48b5-9af3-fb9f04f177a8 admin admin] PATH_INFO: `/v3/users/6652ed0369dc4e828bcfd9afddac5283` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:35.107840 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baecaa37-a945-48b5-9af3-fb9f04f177a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6652ed0369dc4e828bcfd9afddac5283)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:35.109811 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baecaa37-a945-48b5-9af3-fb9f04f177a8 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:35.241107 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42071415-44f6-4f47-b67c-7ca4b456523e None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:35.241633 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42071415-44f6-4f47-b67c-7ca4b456523e None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:35.241777 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42071415-44f6-4f47-b67c-7ca4b456523e None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:35.243592 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 885/1794] 10.222.0.65 () {54 vars in 921 bytes} [Tue May 10 03:19:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 03:19:35.256375 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a5c39-e4f7-497e-b8d9-c87c4e249c13 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:35.256970 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a5c39-e4f7-497e-b8d9-c87c4e249c13 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:35.257420 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a5c39-e4f7-497e-b8d9-c87c4e249c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:35.283719 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-845a5c39-e4f7-497e-b8d9-c87c4e249c13 None None] MFA Rules not processed for user `9b7ccdccba0b4f9e86817946f22dbe28`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:35.285188 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-845a5c39-e4f7-497e-b8d9-c87c4e249c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:35.379275 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-baecaa37-a945-48b5-9af3-fb9f04f177a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6652ed0369dc4e828bcfd9afddac5283'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:35.418591 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-baecaa37-a945-48b5-9af3-fb9f04f177a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6652ed0369dc4e828bcfd9afddac5283'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:35.429641 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 886/1795] 10.222.0.65 () {58 vars in 1018 bytes} [Tue May 10 03:19:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:19:35.467574 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-baecaa37-a945-48b5-9af3-fb9f04f177a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6652ed0369dc4e828bcfd9afddac5283'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:35.468736 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-baecaa37-a945-48b5-9af3-fb9f04f177a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6652ed0369dc4e828bcfd9afddac5283'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:35.469508 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-baecaa37-a945-48b5-9af3-fb9f04f177a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6652ed0369dc4e828bcfd9afddac5283'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:35.561926 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 910/1796] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:19:34 2022] DELETE /identity/v3/users/6652ed0369dc4e828bcfd9afddac5283 => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:19:35.757999 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a5c39-e4f7-497e-b8d9-c87c4e249c13 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:35.759515 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-845a5c39-e4f7-497e-b8d9-c87c4e249c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:35.774739 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a5c39-e4f7-497e-b8d9-c87c4e249c13 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:35.888449 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b2f7d-4c90-4b96-bc41-d1a52c02a896 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b7ccdccba0b4f9e86817946f22dbe28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:35.889131 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b2f7d-4c90-4b96-bc41-d1a52c02a896 service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:35.889406 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b2f7d-4c90-4b96-bc41-d1a52c02a896 service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:35.889850 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b2f7d-4c90-4b96-bc41-d1a52c02a896 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:35.894397 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-dd9b2f7d-4c90-4b96-bc41-d1a52c02a896 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:35.909987 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b2f7d-4c90-4b96-bc41-d1a52c02a896 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:35.911670 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b2f7d-4c90-4b96-bc41-d1a52c02a896 service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:35.924362 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 887/1797] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:19:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:19:36.139230 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baecaa37-a945-48b5-9af3-fb9f04f177a8 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:36.144612 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-baecaa37-a945-48b5-9af3-fb9f04f177a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:36.253371 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baecaa37-a945-48b5-9af3-fb9f04f177a8 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:36.260758 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b490a65-20e2-441e-aa8a-dd70c570824c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:36.261931 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b490a65-20e2-441e-aa8a-dd70c570824c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:36.262361 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b490a65-20e2-441e-aa8a-dd70c570824c admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:36.262815 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b490a65-20e2-441e-aa8a-dd70c570824c admin admin] PATH_INFO: `/v3/projects/99960eea2b4048939c2d206038520ad4` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:36.264404 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b490a65-20e2-441e-aa8a-dd70c570824c admin admin] RBAC: Authorizing `identity:delete_project(project_id=99960eea2b4048939c2d206038520ad4)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:36.266904 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b490a65-20e2-441e-aa8a-dd70c570824c admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:36.476218 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-7b490a65-20e2-441e-aa8a-dd70c570824c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99960eea2b4048939c2d206038520ad4', 'request_id': 'req-7b490a65-20e2-441e-aa8a-dd70c570824c'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:36.510540 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-7b490a65-20e2-441e-aa8a-dd70c570824c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99960eea2b4048939c2d206038520ad4', 'request_id': 'req-7b490a65-20e2-441e-aa8a-dd70c570824c'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:36.536097 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-7b490a65-20e2-441e-aa8a-dd70c570824c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99960eea2b4048939c2d206038520ad4', 'request_id': 'req-7b490a65-20e2-441e-aa8a-dd70c570824c'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:36.645388 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-7b490a65-20e2-441e-aa8a-dd70c570824c admin admin] The token cache is being invalidate because project 99960eea2b4048939c2d206038520ad4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:19:36.646705 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-7b490a65-20e2-441e-aa8a-dd70c570824c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:36.649125 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-7b490a65-20e2-441e-aa8a-dd70c570824c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:36.651960 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 911/1798] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:19:36 2022] DELETE /identity/v3/projects/99960eea2b4048939c2d206038520ad4 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:19:36.658155 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d595823-1f58-4df6-8a70-5cb38eca85ee None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:36.659009 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d595823-1f58-4df6-8a70-5cb38eca85ee None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:36.659433 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d595823-1f58-4df6-8a70-5cb38eca85ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:36.682398 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-7d595823-1f58-4df6-8a70-5cb38eca85ee None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:36.686329 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-7d595823-1f58-4df6-8a70-5cb38eca85ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:36.803917 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 888/1799] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:19:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:19:36.805689 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea67078-41b9-41a9-ab2f-84981810b43d None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:36.805990 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea67078-41b9-41a9-ab2f-84981810b43d None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:36.812564 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea67078-41b9-41a9-ab2f-84981810b43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:36.874433 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-cea67078-41b9-41a9-ab2f-84981810b43d None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:36.876082 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-cea67078-41b9-41a9-ab2f-84981810b43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:36.895157 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 912/1800] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:19:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:19:36.900324 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d595823-1f58-4df6-8a70-5cb38eca85ee None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:36.927474 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d595823-1f58-4df6-8a70-5cb38eca85ee None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:36.936816 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d45d84-ad9e-4cbb-aade-fb09b68b3ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:36.937521 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d45d84-ad9e-4cbb-aade-fb09b68b3ec2 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:36.937807 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d45d84-ad9e-4cbb-aade-fb09b68b3ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:36.938083 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d45d84-ad9e-4cbb-aade-fb09b68b3ec2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:36.938947 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d45d84-ad9e-4cbb-aade-fb09b68b3ec2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:19:36.940190 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d45d84-ad9e-4cbb-aade-fb09b68b3ec2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:36.947892 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d45d84-ad9e-4cbb-aade-fb09b68b3ec2 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:36.971956 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 889/1801] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 10 03:19:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:19:36.975556 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea67078-41b9-41a9-ab2f-84981810b43d None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:36.987807 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea67078-41b9-41a9-ab2f-84981810b43d None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:37.001851 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe29335-9415-4e9a-b24b-18d8fc26bdf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:37.010285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe29335-9415-4e9a-b24b-18d8fc26bdf2 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:37.010586 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe29335-9415-4e9a-b24b-18d8fc26bdf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:37.010874 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe29335-9415-4e9a-b24b-18d8fc26bdf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:37.015819 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe29335-9415-4e9a-b24b-18d8fc26bdf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:37.017821 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe29335-9415-4e9a-b24b-18d8fc26bdf2 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:37.157853 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 913/1802] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:19:36 2022] POST /identity/v3/projects => generated 371 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:19:37.159900 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d45d84-ad9e-4cbb-aade-fb09b68b3ec2 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:37.171330 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d45d84-ad9e-4cbb-aade-fb09b68b3ec2 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:37.246977 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4710820-3c3b-4506-aa1e-1445c893cf4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:37.247846 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4710820-3c3b-4506-aa1e-1445c893cf4f admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:37.248233 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4710820-3c3b-4506-aa1e-1445c893cf4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:37.248605 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4710820-3c3b-4506-aa1e-1445c893cf4f admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:37.249405 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4710820-3c3b-4506-aa1e-1445c893cf4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:37.251629 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4710820-3c3b-4506-aa1e-1445c893cf4f admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:37.345848 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 890/1803] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:19:37 2022] POST /identity/v3/users => generated 286 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:19:37.347156 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe29335-9415-4e9a-b24b-18d8fc26bdf2 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:37.368964 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe29335-9415-4e9a-b24b-18d8fc26bdf2 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:37.376542 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baab1b9-dc46-4c11-ab85-8a748b30b552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:37.377777 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baab1b9-dc46-4c11-ab85-8a748b30b552 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:37.378211 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baab1b9-dc46-4c11-ab85-8a748b30b552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:37.378679 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baab1b9-dc46-4c11-ab85-8a748b30b552 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:37.379922 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baab1b9-dc46-4c11-ab85-8a748b30b552 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:37.381906 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baab1b9-dc46-4c11-ab85-8a748b30b552 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:37.399079 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 914/1804] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:19:37.402953 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4710820-3c3b-4506-aa1e-1445c893cf4f admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:37.413467 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4710820-3c3b-4506-aa1e-1445c893cf4f admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:37.420246 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39cdd5e-e1e2-4b92-87a6-7b3dfbf1c106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:37.420929 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39cdd5e-e1e2-4b92-87a6-7b3dfbf1c106 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:37.421214 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39cdd5e-e1e2-4b92-87a6-7b3dfbf1c106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:37.421489 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39cdd5e-e1e2-4b92-87a6-7b3dfbf1c106 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:37.422222 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39cdd5e-e1e2-4b92-87a6-7b3dfbf1c106 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:37.423825 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39cdd5e-e1e2-4b92-87a6-7b3dfbf1c106 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:37.441297 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baab1b9-dc46-4c11-ab85-8a748b30b552 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:37.442373 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 891/1805] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:19:37.479967 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baab1b9-dc46-4c11-ab85-8a748b30b552 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:37.505822 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc7814a-f735-48f4-a8aa-d10bf047bd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:37.506817 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7814a-f735-48f4-a8aa-d10bf047bd3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:37.507023 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7814a-f735-48f4-a8aa-d10bf047bd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:37.507306 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7814a-f735-48f4-a8aa-d10bf047bd3a admin admin] PATH_INFO: `/v3/projects/45f635f7cec2426294bc6836ab899e9d/users/cf683d527c9f4ff5ba200c2fcb3ddee4/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:37.535998 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc7814a-f735-48f4-a8aa-d10bf047bd3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=45f635f7cec2426294bc6836ab899e9d, user_id=cf683d527c9f4ff5ba200c2fcb3ddee4, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:37.554291 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc7814a-f735-48f4-a8aa-d10bf047bd3a admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:37.763549 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 915/1806] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:19:37 2022] PUT /identity/v3/projects/45f635f7cec2426294bc6836ab899e9d/users/cf683d527c9f4ff5ba200c2fcb3ddee4/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:19:37.781526 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad0991-3bdc-4151-a25c-63994f783a47 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:37.782971 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad0991-3bdc-4151-a25c-63994f783a47 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:37.783444 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad0991-3bdc-4151-a25c-63994f783a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:37.791802 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc7814a-f735-48f4-a8aa-d10bf047bd3a admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:37.794172 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-0fc7814a-f735-48f4-a8aa-d10bf047bd3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:37.848179 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-d4ad0991-3bdc-4151-a25c-63994f783a47 None None] MFA Rules not processed for user `cf683d527c9f4ff5ba200c2fcb3ddee4`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:37.849434 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-d4ad0991-3bdc-4151-a25c-63994f783a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:37.894732 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc7814a-f735-48f4-a8aa-d10bf047bd3a admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:37.900549 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613ae244-5e0e-4311-ad7c-fc2bdabd735f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:37.901490 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ae244-5e0e-4311-ad7c-fc2bdabd735f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:37.901995 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ae244-5e0e-4311-ad7c-fc2bdabd735f admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:37.902497 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ae244-5e0e-4311-ad7c-fc2bdabd735f admin admin] PATH_INFO: `/v3/projects/20c0707768f54a41a2c825f528104cd6` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:37.903926 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613ae244-5e0e-4311-ad7c-fc2bdabd735f admin admin] RBAC: Authorizing `identity:delete_project(project_id=20c0707768f54a41a2c825f528104cd6)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:37.912248 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613ae244-5e0e-4311-ad7c-fc2bdabd735f admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:37.949272 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 892/1807] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:19:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:19:37.972574 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ad0991-3bdc-4151-a25c-63994f783a47 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:37.974001 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-d4ad0991-3bdc-4151-a25c-63994f783a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:38.065792 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-613ae244-5e0e-4311-ad7c-fc2bdabd735f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20c0707768f54a41a2c825f528104cd6', 'request_id': 'req-613ae244-5e0e-4311-ad7c-fc2bdabd735f'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:38.081212 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-613ae244-5e0e-4311-ad7c-fc2bdabd735f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20c0707768f54a41a2c825f528104cd6', 'request_id': 'req-613ae244-5e0e-4311-ad7c-fc2bdabd735f'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:38.083996 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ad0991-3bdc-4151-a25c-63994f783a47 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:38.090729 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-613ae244-5e0e-4311-ad7c-fc2bdabd735f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20c0707768f54a41a2c825f528104cd6', 'request_id': 'req-613ae244-5e0e-4311-ad7c-fc2bdabd735f'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:38.161669 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2543c7d7-8a87-49b9-9a89-7b1e3fd8535b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:38.162362 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543c7d7-8a87-49b9-9a89-7b1e3fd8535b service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:38.162644 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543c7d7-8a87-49b9-9a89-7b1e3fd8535b service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:38.162917 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543c7d7-8a87-49b9-9a89-7b1e3fd8535b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:38.183743 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-613ae244-5e0e-4311-ad7c-fc2bdabd735f admin admin] The token cache is being invalidate because project 20c0707768f54a41a2c825f528104cd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:19:38.185151 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-613ae244-5e0e-4311-ad7c-fc2bdabd735f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:38.186009 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-613ae244-5e0e-4311-ad7c-fc2bdabd735f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:38.191434 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 916/1808] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:19:37 2022] DELETE /identity/v3/projects/20c0707768f54a41a2c825f528104cd6 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:19:38.193237 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb04f41-8c5c-443a-86a0-a8b3e3341e2d None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:38.193765 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb04f41-8c5c-443a-86a0-a8b3e3341e2d None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:38.194238 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb04f41-8c5c-443a-86a0-a8b3e3341e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:38.214651 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-8eb04f41-8c5c-443a-86a0-a8b3e3341e2d None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:38.216539 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-8eb04f41-8c5c-443a-86a0-a8b3e3341e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:38.234835 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2543c7d7-8a87-49b9-9a89-7b1e3fd8535b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:38.236909 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2543c7d7-8a87-49b9-9a89-7b1e3fd8535b service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:38.248822 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 893/1809] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:19:37 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:19:38.280038 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2543c7d7-8a87-49b9-9a89-7b1e3fd8535b service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:38.310520 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 917/1810] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:19:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:19:38.321328 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb3775-b17e-4d0b-94e2-00a7b572598c None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:38.322042 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb3775-b17e-4d0b-94e2-00a7b572598c None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:38.322923 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb3775-b17e-4d0b-94e2-00a7b572598c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:38.349679 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-56fb3775-b17e-4d0b-94e2-00a7b572598c None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:38.353740 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-56fb3775-b17e-4d0b-94e2-00a7b572598c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:38.370124 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 918/1811] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:19:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:19:38.375291 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fb3775-b17e-4d0b-94e2-00a7b572598c None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:38.386575 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fb3775-b17e-4d0b-94e2-00a7b572598c None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:38.388679 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2543c7d7-8a87-49b9-9a89-7b1e3fd8535b service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:38.393914 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e9d0c-4f36-4b29-ba9a-088b0ccd7b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:38.395057 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a828b0-2f0c-4a43-b33b-3415a8c46c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:38.395877 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e9d0c-4f36-4b29-ba9a-088b0ccd7b8f admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:38.396047 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a828b0-2f0c-4a43-b33b-3415a8c46c3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:38.396578 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e9d0c-4f36-4b29-ba9a-088b0ccd7b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:38.397046 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e9d0c-4f36-4b29-ba9a-088b0ccd7b8f admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:38.397978 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e9d0c-4f36-4b29-ba9a-088b0ccd7b8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:19:38.399075 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e9d0c-4f36-4b29-ba9a-088b0ccd7b8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:38.401177 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e9d0c-4f36-4b29-ba9a-088b0ccd7b8f admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:38.410494 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a828b0-2f0c-4a43-b33b-3415a8c46c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:38.410494 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a828b0-2f0c-4a43-b33b-3415a8c46c3a admin admin] PATH_INFO: `/v3/users/cf683d527c9f4ff5ba200c2fcb3ddee4` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:38.411498 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a828b0-2f0c-4a43-b33b-3415a8c46c3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf683d527c9f4ff5ba200c2fcb3ddee4)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:38.417187 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a828b0-2f0c-4a43-b33b-3415a8c46c3a admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:38.419647 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 919/1812] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 10 03:19:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:19:38.421139 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e9d0c-4f36-4b29-ba9a-088b0ccd7b8f admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:38.441174 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e9d0c-4f36-4b29-ba9a-088b0ccd7b8f admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:38.447840 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaea728-a3ec-4c85-8d09-176da0b34275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:38.451546 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaea728-a3ec-4c85-8d09-176da0b34275 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:38.451546 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaea728-a3ec-4c85-8d09-176da0b34275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:38.451546 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaea728-a3ec-4c85-8d09-176da0b34275 admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:38.455009 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaea728-a3ec-4c85-8d09-176da0b34275 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:38.457613 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaea728-a3ec-4c85-8d09-176da0b34275 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:38.588402 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 920/1813] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:19:38 2022] POST /identity/v3/projects => generated 383 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:19:38.592436 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaea728-a3ec-4c85-8d09-176da0b34275 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:38.664147 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaea728-a3ec-4c85-8d09-176da0b34275 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:38.670331 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fccdc2d-e22a-42e7-ae24-932af8c986c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:38.671064 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fccdc2d-e22a-42e7-ae24-932af8c986c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:38.671349 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fccdc2d-e22a-42e7-ae24-932af8c986c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:38.671630 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fccdc2d-e22a-42e7-ae24-932af8c986c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:38.672367 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fccdc2d-e22a-42e7-ae24-932af8c986c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:38.674286 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fccdc2d-e22a-42e7-ae24-932af8c986c3 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:38.700499 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-a2a828b0-2f0c-4a43-b33b-3415a8c46c3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf683d527c9f4ff5ba200c2fcb3ddee4'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:38.701200 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-a2a828b0-2f0c-4a43-b33b-3415a8c46c3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf683d527c9f4ff5ba200c2fcb3ddee4'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:38.714528 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-a2a828b0-2f0c-4a43-b33b-3415a8c46c3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf683d527c9f4ff5ba200c2fcb3ddee4'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:38.773374 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 921/1814] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:19:38 2022] POST /identity/v3/users => generated 292 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:19:38.777930 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fccdc2d-e22a-42e7-ae24-932af8c986c3 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:38.787939 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fccdc2d-e22a-42e7-ae24-932af8c986c3 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:38.793425 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71fed4b-543f-4eb5-ace4-b0785a46da86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:38.794435 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71fed4b-543f-4eb5-ace4-b0785a46da86 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:38.794435 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71fed4b-543f-4eb5-ace4-b0785a46da86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:38.794725 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71fed4b-543f-4eb5-ace4-b0785a46da86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:38.795347 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71fed4b-543f-4eb5-ace4-b0785a46da86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:38.797346 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71fed4b-543f-4eb5-ace4-b0785a46da86 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:38.809401 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 922/1815] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:19:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:19:38.813301 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71fed4b-543f-4eb5-ace4-b0785a46da86 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:38.824853 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71fed4b-543f-4eb5-ace4-b0785a46da86 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:38.829926 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b6a7ab-7abe-48ff-aa9c-9fe7bb33bc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:38.830596 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6a7ab-7abe-48ff-aa9c-9fe7bb33bc8d admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:38.831012 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6a7ab-7abe-48ff-aa9c-9fe7bb33bc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:38.831298 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6a7ab-7abe-48ff-aa9c-9fe7bb33bc8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:38.832065 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b6a7ab-7abe-48ff-aa9c-9fe7bb33bc8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:38.833657 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b6a7ab-7abe-48ff-aa9c-9fe7bb33bc8d admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:38.835718 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-a2a828b0-2f0c-4a43-b33b-3415a8c46c3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf683d527c9f4ff5ba200c2fcb3ddee4'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:38.837540 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-a2a828b0-2f0c-4a43-b33b-3415a8c46c3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf683d527c9f4ff5ba200c2fcb3ddee4'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:38.856125 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 923/1816] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:19:38 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:19:38.858448 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 894/1817] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:19:38 2022] DELETE /identity/v3/users/cf683d527c9f4ff5ba200c2fcb3ddee4 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:19:38.859401 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b6a7ab-7abe-48ff-aa9c-9fe7bb33bc8d admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:38.862882 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-f7b6a7ab-7abe-48ff-aa9c-9fe7bb33bc8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:38.863040 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823723f8-cff0-4aa5-909d-16ac2803a204 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:38.863216 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823723f8-cff0-4aa5-909d-16ac2803a204 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:38.863481 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823723f8-cff0-4aa5-909d-16ac2803a204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:38.881712 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b6a7ab-7abe-48ff-aa9c-9fe7bb33bc8d admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:38.884153 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-823723f8-cff0-4aa5-909d-16ac2803a204 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:38.885657 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-823723f8-cff0-4aa5-909d-16ac2803a204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:38.942156 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86c0c9-6994-4aea-a956-851fa512848b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:38.943034 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86c0c9-6994-4aea-a956-851fa512848b admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:38.943315 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86c0c9-6994-4aea-a956-851fa512848b admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:38.943595 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86c0c9-6994-4aea-a956-851fa512848b admin admin] PATH_INFO: `/v3/projects/f20d4b314f76478380f8d61074565721/users/4b3fd3f690a3407198a1dc49ceb275e4/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:38.959382 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 895/1818] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:19:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:19:38.968059 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab86c0c9-6994-4aea-a956-851fa512848b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f20d4b314f76478380f8d61074565721, user_id=4b3fd3f690a3407198a1dc49ceb275e4, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:38.970105 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823723f8-cff0-4aa5-909d-16ac2803a204 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:38.971899 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-823723f8-cff0-4aa5-909d-16ac2803a204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:38.972834 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab86c0c9-6994-4aea-a956-851fa512848b admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:39.049160 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823723f8-cff0-4aa5-909d-16ac2803a204 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:39.054730 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd6d9f4-7efb-4019-8906-16eac4966bca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:39.054730 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6d9f4-7efb-4019-8906-16eac4966bca service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:39.054730 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6d9f4-7efb-4019-8906-16eac4966bca service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:39.054730 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6d9f4-7efb-4019-8906-16eac4966bca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:39.066066 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd6d9f4-7efb-4019-8906-16eac4966bca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:39.067790 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd6d9f4-7efb-4019-8906-16eac4966bca service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:39.082687 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 896/1819] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:19:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:19:39.086650 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 924/1820] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:19:38 2022] PUT /identity/v3/projects/f20d4b314f76478380f8d61074565721/users/4b3fd3f690a3407198a1dc49ceb275e4/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:19:39.101615 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6865a5-c64b-46e1-9b7a-5494b65d78be None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:39.101982 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6865a5-c64b-46e1-9b7a-5494b65d78be None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:39.102335 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6865a5-c64b-46e1-9b7a-5494b65d78be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:39.131269 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-bb6865a5-c64b-46e1-9b7a-5494b65d78be None None] MFA Rules not processed for user `4b3fd3f690a3407198a1dc49ceb275e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:39.132625 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-bb6865a5-c64b-46e1-9b7a-5494b65d78be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:39.234846 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 897/1821] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:19:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:19:39.240000 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86c0c9-6994-4aea-a956-851fa512848b admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:39.318078 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86c0c9-6994-4aea-a956-851fa512848b admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:39.324966 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd04751-8152-4f14-9be5-16f867cc901f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:39.327854 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd04751-8152-4f14-9be5-16f867cc901f admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:39.328313 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd04751-8152-4f14-9be5-16f867cc901f admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:39.328599 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd04751-8152-4f14-9be5-16f867cc901f admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:39.329367 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd04751-8152-4f14-9be5-16f867cc901f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:39.331495 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd04751-8152-4f14-9be5-16f867cc901f admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:39.445491 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 925/1822] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:19:39 2022] POST /identity/v3/projects => generated 383 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:19:39.454921 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6865a5-c64b-46e1-9b7a-5494b65d78be None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:39.472716 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6865a5-c64b-46e1-9b7a-5494b65d78be None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:39.581580 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2939bb-37ed-4194-b304-72586664916b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:39.582943 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2939bb-37ed-4194-b304-72586664916b admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:39.583231 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2939bb-37ed-4194-b304-72586664916b admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:39.584191 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2939bb-37ed-4194-b304-72586664916b admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:39.584947 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2939bb-37ed-4194-b304-72586664916b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:39.588568 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2939bb-37ed-4194-b304-72586664916b admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:39.691241 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 898/1823] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:19:39 2022] POST /identity/v3/users => generated 298 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:19:39.695695 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd04751-8152-4f14-9be5-16f867cc901f admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:39.707050 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd04751-8152-4f14-9be5-16f867cc901f admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:39.714389 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337bb428-c1b2-4704-bb02-4a4bd87d998b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:39.715482 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337bb428-c1b2-4704-bb02-4a4bd87d998b admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:39.716111 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337bb428-c1b2-4704-bb02-4a4bd87d998b admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:39.720033 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337bb428-c1b2-4704-bb02-4a4bd87d998b admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:39.723056 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337bb428-c1b2-4704-bb02-4a4bd87d998b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:39.725683 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337bb428-c1b2-4704-bb02-4a4bd87d998b admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:39.746711 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2939bb-37ed-4194-b304-72586664916b admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:39.754985 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 926/1824] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:19:39.763754 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2939bb-37ed-4194-b304-72586664916b admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:39.769932 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167aba0d-0fe9-403e-9c71-45d7004cc753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:39.771483 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167aba0d-0fe9-403e-9c71-45d7004cc753 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:39.771997 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167aba0d-0fe9-403e-9c71-45d7004cc753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:39.772605 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167aba0d-0fe9-403e-9c71-45d7004cc753 admin admin] PATH_INFO: `/v3/projects/6a554ee34418485dbd2546fa52e7e6b5/users/e21118a68c9b4890948b103e09ce0414/roles/43105000610f402ca2486e7648018cca` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:39.793135 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167aba0d-0fe9-403e-9c71-45d7004cc753 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a554ee34418485dbd2546fa52e7e6b5, user_id=e21118a68c9b4890948b103e09ce0414, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:39.795885 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167aba0d-0fe9-403e-9c71-45d7004cc753 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:39.881624 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 899/1825] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:19:39 2022] PUT /identity/v3/projects/6a554ee34418485dbd2546fa52e7e6b5/users/e21118a68c9b4890948b103e09ce0414/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:19:39.886180 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337bb428-c1b2-4704-bb02-4a4bd87d998b admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:39.899519 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337bb428-c1b2-4704-bb02-4a4bd87d998b admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:39.983913 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0286edcc-09a6-4eb8-a6f2-5d4bee19ac63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:39.984775 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286edcc-09a6-4eb8-a6f2-5d4bee19ac63 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:39.985714 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286edcc-09a6-4eb8-a6f2-5d4bee19ac63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:39.985714 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286edcc-09a6-4eb8-a6f2-5d4bee19ac63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:39.986212 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0286edcc-09a6-4eb8-a6f2-5d4bee19ac63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:39.987998 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0286edcc-09a6-4eb8-a6f2-5d4bee19ac63 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:40.000470 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 927/1826] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:19:40.004924 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167aba0d-0fe9-403e-9c71-45d7004cc753 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:40.020838 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167aba0d-0fe9-403e-9c71-45d7004cc753 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:40.029001 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b5be8f-a860-49fc-9096-202eac759231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:40.030070 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5be8f-a860-49fc-9096-202eac759231 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:40.030411 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5be8f-a860-49fc-9096-202eac759231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:40.031450 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5be8f-a860-49fc-9096-202eac759231 admin admin] PATH_INFO: `/v3/projects/6a554ee34418485dbd2546fa52e7e6b5/users/e21118a68c9b4890948b103e09ce0414/roles/43105000610f402ca2486e7648018cca` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:40.033963 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b5be8f-a860-49fc-9096-202eac759231 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a554ee34418485dbd2546fa52e7e6b5, user_id=e21118a68c9b4890948b103e09ce0414, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:40.041373 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b5be8f-a860-49fc-9096-202eac759231 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:40.062294 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 900/1827] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:19:40 2022] PUT /identity/v3/projects/6a554ee34418485dbd2546fa52e7e6b5/users/e21118a68c9b4890948b103e09ce0414/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:19:40.075741 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342fb6f-82a5-45dc-9628-57f4ade43b0f None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:40.076064 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342fb6f-82a5-45dc-9628-57f4ade43b0f None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:40.076356 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342fb6f-82a5-45dc-9628-57f4ade43b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:40.116426 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-b342fb6f-82a5-45dc-9628-57f4ade43b0f None None] MFA Rules not processed for user `e21118a68c9b4890948b103e09ce0414`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:40.118859 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-b342fb6f-82a5-45dc-9628-57f4ade43b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:40.237980 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 928/1828] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:19:40 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:19:40.250859 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b5be8f-a860-49fc-9096-202eac759231 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:40.253201 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-d7b5be8f-a860-49fc-9096-202eac759231 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:40.394268 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b5be8f-a860-49fc-9096-202eac759231 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:40.403937 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a51ac2-b3ea-45ce-9723-a2c3c51e1a32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:40.405002 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a51ac2-b3ea-45ce-9723-a2c3c51e1a32 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:40.405288 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a51ac2-b3ea-45ce-9723-a2c3c51e1a32 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:40.405727 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a51ac2-b3ea-45ce-9723-a2c3c51e1a32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:40.442021 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a51ac2-b3ea-45ce-9723-a2c3c51e1a32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:40.448205 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a51ac2-b3ea-45ce-9723-a2c3c51e1a32 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:40.463779 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 901/1829] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:19:40 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:19:40.608497 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b342fb6f-82a5-45dc-9628-57f4ade43b0f None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:40.611630 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a51ac2-b3ea-45ce-9723-a2c3c51e1a32 service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:40.613347 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-b9a51ac2-b3ea-45ce-9723-a2c3c51e1a32 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:40.622223 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b342fb6f-82a5-45dc-9628-57f4ade43b0f None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:40.630808 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571fd180-24e3-4b4a-a0b4-daf5e137f4a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:40.631480 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571fd180-24e3-4b4a-a0b4-daf5e137f4a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:40.631759 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571fd180-24e3-4b4a-a0b4-daf5e137f4a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:40.632047 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571fd180-24e3-4b4a-a0b4-daf5e137f4a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:40.743412 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a51ac2-b3ea-45ce-9723-a2c3c51e1a32 service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:40.756655 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571fd180-24e3-4b4a-a0b4-daf5e137f4a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:40.759566 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571fd180-24e3-4b4a-a0b4-daf5e137f4a8 service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:40.761983 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b843da-e6b0-4cc9-b744-6e7975b8dcc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:40.763375 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b843da-e6b0-4cc9-b744-6e7975b8dcc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:40.763659 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b843da-e6b0-4cc9-b744-6e7975b8dcc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:40.763930 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b843da-e6b0-4cc9-b744-6e7975b8dcc2 admin admin] PATH_INFO: `/v3/projects/45f635f7cec2426294bc6836ab899e9d` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:40.766422 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b843da-e6b0-4cc9-b744-6e7975b8dcc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45f635f7cec2426294bc6836ab899e9d)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:40.777561 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 929/1830] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:19:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:19:40.784287 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b843da-e6b0-4cc9-b744-6e7975b8dcc2 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:40.960317 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-26b843da-e6b0-4cc9-b744-6e7975b8dcc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45f635f7cec2426294bc6836ab899e9d', 'request_id': 'req-26b843da-e6b0-4cc9-b744-6e7975b8dcc2'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:40.974943 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-26b843da-e6b0-4cc9-b744-6e7975b8dcc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45f635f7cec2426294bc6836ab899e9d', 'request_id': 'req-26b843da-e6b0-4cc9-b744-6e7975b8dcc2'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:41.000797 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-26b843da-e6b0-4cc9-b744-6e7975b8dcc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45f635f7cec2426294bc6836ab899e9d', 'request_id': 'req-26b843da-e6b0-4cc9-b744-6e7975b8dcc2'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:41.104295 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-26b843da-e6b0-4cc9-b744-6e7975b8dcc2 admin admin] The token cache is being invalidate because project 45f635f7cec2426294bc6836ab899e9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:19:41.104592 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-26b843da-e6b0-4cc9-b744-6e7975b8dcc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:41.105326 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-26b843da-e6b0-4cc9-b744-6e7975b8dcc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:41.107140 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 902/1831] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:19:40 2022] DELETE /identity/v3/projects/45f635f7cec2426294bc6836ab899e9d => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:19:41.112084 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b1699-142b-45ce-8dc0-2c95047f61fd None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:41.112380 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b1699-142b-45ce-8dc0-2c95047f61fd None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:41.112657 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b1699-142b-45ce-8dc0-2c95047f61fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:41.133874 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-8b3b1699-142b-45ce-8dc0-2c95047f61fd None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:41.135022 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-8b3b1699-142b-45ce-8dc0-2c95047f61fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:41.199415 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 930/1832] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:19:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:19:41.207066 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5237c-517f-4c4f-9426-9c6b2bb256a0 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:41.207383 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5237c-517f-4c4f-9426-9c6b2bb256a0 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:41.207666 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5237c-517f-4c4f-9426-9c6b2bb256a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:41.227396 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-89b5237c-517f-4c4f-9426-9c6b2bb256a0 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:41.228730 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-89b5237c-517f-4c4f-9426-9c6b2bb256a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:41.241480 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 903/1833] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:19:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:19:41.243145 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3b1699-142b-45ce-8dc0-2c95047f61fd None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:41.267646 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3b1699-142b-45ce-8dc0-2c95047f61fd None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:41.284334 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8781384-3595-4523-a787-e53bb3ef7088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:41.285463 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8781384-3595-4523-a787-e53bb3ef7088 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:41.285752 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8781384-3595-4523-a787-e53bb3ef7088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:41.286128 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8781384-3595-4523-a787-e53bb3ef7088 admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:41.287817 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8781384-3595-4523-a787-e53bb3ef7088 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:19:41.288640 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8781384-3595-4523-a787-e53bb3ef7088 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:41.291370 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8781384-3595-4523-a787-e53bb3ef7088 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:41.307910 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 931/1834] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 10 03:19:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:19:41.314094 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b5237c-517f-4c4f-9426-9c6b2bb256a0 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:41.326784 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b5237c-517f-4c4f-9426-9c6b2bb256a0 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:41.336964 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cdecf4-d723-41a7-aef8-735789ead566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:41.337799 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cdecf4-d723-41a7-aef8-735789ead566 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:41.338332 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cdecf4-d723-41a7-aef8-735789ead566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:41.338700 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cdecf4-d723-41a7-aef8-735789ead566 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:41.339657 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cdecf4-d723-41a7-aef8-735789ead566 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:41.342402 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cdecf4-d723-41a7-aef8-735789ead566 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:41.457062 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 904/1835] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:19:41 2022] POST /identity/v3/projects => generated 375 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:19:41.464347 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8781384-3595-4523-a787-e53bb3ef7088 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:41.478446 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8781384-3595-4523-a787-e53bb3ef7088 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:41.543857 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe3c051-b50a-4124-b1b4-82567357e9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:41.544562 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe3c051-b50a-4124-b1b4-82567357e9f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:41.544873 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe3c051-b50a-4124-b1b4-82567357e9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:41.545197 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe3c051-b50a-4124-b1b4-82567357e9f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:41.545903 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe3c051-b50a-4124-b1b4-82567357e9f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:41.547852 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe3c051-b50a-4124-b1b4-82567357e9f1 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:41.652541 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 932/1836] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:19:41 2022] POST /identity/v3/users => generated 288 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:19:41.654482 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cdecf4-d723-41a7-aef8-735789ead566 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:41.665502 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cdecf4-d723-41a7-aef8-735789ead566 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:41.670136 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670b3ff9-f0aa-4f34-b37b-6986e5bb349e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:41.670814 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b3ff9-f0aa-4f34-b37b-6986e5bb349e admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:41.671104 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b3ff9-f0aa-4f34-b37b-6986e5bb349e admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:41.671379 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b3ff9-f0aa-4f34-b37b-6986e5bb349e admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:41.672143 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670b3ff9-f0aa-4f34-b37b-6986e5bb349e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:41.673846 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670b3ff9-f0aa-4f34-b37b-6986e5bb349e admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:41.686644 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 905/1837] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:19:41.690671 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe3c051-b50a-4124-b1b4-82567357e9f1 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:41.701750 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe3c051-b50a-4124-b1b4-82567357e9f1 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:41.709319 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e830418e-f281-4c13-a121-0181f4df4e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:41.709319 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830418e-f281-4c13-a121-0181f4df4e4c admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:41.709319 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830418e-f281-4c13-a121-0181f4df4e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:41.709319 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830418e-f281-4c13-a121-0181f4df4e4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:41.709667 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e830418e-f281-4c13-a121-0181f4df4e4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:41.710683 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e830418e-f281-4c13-a121-0181f4df4e4c admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:41.721585 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 933/1838] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:19:41.725554 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670b3ff9-f0aa-4f34-b37b-6986e5bb349e admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:41.735600 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670b3ff9-f0aa-4f34-b37b-6986e5bb349e admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:41.740503 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb04aa4-07e7-4db6-a2bc-22b7e6c762f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:41.741389 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb04aa4-07e7-4db6-a2bc-22b7e6c762f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:41.741674 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb04aa4-07e7-4db6-a2bc-22b7e6c762f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:41.742498 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb04aa4-07e7-4db6-a2bc-22b7e6c762f2 admin admin] PATH_INFO: `/v3/projects/895dbe17859e43a18bb013a98f83a45e/users/7b91d4485efb4a689a892233333959ba/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:41.761280 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb04aa4-07e7-4db6-a2bc-22b7e6c762f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=895dbe17859e43a18bb013a98f83a45e, user_id=7b91d4485efb4a689a892233333959ba, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:41.764354 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb04aa4-07e7-4db6-a2bc-22b7e6c762f2 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:41.866270 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 906/1839] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:19:41 2022] PUT /identity/v3/projects/895dbe17859e43a18bb013a98f83a45e/users/7b91d4485efb4a689a892233333959ba/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:19:41.876666 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52d37e-517d-4177-95f1-9dbbf2ef8e2d None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:41.877712 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52d37e-517d-4177-95f1-9dbbf2ef8e2d None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:41.878002 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52d37e-517d-4177-95f1-9dbbf2ef8e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:41.907997 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-ec52d37e-517d-4177-95f1-9dbbf2ef8e2d None None] MFA Rules not processed for user `7b91d4485efb4a689a892233333959ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:41.909431 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-ec52d37e-517d-4177-95f1-9dbbf2ef8e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:41.990704 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 934/1840] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:19:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:19:42.002626 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb04aa4-07e7-4db6-a2bc-22b7e6c762f2 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:42.004619 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-2eb04aa4-07e7-4db6-a2bc-22b7e6c762f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:42.065728 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb04aa4-07e7-4db6-a2bc-22b7e6c762f2 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:42.069355 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f162b30-0bb7-493f-ac81-213378b77667 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:42.070059 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f162b30-0bb7-493f-ac81-213378b77667 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:42.070338 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f162b30-0bb7-493f-ac81-213378b77667 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:42.070612 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f162b30-0bb7-493f-ac81-213378b77667 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:42.079229 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f162b30-0bb7-493f-ac81-213378b77667 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:42.080825 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f162b30-0bb7-493f-ac81-213378b77667 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:42.090140 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 907/1841] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:19:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:19:42.795716 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec52d37e-517d-4177-95f1-9dbbf2ef8e2d None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:42.797608 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-ec52d37e-517d-4177-95f1-9dbbf2ef8e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:42.978085 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec52d37e-517d-4177-95f1-9dbbf2ef8e2d None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:42.983420 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f3020-ac3f-4976-becc-b7f90302d3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:42.984993 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f3020-ac3f-4976-becc-b7f90302d3b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:42.985637 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f3020-ac3f-4976-becc-b7f90302d3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:42.986135 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f3020-ac3f-4976-becc-b7f90302d3b3 admin admin] PATH_INFO: `/v3/users/8e79a8defc17460690846cc81f6c2679` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:42.988041 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2f3020-ac3f-4976-becc-b7f90302d3b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e79a8defc17460690846cc81f6c2679)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:42.990521 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2f3020-ac3f-4976-becc-b7f90302d3b3 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:43.258638 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-cc2f3020-ac3f-4976-becc-b7f90302d3b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e79a8defc17460690846cc81f6c2679'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:43.269821 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-cc2f3020-ac3f-4976-becc-b7f90302d3b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e79a8defc17460690846cc81f6c2679'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:43.312039 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-cc2f3020-ac3f-4976-becc-b7f90302d3b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e79a8defc17460690846cc81f6c2679'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:43.317253 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-cc2f3020-ac3f-4976-becc-b7f90302d3b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e79a8defc17460690846cc81f6c2679'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:43.317253 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-cc2f3020-ac3f-4976-becc-b7f90302d3b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e79a8defc17460690846cc81f6c2679'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:43.410009 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 935/1842] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:19:42 2022] DELETE /identity/v3/users/8e79a8defc17460690846cc81f6c2679 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:19:43.413650 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883c1f4-c91f-42a6-a292-ec0cef1d9e61 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:43.414167 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883c1f4-c91f-42a6-a292-ec0cef1d9e61 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:43.415163 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883c1f4-c91f-42a6-a292-ec0cef1d9e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:43.440107 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-8883c1f4-c91f-42a6-a292-ec0cef1d9e61 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:43.441443 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-8883c1f4-c91f-42a6-a292-ec0cef1d9e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:43.520458 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 908/1843] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:19:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:19:43.530737 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f3020-ac3f-4976-becc-b7f90302d3b3 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:43.532661 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-cc2f3020-ac3f-4976-becc-b7f90302d3b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:43.611913 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f3020-ac3f-4976-becc-b7f90302d3b3 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:43.616230 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0022765-a2b9-4205-89ae-99b1c6d335bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:43.616976 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0022765-a2b9-4205-89ae-99b1c6d335bc service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:43.617214 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0022765-a2b9-4205-89ae-99b1c6d335bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:43.617488 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0022765-a2b9-4205-89ae-99b1c6d335bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:43.627454 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0022765-a2b9-4205-89ae-99b1c6d335bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:43.628945 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0022765-a2b9-4205-89ae-99b1c6d335bc service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:43.639822 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 936/1844] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:19:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:19:43.817044 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb54b26e-73e3-4b38-8ad1-87ffed3ebe3f None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:43.817260 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb54b26e-73e3-4b38-8ad1-87ffed3ebe3f None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:43.817835 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb54b26e-73e3-4b38-8ad1-87ffed3ebe3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:43.839136 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-eb54b26e-73e3-4b38-8ad1-87ffed3ebe3f None None] MFA Rules not processed for user `7b91d4485efb4a689a892233333959ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:43.840759 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-eb54b26e-73e3-4b38-8ad1-87ffed3ebe3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:43.902438 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 909/1845] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:19:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:19:44.275405 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0022765-a2b9-4205-89ae-99b1c6d335bc service neutron] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:44.277034 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-b0022765-a2b9-4205-89ae-99b1c6d335bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:44.300462 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0022765-a2b9-4205-89ae-99b1c6d335bc service neutron] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:44.309662 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f8574e-ecde-4d34-b443-ffcb37858105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:44.310880 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8574e-ecde-4d34-b443-ffcb37858105 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:44.320525 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8574e-ecde-4d34-b443-ffcb37858105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:44.321497 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8574e-ecde-4d34-b443-ffcb37858105 admin admin] PATH_INFO: `/v3/projects/d53c5194a9674c75b5d36f4c17cec8da` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:44.323985 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f8574e-ecde-4d34-b443-ffcb37858105 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d53c5194a9674c75b5d36f4c17cec8da)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:44.328547 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f8574e-ecde-4d34-b443-ffcb37858105 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:44.453237 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb54b26e-73e3-4b38-8ad1-87ffed3ebe3f None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:44.455624 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-eb54b26e-73e3-4b38-8ad1-87ffed3ebe3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:44.479008 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb54b26e-73e3-4b38-8ad1-87ffed3ebe3f None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:44.490001 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-68f8574e-ecde-4d34-b443-ffcb37858105 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd53c5194a9674c75b5d36f4c17cec8da', 'request_id': 'req-68f8574e-ecde-4d34-b443-ffcb37858105'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:44.500190 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-68f8574e-ecde-4d34-b443-ffcb37858105 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd53c5194a9674c75b5d36f4c17cec8da', 'request_id': 'req-68f8574e-ecde-4d34-b443-ffcb37858105'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:44.517973 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-68f8574e-ecde-4d34-b443-ffcb37858105 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd53c5194a9674c75b5d36f4c17cec8da', 'request_id': 'req-68f8574e-ecde-4d34-b443-ffcb37858105'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:44.560435 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c439d299-ed0a-4758-a8b7-0a98fa0212d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:44.561290 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c439d299-ed0a-4758-a8b7-0a98fa0212d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:44.561625 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c439d299-ed0a-4758-a8b7-0a98fa0212d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:44.561951 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c439d299-ed0a-4758-a8b7-0a98fa0212d9 admin admin] PATH_INFO: `/v3/users/4b3fd3f690a3407198a1dc49ceb275e4` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:44.563195 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c439d299-ed0a-4758-a8b7-0a98fa0212d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b3fd3f690a3407198a1dc49ceb275e4)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:44.565884 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c439d299-ed0a-4758-a8b7-0a98fa0212d9 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:44.649272 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-68f8574e-ecde-4d34-b443-ffcb37858105 admin admin] The token cache is being invalidate because project d53c5194a9674c75b5d36f4c17cec8da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:19:44.649678 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-68f8574e-ecde-4d34-b443-ffcb37858105 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:44.650560 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-68f8574e-ecde-4d34-b443-ffcb37858105 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:44.653756 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 937/1846] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:19:44 2022] DELETE /identity/v3/projects/d53c5194a9674c75b5d36f4c17cec8da => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:19:44.659827 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f8574e-ecde-4d34-b443-ffcb37858105 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:44.670511 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-68f8574e-ecde-4d34-b443-ffcb37858105 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:44.700642 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f8574e-ecde-4d34-b443-ffcb37858105 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:44.712923 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6ba686-ea0a-489d-8dd2-63fa0f069f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:44.713853 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ba686-ea0a-489d-8dd2-63fa0f069f99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:44.715326 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ba686-ea0a-489d-8dd2-63fa0f069f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:44.715609 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ba686-ea0a-489d-8dd2-63fa0f069f99 admin admin] PATH_INFO: `/v3/users/f30a52f63fbc4555883a8f94f7fd1c67` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:44.721726 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6ba686-ea0a-489d-8dd2-63fa0f069f99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f30a52f63fbc4555883a8f94f7fd1c67)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:44.723663 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6ba686-ea0a-489d-8dd2-63fa0f069f99 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:44.766950 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c439d299-ed0a-4758-a8b7-0a98fa0212d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b3fd3f690a3407198a1dc49ceb275e4'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:44.770523 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c439d299-ed0a-4758-a8b7-0a98fa0212d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b3fd3f690a3407198a1dc49ceb275e4'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:44.781490 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c439d299-ed0a-4758-a8b7-0a98fa0212d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b3fd3f690a3407198a1dc49ceb275e4'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:44.892807 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c439d299-ed0a-4758-a8b7-0a98fa0212d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b3fd3f690a3407198a1dc49ceb275e4'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:44.893396 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c439d299-ed0a-4758-a8b7-0a98fa0212d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b3fd3f690a3407198a1dc49ceb275e4'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:44.912299 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 910/1847] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:19:44 2022] DELETE /identity/v3/users/4b3fd3f690a3407198a1dc49ceb275e4 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:19:44.917716 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d8be8-0dc6-4bc8-85f5-9e1c1636d9e2 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:44.918274 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d8be8-0dc6-4bc8-85f5-9e1c1636d9e2 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:44.918777 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d8be8-0dc6-4bc8-85f5-9e1c1636d9e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:44.937128 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-ec1d8be8-0dc6-4bc8-85f5-9e1c1636d9e2 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:44.938465 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-ec1d8be8-0dc6-4bc8-85f5-9e1c1636d9e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:44.994470 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-6c6ba686-ea0a-489d-8dd2-63fa0f069f99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f30a52f63fbc4555883a8f94f7fd1c67'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:45.003203 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-6c6ba686-ea0a-489d-8dd2-63fa0f069f99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f30a52f63fbc4555883a8f94f7fd1c67'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:45.013329 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 911/1848] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:19:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:19:45.018067 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-6c6ba686-ea0a-489d-8dd2-63fa0f069f99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f30a52f63fbc4555883a8f94f7fd1c67'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:45.019053 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-6c6ba686-ea0a-489d-8dd2-63fa0f069f99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f30a52f63fbc4555883a8f94f7fd1c67'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:45.019669 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-6c6ba686-ea0a-489d-8dd2-63fa0f069f99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f30a52f63fbc4555883a8f94f7fd1c67'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:45.024272 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d8be8-0dc6-4bc8-85f5-9e1c1636d9e2 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:45.025636 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-ec1d8be8-0dc6-4bc8-85f5-9e1c1636d9e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:45.085016 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d8be8-0dc6-4bc8-85f5-9e1c1636d9e2 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:45.090223 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d412c86b-5b80-4b45-8240-16a2181be2ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:45.090942 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412c86b-5b80-4b45-8240-16a2181be2ac service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:45.091227 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412c86b-5b80-4b45-8240-16a2181be2ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:45.091525 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412c86b-5b80-4b45-8240-16a2181be2ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:45.093512 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-d412c86b-5b80-4b45-8240-16a2181be2ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:45.113197 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d412c86b-5b80-4b45-8240-16a2181be2ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:45.114649 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d412c86b-5b80-4b45-8240-16a2181be2ac service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:45.115292 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 938/1849] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:19:44 2022] DELETE /identity/v3/users/f30a52f63fbc4555883a8f94f7fd1c67 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:19:45.125746 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 912/1850] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:19:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:19:45.774981 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6ba686-ea0a-489d-8dd2-63fa0f069f99 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:45.776552 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-6c6ba686-ea0a-489d-8dd2-63fa0f069f99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:45.784456 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d412c86b-5b80-4b45-8240-16a2181be2ac service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:45.785968 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-d412c86b-5b80-4b45-8240-16a2181be2ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:45.814231 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d412c86b-5b80-4b45-8240-16a2181be2ac service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:45.893558 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffa0dfb-7beb-42ba-9468-69a26fde15ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:45.894175 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6ba686-ea0a-489d-8dd2-63fa0f069f99 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:45.894465 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa0dfb-7beb-42ba-9468-69a26fde15ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:45.894805 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa0dfb-7beb-42ba-9468-69a26fde15ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:45.895024 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa0dfb-7beb-42ba-9468-69a26fde15ea admin admin] PATH_INFO: `/v3/projects/f20d4b314f76478380f8d61074565721` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:45.897020 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffa0dfb-7beb-42ba-9468-69a26fde15ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=f20d4b314f76478380f8d61074565721)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:45.899884 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffa0dfb-7beb-42ba-9468-69a26fde15ea admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:45.900718 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e1719d-0e9b-4c7f-a7a5-4eaa555a3f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:45.901960 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1719d-0e9b-4c7f-a7a5-4eaa555a3f50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:45.902633 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1719d-0e9b-4c7f-a7a5-4eaa555a3f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:45.902917 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1719d-0e9b-4c7f-a7a5-4eaa555a3f50 admin admin] PATH_INFO: `/v3/projects/f1b4eff54254442caf4b6c03736e558c` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:45.904537 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e1719d-0e9b-4c7f-a7a5-4eaa555a3f50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1b4eff54254442caf4b6c03736e558c)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:45.906565 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e1719d-0e9b-4c7f-a7a5-4eaa555a3f50 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:46.022184 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-5ffa0dfb-7beb-42ba-9468-69a26fde15ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f20d4b314f76478380f8d61074565721', 'request_id': 'req-5ffa0dfb-7beb-42ba-9468-69a26fde15ea'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:46.028415 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-5ffa0dfb-7beb-42ba-9468-69a26fde15ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f20d4b314f76478380f8d61074565721', 'request_id': 'req-5ffa0dfb-7beb-42ba-9468-69a26fde15ea'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:46.037534 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-5ffa0dfb-7beb-42ba-9468-69a26fde15ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f20d4b314f76478380f8d61074565721', 'request_id': 'req-5ffa0dfb-7beb-42ba-9468-69a26fde15ea'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:46.054186 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-36e1719d-0e9b-4c7f-a7a5-4eaa555a3f50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1b4eff54254442caf4b6c03736e558c', 'request_id': 'req-36e1719d-0e9b-4c7f-a7a5-4eaa555a3f50'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:46.059337 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-36e1719d-0e9b-4c7f-a7a5-4eaa555a3f50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1b4eff54254442caf4b6c03736e558c', 'request_id': 'req-36e1719d-0e9b-4c7f-a7a5-4eaa555a3f50'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:46.065338 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-36e1719d-0e9b-4c7f-a7a5-4eaa555a3f50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1b4eff54254442caf4b6c03736e558c', 'request_id': 'req-36e1719d-0e9b-4c7f-a7a5-4eaa555a3f50'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:46.149440 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-5ffa0dfb-7beb-42ba-9468-69a26fde15ea admin admin] The token cache is being invalidate because project f20d4b314f76478380f8d61074565721 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:19:46.149637 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-5ffa0dfb-7beb-42ba-9468-69a26fde15ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:46.150287 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-5ffa0dfb-7beb-42ba-9468-69a26fde15ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:46.151866 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 913/1851] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:19:45 2022] DELETE /identity/v3/projects/f20d4b314f76478380f8d61074565721 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:19:46.156225 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffa0dfb-7beb-42ba-9468-69a26fde15ea admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:46.157696 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-5ffa0dfb-7beb-42ba-9468-69a26fde15ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:46.234048 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffa0dfb-7beb-42ba-9468-69a26fde15ea admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:46.291727 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-36e1719d-0e9b-4c7f-a7a5-4eaa555a3f50 admin admin] The token cache is being invalidate because project f1b4eff54254442caf4b6c03736e558c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:19:46.292203 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-36e1719d-0e9b-4c7f-a7a5-4eaa555a3f50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:46.292989 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-36e1719d-0e9b-4c7f-a7a5-4eaa555a3f50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:46.294918 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 939/1852] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:19:45 2022] DELETE /identity/v3/projects/f1b4eff54254442caf4b6c03736e558c => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:19:46.299433 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b16374-f91a-4851-a9c1-51c36ffe1fed None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:46.299839 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b16374-f91a-4851-a9c1-51c36ffe1fed None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:46.300284 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b16374-f91a-4851-a9c1-51c36ffe1fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:46.303638 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be15ca74-ba3f-4ea4-a3c9-07c4e30d2641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:46.304799 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15ca74-ba3f-4ea4-a3c9-07c4e30d2641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:46.305226 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15ca74-ba3f-4ea4-a3c9-07c4e30d2641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:46.305667 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15ca74-ba3f-4ea4-a3c9-07c4e30d2641 admin admin] PATH_INFO: `/v3/users/e21118a68c9b4890948b103e09ce0414` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:46.307096 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be15ca74-ba3f-4ea4-a3c9-07c4e30d2641 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e21118a68c9b4890948b103e09ce0414)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:46.309294 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be15ca74-ba3f-4ea4-a3c9-07c4e30d2641 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:46.329826 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-e1b16374-f91a-4851-a9c1-51c36ffe1fed None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:46.331606 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-e1b16374-f91a-4851-a9c1-51c36ffe1fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:46.341812 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 940/1853] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:19:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:19:46.349731 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0fffb9-eacc-4087-a3fc-b3685017d936 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:46.350018 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0fffb9-eacc-4087-a3fc-b3685017d936 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:46.350295 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0fffb9-eacc-4087-a3fc-b3685017d936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:46.368681 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-4b0fffb9-eacc-4087-a3fc-b3685017d936 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:46.373482 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-4b0fffb9-eacc-4087-a3fc-b3685017d936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:46.378645 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 941/1854] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:19:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:19:46.383441 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0fffb9-eacc-4087-a3fc-b3685017d936 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:46.403009 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0fffb9-eacc-4087-a3fc-b3685017d936 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:46.408494 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0729c8d-988d-44ac-bd2c-ca9954a288f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:46.409171 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0729c8d-988d-44ac-bd2c-ca9954a288f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:46.409499 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0729c8d-988d-44ac-bd2c-ca9954a288f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:46.409779 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0729c8d-988d-44ac-bd2c-ca9954a288f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:46.410595 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0729c8d-988d-44ac-bd2c-ca9954a288f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:19:46.410906 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0729c8d-988d-44ac-bd2c-ca9954a288f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:46.413259 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0729c8d-988d-44ac-bd2c-ca9954a288f6 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:46.431507 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 942/1855] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 10 03:19:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:19:46.436364 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0729c8d-988d-44ac-bd2c-ca9954a288f6 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:46.453357 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0729c8d-988d-44ac-bd2c-ca9954a288f6 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:46.465927 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7091349-db38-4d0c-99ab-590464c83734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:46.466615 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7091349-db38-4d0c-99ab-590464c83734 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:46.466906 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7091349-db38-4d0c-99ab-590464c83734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:46.467184 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7091349-db38-4d0c-99ab-590464c83734 admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:46.467886 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7091349-db38-4d0c-99ab-590464c83734 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:46.469858 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7091349-db38-4d0c-99ab-590464c83734 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:46.565543 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-be15ca74-ba3f-4ea4-a3c9-07c4e30d2641 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e21118a68c9b4890948b103e09ce0414'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:46.566761 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-be15ca74-ba3f-4ea4-a3c9-07c4e30d2641 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e21118a68c9b4890948b103e09ce0414'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:46.579229 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-be15ca74-ba3f-4ea4-a3c9-07c4e30d2641 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e21118a68c9b4890948b103e09ce0414'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:46.606364 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 943/1856] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:19:46 2022] POST /identity/v3/projects => generated 369 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:19:46.610067 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7091349-db38-4d0c-99ab-590464c83734 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:46.685267 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-be15ca74-ba3f-4ea4-a3c9-07c4e30d2641 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e21118a68c9b4890948b103e09ce0414'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:46.685984 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-be15ca74-ba3f-4ea4-a3c9-07c4e30d2641 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e21118a68c9b4890948b103e09ce0414'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:46.697114 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7091349-db38-4d0c-99ab-590464c83734 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:46.720407 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09099a93-2001-43ff-a7cd-5589c44fd004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:46.721702 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09099a93-2001-43ff-a7cd-5589c44fd004 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:46.722133 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09099a93-2001-43ff-a7cd-5589c44fd004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:46.722614 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09099a93-2001-43ff-a7cd-5589c44fd004 admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:46.726904 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09099a93-2001-43ff-a7cd-5589c44fd004 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:46.727414 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09099a93-2001-43ff-a7cd-5589c44fd004 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:46.751752 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 914/1857] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:19:46 2022] DELETE /identity/v3/users/e21118a68c9b4890948b103e09ce0414 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:19:46.848310 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be15ca74-ba3f-4ea4-a3c9-07c4e30d2641 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:46.850571 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-be15ca74-ba3f-4ea4-a3c9-07c4e30d2641 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:46.853107 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 944/1858] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:19:46 2022] POST /identity/v3/users => generated 285 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:19:46.922694 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be15ca74-ba3f-4ea4-a3c9-07c4e30d2641 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:46.928909 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3e17ca-5b9e-4683-9985-3e9259e15d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:46.929893 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e17ca-5b9e-4683-9985-3e9259e15d61 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:46.930271 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e17ca-5b9e-4683-9985-3e9259e15d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:46.930765 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e17ca-5b9e-4683-9985-3e9259e15d61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:46.931704 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3e17ca-5b9e-4683-9985-3e9259e15d61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:46.933582 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3e17ca-5b9e-4683-9985-3e9259e15d61 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:46.951174 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09099a93-2001-43ff-a7cd-5589c44fd004 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:46.952374 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 915/1859] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:19:46 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:19:46.962811 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09099a93-2001-43ff-a7cd-5589c44fd004 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:46.979828 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f483ac-a9b8-4d80-9f28-6a4f279dbd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:46.980968 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f483ac-a9b8-4d80-9f28-6a4f279dbd5a admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:46.981426 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f483ac-a9b8-4d80-9f28-6a4f279dbd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:46.981845 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f483ac-a9b8-4d80-9f28-6a4f279dbd5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:46.982725 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f483ac-a9b8-4d80-9f28-6a4f279dbd5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:46.984681 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f483ac-a9b8-4d80-9f28-6a4f279dbd5a admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:47.012821 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 945/1860] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:19:46 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:19:47.014951 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3e17ca-5b9e-4683-9985-3e9259e15d61 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:47.033139 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3e17ca-5b9e-4683-9985-3e9259e15d61 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:47.043158 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d6e920-1a42-459a-98ba-77a52c652276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:47.044416 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6e920-1a42-459a-98ba-77a52c652276 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:47.044938 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6e920-1a42-459a-98ba-77a52c652276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:47.047028 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6e920-1a42-459a-98ba-77a52c652276 admin admin] PATH_INFO: `/v3/projects/a850ed0bd0424d0aac3d869f046e48a3/users/20044d77976341a6be25507fec5c18b8/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:47.065456 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d6e920-1a42-459a-98ba-77a52c652276 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a850ed0bd0424d0aac3d869f046e48a3, user_id=20044d77976341a6be25507fec5c18b8, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:47.069837 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d6e920-1a42-459a-98ba-77a52c652276 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:47.173834 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 916/1861] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:19:47 2022] PUT /identity/v3/projects/a850ed0bd0424d0aac3d869f046e48a3/users/20044d77976341a6be25507fec5c18b8/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:19:47.184249 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716b06a-ac02-4190-bc7c-78b431f8bc1a None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:47.184948 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716b06a-ac02-4190-bc7c-78b431f8bc1a None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:47.185597 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716b06a-ac02-4190-bc7c-78b431f8bc1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:47.244170 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-f716b06a-ac02-4190-bc7c-78b431f8bc1a None None] MFA Rules not processed for user `20044d77976341a6be25507fec5c18b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:47.245398 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-f716b06a-ac02-4190-bc7c-78b431f8bc1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:47.371677 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 946/1862] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:19:47 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:19:47.373101 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d6e920-1a42-459a-98ba-77a52c652276 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:47.466277 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d6e920-1a42-459a-98ba-77a52c652276 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:47.475222 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74581135-fd9b-4791-919b-33a6d2f2e5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:47.476632 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74581135-fd9b-4791-919b-33a6d2f2e5b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:47.477082 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74581135-fd9b-4791-919b-33a6d2f2e5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:47.477357 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74581135-fd9b-4791-919b-33a6d2f2e5b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:47.478062 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74581135-fd9b-4791-919b-33a6d2f2e5b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:47.480114 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74581135-fd9b-4791-919b-33a6d2f2e5b5 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:47.560882 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 917/1863] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:19:47 2022] POST /identity/v3/projects => generated 367 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:19:47.564093 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f716b06a-ac02-4190-bc7c-78b431f8bc1a None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:47.576777 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f716b06a-ac02-4190-bc7c-78b431f8bc1a None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:47.611523 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74581135-fd9b-4791-919b-33a6d2f2e5b5 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:47.613750 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-74581135-fd9b-4791-919b-33a6d2f2e5b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:47.641546 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f263687a-2d57-4903-96f7-4f40318b865f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:47.642227 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263687a-2d57-4903-96f7-4f40318b865f admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:47.642509 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263687a-2d57-4903-96f7-4f40318b865f admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:47.642784 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263687a-2d57-4903-96f7-4f40318b865f admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:47.643616 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f263687a-2d57-4903-96f7-4f40318b865f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:47.646657 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f263687a-2d57-4903-96f7-4f40318b865f admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:47.694122 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74581135-fd9b-4791-919b-33a6d2f2e5b5 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:47.700792 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e96af6-66b3-4483-b7d5-cb8d1278e5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:47.701671 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e96af6-66b3-4483-b7d5-cb8d1278e5a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:47.701980 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e96af6-66b3-4483-b7d5-cb8d1278e5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:47.702265 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e96af6-66b3-4483-b7d5-cb8d1278e5a0 admin admin] PATH_INFO: `/v3/projects/6a554ee34418485dbd2546fa52e7e6b5` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:47.703430 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e96af6-66b3-4483-b7d5-cb8d1278e5a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a554ee34418485dbd2546fa52e7e6b5)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:47.706112 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e96af6-66b3-4483-b7d5-cb8d1278e5a0 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:47.747065 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 947/1864] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:19:47 2022] POST /identity/v3/users => generated 290 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:19:47.751335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f263687a-2d57-4903-96f7-4f40318b865f admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:47.761415 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f263687a-2d57-4903-96f7-4f40318b865f admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:47.765959 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6528abac-be59-4373-8b69-53139df1976a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:47.766606 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528abac-be59-4373-8b69-53139df1976a admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:47.766890 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528abac-be59-4373-8b69-53139df1976a admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:47.767171 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528abac-be59-4373-8b69-53139df1976a admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:47.768424 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6528abac-be59-4373-8b69-53139df1976a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:47.770239 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6528abac-be59-4373-8b69-53139df1976a admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:47.781680 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 948/1865] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:19:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:19:47.786126 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6528abac-be59-4373-8b69-53139df1976a admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:47.797179 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6528abac-be59-4373-8b69-53139df1976a admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:47.804868 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d097ef0f-e092-43a0-9594-6da425fcff21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:47.805866 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097ef0f-e092-43a0-9594-6da425fcff21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:47.809380 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097ef0f-e092-43a0-9594-6da425fcff21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:47.809380 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097ef0f-e092-43a0-9594-6da425fcff21 admin admin] PATH_INFO: `/v3/projects/5556e0424f954320811aa70f6f661cb0/users/96c3abbf2ccc4c4f813e112be648cb3c/roles/43105000610f402ca2486e7648018cca` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:47.821715 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d097ef0f-e092-43a0-9594-6da425fcff21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5556e0424f954320811aa70f6f661cb0, user_id=96c3abbf2ccc4c4f813e112be648cb3c, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:47.824406 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d097ef0f-e092-43a0-9594-6da425fcff21 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:47.843130 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-18e96af6-66b3-4483-b7d5-cb8d1278e5a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a554ee34418485dbd2546fa52e7e6b5', 'request_id': 'req-18e96af6-66b3-4483-b7d5-cb8d1278e5a0'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:47.848594 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-18e96af6-66b3-4483-b7d5-cb8d1278e5a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a554ee34418485dbd2546fa52e7e6b5', 'request_id': 'req-18e96af6-66b3-4483-b7d5-cb8d1278e5a0'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:47.854883 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-18e96af6-66b3-4483-b7d5-cb8d1278e5a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a554ee34418485dbd2546fa52e7e6b5', 'request_id': 'req-18e96af6-66b3-4483-b7d5-cb8d1278e5a0'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:47.939838 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-18e96af6-66b3-4483-b7d5-cb8d1278e5a0 admin admin] The token cache is being invalidate because project 6a554ee34418485dbd2546fa52e7e6b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:19:47.940172 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-18e96af6-66b3-4483-b7d5-cb8d1278e5a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:47.940674 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 949/1866] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:19:47 2022] PUT /identity/v3/projects/5556e0424f954320811aa70f6f661cb0/users/96c3abbf2ccc4c4f813e112be648cb3c/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:19:47.941113 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-18e96af6-66b3-4483-b7d5-cb8d1278e5a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:47.942556 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 918/1867] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:19:47 2022] DELETE /identity/v3/projects/6a554ee34418485dbd2546fa52e7e6b5 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:19:47.944785 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d097ef0f-e092-43a0-9594-6da425fcff21 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:47.946899 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-d097ef0f-e092-43a0-9594-6da425fcff21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:47.947911 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d5dd2-6688-4d25-b80f-60582ca27670 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:47.948268 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d5dd2-6688-4d25-b80f-60582ca27670 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:47.948552 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d5dd2-6688-4d25-b80f-60582ca27670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:47.967949 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-058d5dd2-6688-4d25-b80f-60582ca27670 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:47.969205 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-058d5dd2-6688-4d25-b80f-60582ca27670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:48.016588 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d097ef0f-e092-43a0-9594-6da425fcff21 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:48.021398 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0042d6-361c-45b1-a442-331f11d4d72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:48.022071 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0042d6-361c-45b1-a442-331f11d4d72c admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:48.022408 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0042d6-361c-45b1-a442-331f11d4d72c admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:48.022695 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0042d6-361c-45b1-a442-331f11d4d72c admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:48.024080 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0042d6-361c-45b1-a442-331f11d4d72c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:48.025887 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0042d6-361c-45b1-a442-331f11d4d72c admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:48.034974 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 919/1868] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:19:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:19:48.036551 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 950/1869] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:19:47 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:19:48.042322 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d5dd2-6688-4d25-b80f-60582ca27670 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:48.042792 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe15edbd-1481-41ea-b77e-08750e17dabb None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:48.043129 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe15edbd-1481-41ea-b77e-08750e17dabb None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:48.043412 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe15edbd-1481-41ea-b77e-08750e17dabb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:48.051942 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d5dd2-6688-4d25-b80f-60582ca27670 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:48.056905 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab19e1d3-a5c0-4547-b7cd-e0e71e41de4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:48.057804 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19e1d3-a5c0-4547-b7cd-e0e71e41de4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:48.058093 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19e1d3-a5c0-4547-b7cd-e0e71e41de4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:48.058366 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19e1d3-a5c0-4547-b7cd-e0e71e41de4b admin admin] PATH_INFO: `/v3/projects/5556e0424f954320811aa70f6f661cb0/users/96c3abbf2ccc4c4f813e112be648cb3c/roles/43105000610f402ca2486e7648018cca` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:48.060625 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab19e1d3-a5c0-4547-b7cd-e0e71e41de4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5556e0424f954320811aa70f6f661cb0, user_id=96c3abbf2ccc4c4f813e112be648cb3c, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:48.062264 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-fe15edbd-1481-41ea-b77e-08750e17dabb None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:48.063437 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab19e1d3-a5c0-4547-b7cd-e0e71e41de4b admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:48.063550 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-fe15edbd-1481-41ea-b77e-08750e17dabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:48.086766 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 951/1870] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:19:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:19:48.087584 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 920/1871] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:19:48 2022] PUT /identity/v3/projects/5556e0424f954320811aa70f6f661cb0/users/96c3abbf2ccc4c4f813e112be648cb3c/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:19:48.087665 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe15edbd-1481-41ea-b77e-08750e17dabb None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:48.088567 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db4d64-e5a2-4f30-95d8-1675ce00e8c5 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:48.088763 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db4d64-e5a2-4f30-95d8-1675ce00e8c5 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:48.089003 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db4d64-e5a2-4f30-95d8-1675ce00e8c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:48.089691 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe15edbd-1481-41ea-b77e-08750e17dabb None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:48.117422 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-45db4d64-e5a2-4f30-95d8-1675ce00e8c5 None None] MFA Rules not processed for user `96c3abbf2ccc4c4f813e112be648cb3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:48.118909 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-45db4d64-e5a2-4f30-95d8-1675ce00e8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:48.154516 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3442a0f-662e-4031-a1aa-b450f9e7eb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:48.155377 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3442a0f-662e-4031-a1aa-b450f9e7eb53 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:48.155761 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3442a0f-662e-4031-a1aa-b450f9e7eb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:48.156171 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3442a0f-662e-4031-a1aa-b450f9e7eb53 admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:48.165908 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3442a0f-662e-4031-a1aa-b450f9e7eb53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:19:48.165908 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3442a0f-662e-4031-a1aa-b450f9e7eb53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:48.165908 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3442a0f-662e-4031-a1aa-b450f9e7eb53 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:48.183134 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 952/1872] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 10 03:19:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:19:48.184423 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3442a0f-662e-4031-a1aa-b450f9e7eb53 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:48.196522 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3442a0f-662e-4031-a1aa-b450f9e7eb53 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:48.201401 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e85c798-8671-4405-ac78-19174add8891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:48.202245 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85c798-8671-4405-ac78-19174add8891 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:48.202605 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85c798-8671-4405-ac78-19174add8891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:48.203010 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85c798-8671-4405-ac78-19174add8891 admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:48.203788 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e85c798-8671-4405-ac78-19174add8891 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:48.205793 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e85c798-8671-4405-ac78-19174add8891 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:48.214093 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 921/1873] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:19:48 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:19:48.225076 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db4d64-e5a2-4f30-95d8-1675ce00e8c5 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:48.226510 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-45db4d64-e5a2-4f30-95d8-1675ce00e8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:48.286665 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db4d64-e5a2-4f30-95d8-1675ce00e8c5 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:48.296433 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7c4bbb-d053-4279-b821-6ee1aaa22c5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:48.296433 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c4bbb-d053-4279-b821-6ee1aaa22c5b service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:48.296433 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c4bbb-d053-4279-b821-6ee1aaa22c5b service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:48.296433 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c4bbb-d053-4279-b821-6ee1aaa22c5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:48.304901 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7c4bbb-d053-4279-b821-6ee1aaa22c5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:48.306332 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7c4bbb-d053-4279-b821-6ee1aaa22c5b service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:48.318709 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 922/1874] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:19:48 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:19:48.330867 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 953/1875] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:19:48 2022] POST /identity/v3/projects => generated 407 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:19:48.332920 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7c4bbb-d053-4279-b821-6ee1aaa22c5b service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:48.346448 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7c4bbb-d053-4279-b821-6ee1aaa22c5b service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:48.417619 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe85ee19-30ed-4d81-b1eb-a1d047d7d99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:48.417619 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe85ee19-30ed-4d81-b1eb-a1d047d7d99e admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:48.417619 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe85ee19-30ed-4d81-b1eb-a1d047d7d99e admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:48.417619 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe85ee19-30ed-4d81-b1eb-a1d047d7d99e admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:48.417970 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe85ee19-30ed-4d81-b1eb-a1d047d7d99e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:48.417970 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe85ee19-30ed-4d81-b1eb-a1d047d7d99e admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:48.431161 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e85c798-8671-4405-ac78-19174add8891 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:48.431161 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-1e85c798-8671-4405-ac78-19174add8891 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:48.505668 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e85c798-8671-4405-ac78-19174add8891 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:48.509819 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df295206-b620-4fd1-8d98-8c8f17ce4bc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:48.510161 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df295206-b620-4fd1-8d98-8c8f17ce4bc0 service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:48.510500 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df295206-b620-4fd1-8d98-8c8f17ce4bc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:48.510868 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df295206-b620-4fd1-8d98-8c8f17ce4bc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:48.512826 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-df295206-b620-4fd1-8d98-8c8f17ce4bc0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:48.571401 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 923/1876] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:19:48 2022] POST /identity/v3/users => generated 304 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:19:48.572458 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe85ee19-30ed-4d81-b1eb-a1d047d7d99e admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:48.590559 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df295206-b620-4fd1-8d98-8c8f17ce4bc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:48.592346 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df295206-b620-4fd1-8d98-8c8f17ce4bc0 service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:48.605034 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe85ee19-30ed-4d81-b1eb-a1d047d7d99e admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:48.605340 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 954/1877] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:19:48 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:19:48.615238 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff868149-f7ba-49a0-a656-3a067116221a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:48.615951 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff868149-f7ba-49a0-a656-3a067116221a admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:48.617058 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff868149-f7ba-49a0-a656-3a067116221a admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:48.617347 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff868149-f7ba-49a0-a656-3a067116221a admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:48.618093 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff868149-f7ba-49a0-a656-3a067116221a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:48.619703 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff868149-f7ba-49a0-a656-3a067116221a admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:48.641371 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 924/1878] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:19:48 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:19:48.645574 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df295206-b620-4fd1-8d98-8c8f17ce4bc0 service cinder] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:48.662388 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df295206-b620-4fd1-8d98-8c8f17ce4bc0 service cinder] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:48.679100 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84bcb40-cb5d-47fd-a5b6-bda6fab680a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:48.679341 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84bcb40-cb5d-47fd-a5b6-bda6fab680a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:48.679558 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84bcb40-cb5d-47fd-a5b6-bda6fab680a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:48.679787 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84bcb40-cb5d-47fd-a5b6-bda6fab680a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:48.680514 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84bcb40-cb5d-47fd-a5b6-bda6fab680a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:48.682328 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84bcb40-cb5d-47fd-a5b6-bda6fab680a8 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:48.696609 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 955/1879] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:19:48 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:19:48.701105 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff868149-f7ba-49a0-a656-3a067116221a admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:48.716729 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff868149-f7ba-49a0-a656-3a067116221a admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:48.721916 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f8e8e-05e3-4cfa-bc43-4b544534de9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:48.722823 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f8e8e-05e3-4cfa-bc43-4b544534de9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:48.723129 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f8e8e-05e3-4cfa-bc43-4b544534de9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:48.724032 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f8e8e-05e3-4cfa-bc43-4b544534de9d admin admin] PATH_INFO: `/v3/projects/f5b1681ffe4d4b73b678da8c36c9ff77/users/21d512c09d964d04b236f3728a589f26/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:48.745940 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50f8e8e-05e3-4cfa-bc43-4b544534de9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5b1681ffe4d4b73b678da8c36c9ff77, user_id=21d512c09d964d04b236f3728a589f26, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:48.750044 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50f8e8e-05e3-4cfa-bc43-4b544534de9d admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:48.812648 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 925/1880] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:19:48 2022] PUT /identity/v3/projects/f5b1681ffe4d4b73b678da8c36c9ff77/users/21d512c09d964d04b236f3728a589f26/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:19:48.823852 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf3e7b-8e6e-4f20-98fd-8d3663f2acd5 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:48.824187 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf3e7b-8e6e-4f20-98fd-8d3663f2acd5 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:48.824473 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf3e7b-8e6e-4f20-98fd-8d3663f2acd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:48.853331 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-d0bf3e7b-8e6e-4f20-98fd-8d3663f2acd5 None None] MFA Rules not processed for user `21d512c09d964d04b236f3728a589f26`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:48.854483 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-d0bf3e7b-8e6e-4f20-98fd-8d3663f2acd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:48.931915 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 956/1881] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:19:48 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:19:48.936530 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f8e8e-05e3-4cfa-bc43-4b544534de9d admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:49.029091 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f8e8e-05e3-4cfa-bc43-4b544534de9d admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:49.034384 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce19815-2d26-4315-9039-6c2fdf247197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:49.035223 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce19815-2d26-4315-9039-6c2fdf247197 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:49.035574 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce19815-2d26-4315-9039-6c2fdf247197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:49.035919 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce19815-2d26-4315-9039-6c2fdf247197 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:49.037531 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce19815-2d26-4315-9039-6c2fdf247197 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:49.040045 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce19815-2d26-4315-9039-6c2fdf247197 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:49.151479 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 926/1882] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:19:48 2022] POST /identity/v3/projects => generated 407 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:19:49.155303 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf3e7b-8e6e-4f20-98fd-8d3663f2acd5 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:49.172733 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf3e7b-8e6e-4f20-98fd-8d3663f2acd5 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:49.246931 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83872d5-eb6b-45d6-bef3-30243a09c95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:49.248046 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83872d5-eb6b-45d6-bef3-30243a09c95b admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:49.248401 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83872d5-eb6b-45d6-bef3-30243a09c95b admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:49.248753 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83872d5-eb6b-45d6-bef3-30243a09c95b admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:49.249645 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83872d5-eb6b-45d6-bef3-30243a09c95b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:49.252406 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83872d5-eb6b-45d6-bef3-30243a09c95b admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:49.392606 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 957/1883] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:19:49 2022] POST /identity/v3/users => generated 310 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:19:49.393712 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce19815-2d26-4315-9039-6c2fdf247197 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:49.409420 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce19815-2d26-4315-9039-6c2fdf247197 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:49.427791 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c464a7d-e168-4dc4-96bf-4694797f1c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:49.428531 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c464a7d-e168-4dc4-96bf-4694797f1c76 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:49.428823 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c464a7d-e168-4dc4-96bf-4694797f1c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:49.429100 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c464a7d-e168-4dc4-96bf-4694797f1c76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:49.441005 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c464a7d-e168-4dc4-96bf-4694797f1c76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:49.447689 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c464a7d-e168-4dc4-96bf-4694797f1c76 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:49.481878 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 927/1884] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:19:49 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:19:49.486022 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83872d5-eb6b-45d6-bef3-30243a09c95b admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:49.500215 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83872d5-eb6b-45d6-bef3-30243a09c95b admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:49.506092 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9067457-1d41-4356-8d5f-f2d29a5f0133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:49.507053 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9067457-1d41-4356-8d5f-f2d29a5f0133 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:49.507890 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9067457-1d41-4356-8d5f-f2d29a5f0133 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:49.508206 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9067457-1d41-4356-8d5f-f2d29a5f0133 admin admin] PATH_INFO: `/v3/projects/81690a59de3e4afc9279fd8e4678065c/users/74dd7ef6b4194e91a0d7da415bc3fc7b/roles/43105000610f402ca2486e7648018cca` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:49.541175 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9067457-1d41-4356-8d5f-f2d29a5f0133 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81690a59de3e4afc9279fd8e4678065c, user_id=74dd7ef6b4194e91a0d7da415bc3fc7b, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:49.543870 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9067457-1d41-4356-8d5f-f2d29a5f0133 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:49.626746 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 958/1885] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:19:49 2022] PUT /identity/v3/projects/81690a59de3e4afc9279fd8e4678065c/users/74dd7ef6b4194e91a0d7da415bc3fc7b/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:19:49.630719 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c464a7d-e168-4dc4-96bf-4694797f1c76 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:49.644387 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c464a7d-e168-4dc4-96bf-4694797f1c76 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:49.722736 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a9d5a1-36d3-4b06-97e4-ca679e2c8490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:49.723410 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a9d5a1-36d3-4b06-97e4-ca679e2c8490 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:49.723703 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a9d5a1-36d3-4b06-97e4-ca679e2c8490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:49.723982 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a9d5a1-36d3-4b06-97e4-ca679e2c8490 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:49.724904 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a9d5a1-36d3-4b06-97e4-ca679e2c8490 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:49.727217 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a9d5a1-36d3-4b06-97e4-ca679e2c8490 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:49.742949 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9067457-1d41-4356-8d5f-f2d29a5f0133 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:49.747381 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 928/1886] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:19:49 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:19:49.757458 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9067457-1d41-4356-8d5f-f2d29a5f0133 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:49.763044 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c40493-d070-4633-94fe-d2355c8cc254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:49.763986 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c40493-d070-4633-94fe-d2355c8cc254 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:49.764286 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c40493-d070-4633-94fe-d2355c8cc254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:49.764554 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c40493-d070-4633-94fe-d2355c8cc254 admin admin] PATH_INFO: `/v3/projects/81690a59de3e4afc9279fd8e4678065c/users/74dd7ef6b4194e91a0d7da415bc3fc7b/roles/43105000610f402ca2486e7648018cca` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:49.766519 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c40493-d070-4633-94fe-d2355c8cc254 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81690a59de3e4afc9279fd8e4678065c, user_id=74dd7ef6b4194e91a0d7da415bc3fc7b, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:49.769775 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c40493-d070-4633-94fe-d2355c8cc254 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:49.780981 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 959/1887] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:19:49 2022] PUT /identity/v3/projects/81690a59de3e4afc9279fd8e4678065c/users/74dd7ef6b4194e91a0d7da415bc3fc7b/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:19:49.793362 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee449a5-65fd-447d-b790-5e1c7088760b None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:49.793666 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee449a5-65fd-447d-b790-5e1c7088760b None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:49.794079 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee449a5-65fd-447d-b790-5e1c7088760b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:49.820698 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-3ee449a5-65fd-447d-b790-5e1c7088760b None None] MFA Rules not processed for user `74dd7ef6b4194e91a0d7da415bc3fc7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:49.822026 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-3ee449a5-65fd-447d-b790-5e1c7088760b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:49.892466 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 929/1888] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:19:49 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:19:49.904634 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c40493-d070-4633-94fe-d2355c8cc254 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:49.966663 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c40493-d070-4633-94fe-d2355c8cc254 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:49.971016 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6392b294-9c17-4aa3-9343-741578669693 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:49.971493 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6392b294-9c17-4aa3-9343-741578669693 service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:49.971837 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6392b294-9c17-4aa3-9343-741578669693 service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:49.972221 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6392b294-9c17-4aa3-9343-741578669693 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:49.982865 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6392b294-9c17-4aa3-9343-741578669693 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:49.984814 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6392b294-9c17-4aa3-9343-741578669693 service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:49.999520 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 960/1889] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:19:49 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:19:50.402888 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee449a5-65fd-447d-b790-5e1c7088760b None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:50.413878 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee449a5-65fd-447d-b790-5e1c7088760b None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:50.418136 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a4db9-a7ee-4a04-9b29-a7689729b63a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:50.418835 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a4db9-a7ee-4a04-9b29-a7689729b63a service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:50.419124 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a4db9-a7ee-4a04-9b29-a7689729b63a service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:50.419394 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a4db9-a7ee-4a04-9b29-a7689729b63a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:50.488647 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159a4db9-a7ee-4a04-9b29-a7689729b63a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:50.490251 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159a4db9-a7ee-4a04-9b29-a7689729b63a service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:50.501247 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 930/1890] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:19:50 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:19:54.546594 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6392b294-9c17-4aa3-9343-741578669693 service cinder] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:54.676281 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6392b294-9c17-4aa3-9343-741578669693 service cinder] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:54.682396 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3044057-0368-42c6-818e-000b9222bb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:54.683377 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3044057-0368-42c6-818e-000b9222bb34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:54.683831 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3044057-0368-42c6-818e-000b9222bb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:54.684236 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3044057-0368-42c6-818e-000b9222bb34 admin admin] PATH_INFO: `/v3/users/20044d77976341a6be25507fec5c18b8` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:54.688991 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3044057-0368-42c6-818e-000b9222bb34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20044d77976341a6be25507fec5c18b8)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:54.689391 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3044057-0368-42c6-818e-000b9222bb34 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:54.885776 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-c3044057-0368-42c6-818e-000b9222bb34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20044d77976341a6be25507fec5c18b8'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:54.899748 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-c3044057-0368-42c6-818e-000b9222bb34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20044d77976341a6be25507fec5c18b8'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:54.911937 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-c3044057-0368-42c6-818e-000b9222bb34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20044d77976341a6be25507fec5c18b8'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:54.912746 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-c3044057-0368-42c6-818e-000b9222bb34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20044d77976341a6be25507fec5c18b8'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:54.913372 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-c3044057-0368-42c6-818e-000b9222bb34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20044d77976341a6be25507fec5c18b8'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:55.006619 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 961/1891] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:19:54 2022] DELETE /identity/v3/users/20044d77976341a6be25507fec5c18b8 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:19:55.011805 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41bf51-11b9-4968-9907-8d8fb61b3a5f None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:55.012381 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41bf51-11b9-4968-9907-8d8fb61b3a5f None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:55.012671 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41bf51-11b9-4968-9907-8d8fb61b3a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:55.030655 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-df41bf51-11b9-4968-9907-8d8fb61b3a5f None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:55.031877 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-df41bf51-11b9-4968-9907-8d8fb61b3a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:55.094316 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 931/1892] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:19:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:19:55.103820 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3044057-0368-42c6-818e-000b9222bb34 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:55.105315 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-c3044057-0368-42c6-818e-000b9222bb34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:55.168387 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3044057-0368-42c6-818e-000b9222bb34 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:55.172160 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea53a9b-17e7-4ac8-8060-43c0ddbeb73a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:55.172890 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea53a9b-17e7-4ac8-8060-43c0ddbeb73a service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:55.173170 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea53a9b-17e7-4ac8-8060-43c0ddbeb73a service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:55.173460 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea53a9b-17e7-4ac8-8060-43c0ddbeb73a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:55.183448 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea53a9b-17e7-4ac8-8060-43c0ddbeb73a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:55.185000 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea53a9b-17e7-4ac8-8060-43c0ddbeb73a service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:55.194547 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 962/1893] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:19:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:19:55.870010 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df41bf51-11b9-4968-9907-8d8fb61b3a5f None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:55.879086 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-df41bf51-11b9-4968-9907-8d8fb61b3a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:55.902654 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df41bf51-11b9-4968-9907-8d8fb61b3a5f None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:55.909423 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed76b35a-f4af-4a32-8aeb-65c69aea3a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:55.910542 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76b35a-f4af-4a32-8aeb-65c69aea3a73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:55.910991 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76b35a-f4af-4a32-8aeb-65c69aea3a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:55.911475 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76b35a-f4af-4a32-8aeb-65c69aea3a73 admin admin] PATH_INFO: `/v3/projects/a850ed0bd0424d0aac3d869f046e48a3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:55.913957 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed76b35a-f4af-4a32-8aeb-65c69aea3a73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a850ed0bd0424d0aac3d869f046e48a3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:55.916680 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed76b35a-f4af-4a32-8aeb-65c69aea3a73 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:56.058355 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-ed76b35a-f4af-4a32-8aeb-65c69aea3a73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a850ed0bd0424d0aac3d869f046e48a3', 'request_id': 'req-ed76b35a-f4af-4a32-8aeb-65c69aea3a73'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:56.066307 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-ed76b35a-f4af-4a32-8aeb-65c69aea3a73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a850ed0bd0424d0aac3d869f046e48a3', 'request_id': 'req-ed76b35a-f4af-4a32-8aeb-65c69aea3a73'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:56.081052 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-ed76b35a-f4af-4a32-8aeb-65c69aea3a73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a850ed0bd0424d0aac3d869f046e48a3', 'request_id': 'req-ed76b35a-f4af-4a32-8aeb-65c69aea3a73'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:56.166616 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-ed76b35a-f4af-4a32-8aeb-65c69aea3a73 admin admin] The token cache is being invalidate because project a850ed0bd0424d0aac3d869f046e48a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:19:56.167072 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-ed76b35a-f4af-4a32-8aeb-65c69aea3a73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:56.167965 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-ed76b35a-f4af-4a32-8aeb-65c69aea3a73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:56.169562 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 932/1894] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:19:55 2022] DELETE /identity/v3/projects/a850ed0bd0424d0aac3d869f046e48a3 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:19:56.173518 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea53a9b-17e7-4ac8-8060-43c0ddbeb73a service neutron] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:56.183547 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea53a9b-17e7-4ac8-8060-43c0ddbeb73a service neutron] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:56.249085 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303182ce-27a1-47b6-bbbd-d20ced5d6035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:56.249582 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303182ce-27a1-47b6-bbbd-d20ced5d6035 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:56.249870 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303182ce-27a1-47b6-bbbd-d20ced5d6035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:56.250149 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303182ce-27a1-47b6-bbbd-d20ced5d6035 admin admin] PATH_INFO: `/v3/users/96c3abbf2ccc4c4f813e112be648cb3c` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:56.251956 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303182ce-27a1-47b6-bbbd-d20ced5d6035 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96c3abbf2ccc4c4f813e112be648cb3c)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:56.254004 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303182ce-27a1-47b6-bbbd-d20ced5d6035 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:56.508852 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-303182ce-27a1-47b6-bbbd-d20ced5d6035 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96c3abbf2ccc4c4f813e112be648cb3c'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:56.519406 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-303182ce-27a1-47b6-bbbd-d20ced5d6035 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96c3abbf2ccc4c4f813e112be648cb3c'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:56.541229 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-303182ce-27a1-47b6-bbbd-d20ced5d6035 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96c3abbf2ccc4c4f813e112be648cb3c'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:56.544333 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-303182ce-27a1-47b6-bbbd-d20ced5d6035 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96c3abbf2ccc4c4f813e112be648cb3c'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:56.544333 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-303182ce-27a1-47b6-bbbd-d20ced5d6035 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96c3abbf2ccc4c4f813e112be648cb3c'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:56.614161 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed76b35a-f4af-4a32-8aeb-65c69aea3a73 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:56.616154 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-ed76b35a-f4af-4a32-8aeb-65c69aea3a73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:56.626073 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 963/1895] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:19:56 2022] DELETE /identity/v3/users/96c3abbf2ccc4c4f813e112be648cb3c => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:19:56.642100 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed76b35a-f4af-4a32-8aeb-65c69aea3a73 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:56.746263 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf3b2f-6e40-47a6-bfd7-1309e121feda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:56.751886 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf3b2f-6e40-47a6-bfd7-1309e121feda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:56.752453 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf3b2f-6e40-47a6-bfd7-1309e121feda admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:56.752884 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf3b2f-6e40-47a6-bfd7-1309e121feda admin admin] PATH_INFO: `/v3/users/2637ea3672264d8c85cd8c32c1f38423` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:56.758979 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cf3b2f-6e40-47a6-bfd7-1309e121feda admin admin] RBAC: Authorizing `identity:delete_user(user_id=2637ea3672264d8c85cd8c32c1f38423)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:56.763855 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cf3b2f-6e40-47a6-bfd7-1309e121feda admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:56.997447 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-65cf3b2f-6e40-47a6-bfd7-1309e121feda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2637ea3672264d8c85cd8c32c1f38423'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:56.998431 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-65cf3b2f-6e40-47a6-bfd7-1309e121feda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2637ea3672264d8c85cd8c32c1f38423'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:57.011592 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-65cf3b2f-6e40-47a6-bfd7-1309e121feda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2637ea3672264d8c85cd8c32c1f38423'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:57.088587 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-65cf3b2f-6e40-47a6-bfd7-1309e121feda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2637ea3672264d8c85cd8c32c1f38423'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:57.089279 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-65cf3b2f-6e40-47a6-bfd7-1309e121feda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2637ea3672264d8c85cd8c32c1f38423'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:57.107673 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 933/1896] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:19:56 2022] DELETE /identity/v3/users/2637ea3672264d8c85cd8c32c1f38423 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:19:57.381947 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303182ce-27a1-47b6-bbbd-d20ced5d6035 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:57.387225 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-303182ce-27a1-47b6-bbbd-d20ced5d6035 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:57.407151 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303182ce-27a1-47b6-bbbd-d20ced5d6035 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:57.422045 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf3b2f-6e40-47a6-bfd7-1309e121feda admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:57.424963 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-65cf3b2f-6e40-47a6-bfd7-1309e121feda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:57.479208 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed35a072-864e-4202-aab4-8f628487e125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:57.480323 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed35a072-864e-4202-aab4-8f628487e125 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:57.480769 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed35a072-864e-4202-aab4-8f628487e125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:57.481390 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed35a072-864e-4202-aab4-8f628487e125 admin admin] PATH_INFO: `/v3/projects/9244cbe8f30144d984cfc43e3cbb5f4a` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:57.483362 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed35a072-864e-4202-aab4-8f628487e125 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9244cbe8f30144d984cfc43e3cbb5f4a)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:57.485673 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed35a072-864e-4202-aab4-8f628487e125 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:57.539951 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf3b2f-6e40-47a6-bfd7-1309e121feda admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:57.544744 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90023bd0-2ef3-4e98-89bd-349eaa9b19d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:57.545837 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90023bd0-2ef3-4e98-89bd-349eaa9b19d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:57.546118 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90023bd0-2ef3-4e98-89bd-349eaa9b19d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:57.546554 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90023bd0-2ef3-4e98-89bd-349eaa9b19d0 admin admin] PATH_INFO: `/v3/projects/5556e0424f954320811aa70f6f661cb0` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:57.547764 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90023bd0-2ef3-4e98-89bd-349eaa9b19d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5556e0424f954320811aa70f6f661cb0)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:57.549713 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90023bd0-2ef3-4e98-89bd-349eaa9b19d0 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:57.620065 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-ed35a072-864e-4202-aab4-8f628487e125 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9244cbe8f30144d984cfc43e3cbb5f4a', 'request_id': 'req-ed35a072-864e-4202-aab4-8f628487e125'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:57.626871 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-ed35a072-864e-4202-aab4-8f628487e125 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9244cbe8f30144d984cfc43e3cbb5f4a', 'request_id': 'req-ed35a072-864e-4202-aab4-8f628487e125'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:57.634961 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-ed35a072-864e-4202-aab4-8f628487e125 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9244cbe8f30144d984cfc43e3cbb5f4a', 'request_id': 'req-ed35a072-864e-4202-aab4-8f628487e125'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:57.683162 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-90023bd0-2ef3-4e98-89bd-349eaa9b19d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5556e0424f954320811aa70f6f661cb0', 'request_id': 'req-90023bd0-2ef3-4e98-89bd-349eaa9b19d0'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:57.689103 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-90023bd0-2ef3-4e98-89bd-349eaa9b19d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5556e0424f954320811aa70f6f661cb0', 'request_id': 'req-90023bd0-2ef3-4e98-89bd-349eaa9b19d0'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:57.696305 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-90023bd0-2ef3-4e98-89bd-349eaa9b19d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5556e0424f954320811aa70f6f661cb0', 'request_id': 'req-90023bd0-2ef3-4e98-89bd-349eaa9b19d0'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:57.763060 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-ed35a072-864e-4202-aab4-8f628487e125 admin admin] The token cache is being invalidate because project 9244cbe8f30144d984cfc43e3cbb5f4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:19:57.763982 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-ed35a072-864e-4202-aab4-8f628487e125 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:57.764383 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-ed35a072-864e-4202-aab4-8f628487e125 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:57.766184 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 964/1897] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:19:57 2022] DELETE /identity/v3/projects/9244cbe8f30144d984cfc43e3cbb5f4a => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:19:57.771276 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2607df-8ec2-45da-a377-4627fe2ce637 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:57.771667 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2607df-8ec2-45da-a377-4627fe2ce637 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:57.772386 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2607df-8ec2-45da-a377-4627fe2ce637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:57.791044 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-4d2607df-8ec2-45da-a377-4627fe2ce637 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:57.795797 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-4d2607df-8ec2-45da-a377-4627fe2ce637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:57.820506 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-90023bd0-2ef3-4e98-89bd-349eaa9b19d0 admin admin] The token cache is being invalidate because project 5556e0424f954320811aa70f6f661cb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:19:57.824615 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-90023bd0-2ef3-4e98-89bd-349eaa9b19d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:57.824615 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-90023bd0-2ef3-4e98-89bd-349eaa9b19d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:57.824615 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 934/1898] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:19:57 2022] DELETE /identity/v3/projects/5556e0424f954320811aa70f6f661cb0 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:19:57.828435 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852478ce-aafa-403e-98dd-acc0b5485bc0 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:57.828725 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852478ce-aafa-403e-98dd-acc0b5485bc0 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:57.829012 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852478ce-aafa-403e-98dd-acc0b5485bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:57.847263 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-852478ce-aafa-403e-98dd-acc0b5485bc0 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:57.848504 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-852478ce-aafa-403e-98dd-acc0b5485bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:57.855357 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 965/1899] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:19:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:19:57.859339 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 935/1900] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:19:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:19:57.865233 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4676d65-320e-4f06-8f27-1815df084dd3 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:57.865233 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4676d65-320e-4f06-8f27-1815df084dd3 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:57.865233 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4676d65-320e-4f06-8f27-1815df084dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:57.867513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0640d-59e3-4b4d-9d47-8837fff46b29 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:57.868734 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0640d-59e3-4b4d-9d47-8837fff46b29 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:57.871328 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0640d-59e3-4b4d-9d47-8837fff46b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:57.884382 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-e4676d65-320e-4f06-8f27-1815df084dd3 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:57.885589 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-e4676d65-320e-4f06-8f27-1815df084dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:57.892234 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-87e0640d-59e3-4b4d-9d47-8837fff46b29 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:57.893432 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-87e0640d-59e3-4b4d-9d47-8837fff46b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:57.896062 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 966/1901] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:19:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:19:57.898795 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4676d65-320e-4f06-8f27-1815df084dd3 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:57.903904 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 936/1902] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:19:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:19:57.908208 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e0640d-59e3-4b4d-9d47-8837fff46b29 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:57.909041 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4676d65-320e-4f06-8f27-1815df084dd3 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:57.915449 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db494c74-caf0-49ff-85d2-889a45cf96c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:57.916310 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db494c74-caf0-49ff-85d2-889a45cf96c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:57.916711 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db494c74-caf0-49ff-85d2-889a45cf96c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:57.917077 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db494c74-caf0-49ff-85d2-889a45cf96c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:57.918076 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db494c74-caf0-49ff-85d2-889a45cf96c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:19:57.918486 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db494c74-caf0-49ff-85d2-889a45cf96c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:57.920512 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db494c74-caf0-49ff-85d2-889a45cf96c8 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:57.920642 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e0640d-59e3-4b4d-9d47-8837fff46b29 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:57.927809 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adea59b-867b-483f-be06-535cd180ad63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:57.928468 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adea59b-867b-483f-be06-535cd180ad63 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:57.928772 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adea59b-867b-483f-be06-535cd180ad63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:57.929733 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adea59b-867b-483f-be06-535cd180ad63 admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:57.930632 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adea59b-867b-483f-be06-535cd180ad63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:19:57.930941 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adea59b-867b-483f-be06-535cd180ad63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:57.932586 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adea59b-867b-483f-be06-535cd180ad63 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:57.940166 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 967/1903] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 10 03:19:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:19:57.940166 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db494c74-caf0-49ff-85d2-889a45cf96c8 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:57.945443 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 937/1904] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 10 03:19:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:19:57.950137 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adea59b-867b-483f-be06-535cd180ad63 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:57.952964 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db494c74-caf0-49ff-85d2-889a45cf96c8 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:57.962864 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee49313-069e-4071-90e3-71fe9c3633b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:57.963434 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee49313-069e-4071-90e3-71fe9c3633b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:57.963717 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee49313-069e-4071-90e3-71fe9c3633b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:57.963992 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee49313-069e-4071-90e3-71fe9c3633b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:57.964779 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee49313-069e-4071-90e3-71fe9c3633b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:57.964955 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adea59b-867b-483f-be06-535cd180ad63 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:57.966692 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee49313-069e-4071-90e3-71fe9c3633b1 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:57.970116 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82140ea5-7ead-4110-b84d-1fc0c194e776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:57.970778 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82140ea5-7ead-4110-b84d-1fc0c194e776 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:57.974582 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82140ea5-7ead-4110-b84d-1fc0c194e776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:57.974582 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82140ea5-7ead-4110-b84d-1fc0c194e776 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:57.974582 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82140ea5-7ead-4110-b84d-1fc0c194e776 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:57.974582 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82140ea5-7ead-4110-b84d-1fc0c194e776 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:58.078456 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 938/1905] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:19:57 2022] POST /identity/v3/projects => generated 393 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:19:58.081590 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 968/1906] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:19:57 2022] POST /identity/v3/projects => generated 371 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:19:58.082426 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82140ea5-7ead-4110-b84d-1fc0c194e776 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:58.082558 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee49313-069e-4071-90e3-71fe9c3633b1 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:58.142202 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82140ea5-7ead-4110-b84d-1fc0c194e776 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:58.143494 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee49313-069e-4071-90e3-71fe9c3633b1 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:58.146997 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e50a4-8888-4473-8fc0-683793b7c39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:58.148195 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e50a4-8888-4473-8fc0-683793b7c39e admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:58.148483 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e50a4-8888-4473-8fc0-683793b7c39e admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:58.148738 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75902ef-b1b2-45ad-aa52-aae0841e6c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:58.148856 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e50a4-8888-4473-8fc0-683793b7c39e admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:58.149403 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75902ef-b1b2-45ad-aa52-aae0841e6c4a admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:58.149515 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05e50a4-8888-4473-8fc0-683793b7c39e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:58.149687 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75902ef-b1b2-45ad-aa52-aae0841e6c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:58.149965 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75902ef-b1b2-45ad-aa52-aae0841e6c4a admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:58.150697 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75902ef-b1b2-45ad-aa52-aae0841e6c4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:58.151371 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05e50a4-8888-4473-8fc0-683793b7c39e admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:58.152730 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75902ef-b1b2-45ad-aa52-aae0841e6c4a admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:58.243089 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 969/1908] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:19:58 2022] POST /identity/v3/users => generated 297 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:19:58.244363 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75902ef-b1b2-45ad-aa52-aae0841e6c4a admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:58.246275 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 939/1908] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:19:58 2022] POST /identity/v3/users => generated 286 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:19:58.247047 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-a75902ef-b1b2-45ad-aa52-aae0841e6c4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:58.247198 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e50a4-8888-4473-8fc0-683793b7c39e admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:58.257943 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e50a4-8888-4473-8fc0-683793b7c39e admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:58.259003 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75902ef-b1b2-45ad-aa52-aae0841e6c4a admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:58.263528 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce659c7-f3a3-4fba-8c30-3948412e8be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:58.266223 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b618890a-7f2f-41d6-83d6-431309031f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:58.266357 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce659c7-f3a3-4fba-8c30-3948412e8be8 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:58.266449 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b618890a-7f2f-41d6-83d6-431309031f04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:58.266540 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce659c7-f3a3-4fba-8c30-3948412e8be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:58.266638 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b618890a-7f2f-41d6-83d6-431309031f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:58.266724 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce659c7-f3a3-4fba-8c30-3948412e8be8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:58.266808 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b618890a-7f2f-41d6-83d6-431309031f04 admin admin] PATH_INFO: `/v3/users/21d512c09d964d04b236f3728a589f26` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:58.266892 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce659c7-f3a3-4fba-8c30-3948412e8be8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:58.266974 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b618890a-7f2f-41d6-83d6-431309031f04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21d512c09d964d04b236f3728a589f26)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:58.267102 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce659c7-f3a3-4fba-8c30-3948412e8be8 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:58.268764 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b618890a-7f2f-41d6-83d6-431309031f04 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:58.277804 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 940/1909] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:19:58.281732 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce659c7-f3a3-4fba-8c30-3948412e8be8 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:58.292055 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce659c7-f3a3-4fba-8c30-3948412e8be8 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:58.297220 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f14c0-5a9f-49ee-894b-0deeecb9297e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:58.297932 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f14c0-5a9f-49ee-894b-0deeecb9297e admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:58.298218 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f14c0-5a9f-49ee-894b-0deeecb9297e admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:58.298497 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f14c0-5a9f-49ee-894b-0deeecb9297e admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:58.299220 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180f14c0-5a9f-49ee-894b-0deeecb9297e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:58.300941 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180f14c0-5a9f-49ee-894b-0deeecb9297e admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:58.312189 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 941/1910] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:19:58.312979 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f14c0-5a9f-49ee-894b-0deeecb9297e admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:58.325365 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f14c0-5a9f-49ee-894b-0deeecb9297e admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:58.330530 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e8b092-f323-485d-a086-a77121cf0a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:58.331379 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8b092-f323-485d-a086-a77121cf0a45 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:58.331730 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8b092-f323-485d-a086-a77121cf0a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:58.332097 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8b092-f323-485d-a086-a77121cf0a45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:58.332981 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e8b092-f323-485d-a086-a77121cf0a45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:58.334555 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e8b092-f323-485d-a086-a77121cf0a45 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:58.348254 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 942/1911] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:19:58.348254 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e8b092-f323-485d-a086-a77121cf0a45 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:58.357356 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e8b092-f323-485d-a086-a77121cf0a45 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:58.362540 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cdbc52-0f60-4420-ad9c-f06c021fa786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:58.363278 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cdbc52-0f60-4420-ad9c-f06c021fa786 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:58.363625 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cdbc52-0f60-4420-ad9c-f06c021fa786 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:58.363985 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cdbc52-0f60-4420-ad9c-f06c021fa786 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:58.364831 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cdbc52-0f60-4420-ad9c-f06c021fa786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:58.367090 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cdbc52-0f60-4420-ad9c-f06c021fa786 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:58.377556 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 943/1912] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:19:58.378366 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cdbc52-0f60-4420-ad9c-f06c021fa786 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:58.395013 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cdbc52-0f60-4420-ad9c-f06c021fa786 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:58.409501 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fed8352-36fb-44e7-a66d-4b856aef1564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:58.411801 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed8352-36fb-44e7-a66d-4b856aef1564 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:58.412360 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed8352-36fb-44e7-a66d-4b856aef1564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:58.413846 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed8352-36fb-44e7-a66d-4b856aef1564 admin admin] PATH_INFO: `/v3/projects/c87fcab3cf8c4638a8b1aca7561f3aa2/users/78995d7eaec244918df57d35fec4ab1e/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:58.461776 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fed8352-36fb-44e7-a66d-4b856aef1564 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c87fcab3cf8c4638a8b1aca7561f3aa2, user_id=78995d7eaec244918df57d35fec4ab1e, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:58.464673 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fed8352-36fb-44e7-a66d-4b856aef1564 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:58.498830 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-b618890a-7f2f-41d6-83d6-431309031f04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21d512c09d964d04b236f3728a589f26'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:58.507573 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-b618890a-7f2f-41d6-83d6-431309031f04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21d512c09d964d04b236f3728a589f26'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:58.524554 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-b618890a-7f2f-41d6-83d6-431309031f04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21d512c09d964d04b236f3728a589f26'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:58.528324 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-b618890a-7f2f-41d6-83d6-431309031f04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21d512c09d964d04b236f3728a589f26'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:58.531088 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-b618890a-7f2f-41d6-83d6-431309031f04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21d512c09d964d04b236f3728a589f26'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:58.583090 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 944/1913] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:19:58 2022] PUT /identity/v3/projects/c87fcab3cf8c4638a8b1aca7561f3aa2/users/78995d7eaec244918df57d35fec4ab1e/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:19:58.583909 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fed8352-36fb-44e7-a66d-4b856aef1564 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:58.593802 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-4fed8352-36fb-44e7-a66d-4b856aef1564 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:58.648534 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 970/1914] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:19:58 2022] DELETE /identity/v3/users/21d512c09d964d04b236f3728a589f26 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:19:58.655531 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982dd53-7361-4c37-85c4-03c836cbbc1e None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:58.656101 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982dd53-7361-4c37-85c4-03c836cbbc1e None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:58.656576 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982dd53-7361-4c37-85c4-03c836cbbc1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:58.674204 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fed8352-36fb-44e7-a66d-4b856aef1564 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:58.719405 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-d982dd53-7361-4c37-85c4-03c836cbbc1e None None] MFA Rules not processed for user `78995d7eaec244918df57d35fec4ab1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:58.721462 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-d982dd53-7361-4c37-85c4-03c836cbbc1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:58.755452 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed005411-0678-4a78-a6cd-646240ae5e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:58.757371 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed005411-0678-4a78-a6cd-646240ae5e5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:58.757782 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed005411-0678-4a78-a6cd-646240ae5e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:58.758790 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed005411-0678-4a78-a6cd-646240ae5e5a admin admin] PATH_INFO: `/v3/projects/635aa0651e7147e988933e9ad3503b9d/users/93aa7b88ac3c475691a2bac55ea5c843/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:58.788072 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed005411-0678-4a78-a6cd-646240ae5e5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=635aa0651e7147e988933e9ad3503b9d, user_id=93aa7b88ac3c475691a2bac55ea5c843, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:58.791683 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed005411-0678-4a78-a6cd-646240ae5e5a admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:58.820357 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 971/1915] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:19:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:19:58.823934 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507453e8-ff23-41b9-9df5-564dfe283ebe None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:58.823934 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507453e8-ff23-41b9-9df5-564dfe283ebe None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:58.823934 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507453e8-ff23-41b9-9df5-564dfe283ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:58.840630 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-507453e8-ff23-41b9-9df5-564dfe283ebe None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:58.841885 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-507453e8-ff23-41b9-9df5-564dfe283ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:58.849795 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 972/1916] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:19:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:19:58.850557 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507453e8-ff23-41b9-9df5-564dfe283ebe None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:58.852592 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-507453e8-ff23-41b9-9df5-564dfe283ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:58.864114 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507453e8-ff23-41b9-9df5-564dfe283ebe None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:58.868951 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b87ce27-c51e-44f2-9541-edb07c833042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:58.869613 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87ce27-c51e-44f2-9541-edb07c833042 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:58.869905 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87ce27-c51e-44f2-9541-edb07c833042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:58.870239 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87ce27-c51e-44f2-9541-edb07c833042 admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:58.871066 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b87ce27-c51e-44f2-9541-edb07c833042 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:58.873000 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b87ce27-c51e-44f2-9541-edb07c833042 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:58.878110 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 945/1917] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:19:58 2022] PUT /identity/v3/projects/635aa0651e7147e988933e9ad3503b9d/users/93aa7b88ac3c475691a2bac55ea5c843/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:19:58.881283 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed005411-0678-4a78-a6cd-646240ae5e5a admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:58.881283 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-ed005411-0678-4a78-a6cd-646240ae5e5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:58.937006 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed005411-0678-4a78-a6cd-646240ae5e5a admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:58.941952 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3118075-7ea4-47f6-acb2-52695057f60f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:58.942607 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3118075-7ea4-47f6-acb2-52695057f60f service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:58.942937 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3118075-7ea4-47f6-acb2-52695057f60f service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:58.943216 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3118075-7ea4-47f6-acb2-52695057f60f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:58.957781 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 973/1918] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:19:58 2022] POST /identity/v3/projects => generated 393 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:19:58.963076 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817137c-66e5-4b01-9537-6ab282516854 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:58.963433 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817137c-66e5-4b01-9537-6ab282516854 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:58.963782 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817137c-66e5-4b01-9537-6ab282516854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:58.998768 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-7817137c-66e5-4b01-9537-6ab282516854 None None] MFA Rules not processed for user `93aa7b88ac3c475691a2bac55ea5c843`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:58.999910 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-7817137c-66e5-4b01-9537-6ab282516854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:59.017580 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3118075-7ea4-47f6-acb2-52695057f60f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:59.019034 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3118075-7ea4-47f6-acb2-52695057f60f service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:59.030187 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 946/1919] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:19:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:19:59.031031 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3118075-7ea4-47f6-acb2-52695057f60f service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:59.041385 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3118075-7ea4-47f6-acb2-52695057f60f service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:59.093531 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 974/1920] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:19:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:19:59.106486 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7817137c-66e5-4b01-9537-6ab282516854 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:59.108721 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-7817137c-66e5-4b01-9537-6ab282516854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:59.121814 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d2609b-d3a3-46c6-bbf7-0f4191cfcc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:59.122816 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d2609b-d3a3-46c6-bbf7-0f4191cfcc1e admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:59.123354 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d2609b-d3a3-46c6-bbf7-0f4191cfcc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:59.123705 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d2609b-d3a3-46c6-bbf7-0f4191cfcc1e admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:59.124634 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d2609b-d3a3-46c6-bbf7-0f4191cfcc1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:59.126664 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d2609b-d3a3-46c6-bbf7-0f4191cfcc1e admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:59.186655 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7817137c-66e5-4b01-9537-6ab282516854 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:59.192449 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bbf450-46ab-4c08-a238-3b3735af90be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b7ccdccba0b4f9e86817946f22dbe28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:59.193102 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bbf450-46ab-4c08-a238-3b3735af90be service nova] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:59.193393 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bbf450-46ab-4c08-a238-3b3735af90be service nova] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:59.193671 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bbf450-46ab-4c08-a238-3b3735af90be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:59.202348 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bbf450-46ab-4c08-a238-3b3735af90be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:59.203933 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bbf450-46ab-4c08-a238-3b3735af90be service nova] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:59.214154 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 975/1921] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:19:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:19:59.256318 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 947/1922] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:19:59 2022] POST /identity/v3/users => generated 303 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:19:59.257964 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bbf450-46ab-4c08-a238-3b3735af90be service nova] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:59.268339 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bbf450-46ab-4c08-a238-3b3735af90be service nova] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:59.274190 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c309db9-58de-4f88-a77d-728d138afdc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:59.275584 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c309db9-58de-4f88-a77d-728d138afdc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:59.275956 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c309db9-58de-4f88-a77d-728d138afdc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:59.276356 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c309db9-58de-4f88-a77d-728d138afdc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:59.277186 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c309db9-58de-4f88-a77d-728d138afdc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:59.278975 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c309db9-58de-4f88-a77d-728d138afdc7 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:59.290024 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 976/1923] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:19:59.294310 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d2609b-d3a3-46c6-bbf7-0f4191cfcc1e admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:59.306630 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d2609b-d3a3-46c6-bbf7-0f4191cfcc1e admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:59.311650 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ab8f5-c376-4171-8e14-c20c4f2943ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:59.312693 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ab8f5-c376-4171-8e14-c20c4f2943ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:59.313049 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ab8f5-c376-4171-8e14-c20c4f2943ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:59.313399 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ab8f5-c376-4171-8e14-c20c4f2943ba admin admin] PATH_INFO: `/v3/projects/b1649cb2e0cd4262aad421c14c0b0e8e/users/02441431d5c1453d9995f7280a0907b3/roles/43105000610f402ca2486e7648018cca` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:59.330398 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92ab8f5-c376-4171-8e14-c20c4f2943ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1649cb2e0cd4262aad421c14c0b0e8e, user_id=02441431d5c1453d9995f7280a0907b3, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:59.333207 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92ab8f5-c376-4171-8e14-c20c4f2943ba admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:59.414419 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 948/1924] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:19:59 2022] PUT /identity/v3/projects/b1649cb2e0cd4262aad421c14c0b0e8e/users/02441431d5c1453d9995f7280a0907b3/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:19:59.418987 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c309db9-58de-4f88-a77d-728d138afdc7 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:59.431894 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c309db9-58de-4f88-a77d-728d138afdc7 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:59.503023 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1480ccb-ab4e-4d70-a50d-c6e7cb3d7996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:59.504498 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1480ccb-ab4e-4d70-a50d-c6e7cb3d7996 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:59.504807 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1480ccb-ab4e-4d70-a50d-c6e7cb3d7996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:59.505080 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1480ccb-ab4e-4d70-a50d-c6e7cb3d7996 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:59.505806 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1480ccb-ab4e-4d70-a50d-c6e7cb3d7996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:59.507856 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1480ccb-ab4e-4d70-a50d-c6e7cb3d7996 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:59.518135 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 977/1925] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:19:59.522470 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ab8f5-c376-4171-8e14-c20c4f2943ba admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:59.534035 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ab8f5-c376-4171-8e14-c20c4f2943ba admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:59.539754 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39456f12-3027-4a44-a027-e991f0c94980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:59.540712 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39456f12-3027-4a44-a027-e991f0c94980 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:59.540997 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39456f12-3027-4a44-a027-e991f0c94980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:59.541394 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39456f12-3027-4a44-a027-e991f0c94980 admin admin] PATH_INFO: `/v3/projects/b1649cb2e0cd4262aad421c14c0b0e8e/users/02441431d5c1453d9995f7280a0907b3/roles/43105000610f402ca2486e7648018cca` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:59.543406 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39456f12-3027-4a44-a027-e991f0c94980 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1649cb2e0cd4262aad421c14c0b0e8e, user_id=02441431d5c1453d9995f7280a0907b3, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:59.546100 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39456f12-3027-4a44-a027-e991f0c94980 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:59.557580 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 949/1926] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:19:59 2022] PUT /identity/v3/projects/b1649cb2e0cd4262aad421c14c0b0e8e/users/02441431d5c1453d9995f7280a0907b3/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:19:59.569070 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f15d0b-6f71-4e52-9c57-57bbfc309134 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:59.569369 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f15d0b-6f71-4e52-9c57-57bbfc309134 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:59.570309 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f15d0b-6f71-4e52-9c57-57bbfc309134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:59.600153 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-d1f15d0b-6f71-4e52-9c57-57bbfc309134 None None] MFA Rules not processed for user `02441431d5c1453d9995f7280a0907b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:19:59.601390 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-d1f15d0b-6f71-4e52-9c57-57bbfc309134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:59.634072 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39456f12-3027-4a44-a027-e991f0c94980 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:59.634988 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-39456f12-3027-4a44-a027-e991f0c94980 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:59.685152 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 978/1927] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:19:59 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:19:59.693063 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f15d0b-6f71-4e52-9c57-57bbfc309134 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:59.695147 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-d1f15d0b-6f71-4e52-9c57-57bbfc309134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:59.723363 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39456f12-3027-4a44-a027-e991f0c94980 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:59.728513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc10d269-0b23-4bcf-b1bd-ef3945731510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:59.729501 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc10d269-0b23-4bcf-b1bd-ef3945731510 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:59.736503 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc10d269-0b23-4bcf-b1bd-ef3945731510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:59.736503 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc10d269-0b23-4bcf-b1bd-ef3945731510 admin admin] PATH_INFO: `/v3/projects/f5b1681ffe4d4b73b678da8c36c9ff77` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:59.736503 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc10d269-0b23-4bcf-b1bd-ef3945731510 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5b1681ffe4d4b73b678da8c36c9ff77)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:59.736503 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc10d269-0b23-4bcf-b1bd-ef3945731510 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:59.780337 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f15d0b-6f71-4e52-9c57-57bbfc309134 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:59.780337 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc5be6-1ae8-438d-9557-60649b172a79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:59.780337 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc5be6-1ae8-438d-9557-60649b172a79 service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:59.780337 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc5be6-1ae8-438d-9557-60649b172a79 service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:59.780725 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc5be6-1ae8-438d-9557-60649b172a79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:59.790730 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cc5be6-1ae8-438d-9557-60649b172a79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:59.792203 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cc5be6-1ae8-438d-9557-60649b172a79 service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:59.802805 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 979/1928] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:19:59 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:19:59.854897 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc5be6-1ae8-438d-9557-60649b172a79 service cinder] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:59.863421 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc5be6-1ae8-438d-9557-60649b172a79 service cinder] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:19:59.877250 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-cc10d269-0b23-4bcf-b1bd-ef3945731510 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5b1681ffe4d4b73b678da8c36c9ff77', 'request_id': 'req-cc10d269-0b23-4bcf-b1bd-ef3945731510'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:59.885160 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-cc10d269-0b23-4bcf-b1bd-ef3945731510 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5b1681ffe4d4b73b678da8c36c9ff77', 'request_id': 'req-cc10d269-0b23-4bcf-b1bd-ef3945731510'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:59.891674 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-cc10d269-0b23-4bcf-b1bd-ef3945731510 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5b1681ffe4d4b73b678da8c36c9ff77', 'request_id': 'req-cc10d269-0b23-4bcf-b1bd-ef3945731510'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:59.916809 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35faa6a7-04e5-47c4-892f-b8afe7bfd827 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:19:59.917464 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35faa6a7-04e5-47c4-892f-b8afe7bfd827 service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:19:59.917747 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35faa6a7-04e5-47c4-892f-b8afe7bfd827 service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:19:59.918022 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35faa6a7-04e5-47c4-892f-b8afe7bfd827 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:19:59.973385 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-cc10d269-0b23-4bcf-b1bd-ef3945731510 admin admin] The token cache is being invalidate because project f5b1681ffe4d4b73b678da8c36c9ff77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:19:59.973792 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-cc10d269-0b23-4bcf-b1bd-ef3945731510 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:59.975318 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-cc10d269-0b23-4bcf-b1bd-ef3945731510 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:19:59.976631 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35faa6a7-04e5-47c4-892f-b8afe7bfd827 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:19:59.977695 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 950/1929] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:19:59 2022] DELETE /identity/v3/projects/f5b1681ffe4d4b73b678da8c36c9ff77 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:19:59.978207 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35faa6a7-04e5-47c4-892f-b8afe7bfd827 service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:19:59.983605 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc10d269-0b23-4bcf-b1bd-ef3945731510 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:19:59.985190 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-cc10d269-0b23-4bcf-b1bd-ef3945731510 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:19:59.988381 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 980/1930] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:19:59 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:20:00.109770 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc10d269-0b23-4bcf-b1bd-ef3945731510 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:00.125174 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f54cc6-b558-492b-8c60-5c1415301967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:00.126076 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f54cc6-b558-492b-8c60-5c1415301967 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:00.126368 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f54cc6-b558-492b-8c60-5c1415301967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:00.126645 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f54cc6-b558-492b-8c60-5c1415301967 admin admin] PATH_INFO: `/v3/users/74dd7ef6b4194e91a0d7da415bc3fc7b` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:00.127918 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f54cc6-b558-492b-8c60-5c1415301967 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74dd7ef6b4194e91a0d7da415bc3fc7b)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:00.129888 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f54cc6-b558-492b-8c60-5c1415301967 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:00.351406 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-34f54cc6-b558-492b-8c60-5c1415301967 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74dd7ef6b4194e91a0d7da415bc3fc7b'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:00.352420 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-34f54cc6-b558-492b-8c60-5c1415301967 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74dd7ef6b4194e91a0d7da415bc3fc7b'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:00.359875 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-34f54cc6-b558-492b-8c60-5c1415301967 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74dd7ef6b4194e91a0d7da415bc3fc7b'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:00.494793 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-34f54cc6-b558-492b-8c60-5c1415301967 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74dd7ef6b4194e91a0d7da415bc3fc7b'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:00.495456 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-34f54cc6-b558-492b-8c60-5c1415301967 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74dd7ef6b4194e91a0d7da415bc3fc7b'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:00.515233 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 951/1931] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:19:59 2022] DELETE /identity/v3/users/74dd7ef6b4194e91a0d7da415bc3fc7b => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:20:01.057702 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35faa6a7-04e5-47c4-892f-b8afe7bfd827 service cinder] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:01.072397 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35faa6a7-04e5-47c4-892f-b8afe7bfd827 service cinder] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:01.224153 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888e205d-2d4b-41bd-aaf7-0989215c2ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:01.225267 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e205d-2d4b-41bd-aaf7-0989215c2ec0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:01.226309 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e205d-2d4b-41bd-aaf7-0989215c2ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:01.226926 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e205d-2d4b-41bd-aaf7-0989215c2ec0 admin admin] PATH_INFO: `/v3/projects/81690a59de3e4afc9279fd8e4678065c` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:01.229488 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888e205d-2d4b-41bd-aaf7-0989215c2ec0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81690a59de3e4afc9279fd8e4678065c)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:01.231577 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888e205d-2d4b-41bd-aaf7-0989215c2ec0 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:01.385364 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-888e205d-2d4b-41bd-aaf7-0989215c2ec0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81690a59de3e4afc9279fd8e4678065c', 'request_id': 'req-888e205d-2d4b-41bd-aaf7-0989215c2ec0'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:01.394301 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-888e205d-2d4b-41bd-aaf7-0989215c2ec0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81690a59de3e4afc9279fd8e4678065c', 'request_id': 'req-888e205d-2d4b-41bd-aaf7-0989215c2ec0'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:01.403002 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-888e205d-2d4b-41bd-aaf7-0989215c2ec0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81690a59de3e4afc9279fd8e4678065c', 'request_id': 'req-888e205d-2d4b-41bd-aaf7-0989215c2ec0'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:01.489189 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-888e205d-2d4b-41bd-aaf7-0989215c2ec0 admin admin] The token cache is being invalidate because project 81690a59de3e4afc9279fd8e4678065c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:20:01.489480 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-888e205d-2d4b-41bd-aaf7-0989215c2ec0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:01.490105 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-888e205d-2d4b-41bd-aaf7-0989215c2ec0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:01.492831 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 981/1932] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:20:01 2022] DELETE /identity/v3/projects/81690a59de3e4afc9279fd8e4678065c => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:01.496850 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e1074-613e-4ee9-8eb1-5889665a583f None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:01.497326 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e1074-613e-4ee9-8eb1-5889665a583f None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:01.497442 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e1074-613e-4ee9-8eb1-5889665a583f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:01.516625 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-586e1074-613e-4ee9-8eb1-5889665a583f None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:01.517837 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-586e1074-613e-4ee9-8eb1-5889665a583f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:01.584288 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 952/1933] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:20:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:01.591373 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d803ca-a188-4717-9fa5-f2b351596d25 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:01.592112 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d803ca-a188-4717-9fa5-f2b351596d25 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:01.593007 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d803ca-a188-4717-9fa5-f2b351596d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:01.622182 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-20d803ca-a188-4717-9fa5-f2b351596d25 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:01.623776 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-20d803ca-a188-4717-9fa5-f2b351596d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:01.634795 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 982/1934] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:20:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:01.642714 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e1074-613e-4ee9-8eb1-5889665a583f None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:01.655130 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e1074-613e-4ee9-8eb1-5889665a583f None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:01.660424 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4b0abf-e72c-4560-be13-dc48a653b8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:01.661336 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b0abf-e72c-4560-be13-dc48a653b8c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:01.668585 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b0abf-e72c-4560-be13-dc48a653b8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:01.668585 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b0abf-e72c-4560-be13-dc48a653b8c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:01.668585 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4b0abf-e72c-4560-be13-dc48a653b8c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:20:01.668585 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4b0abf-e72c-4560-be13-dc48a653b8c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:01.668585 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4b0abf-e72c-4560-be13-dc48a653b8c7 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:01.682105 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 953/1935] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 10 03:20:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:20:01.684043 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d803ca-a188-4717-9fa5-f2b351596d25 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:01.693757 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d803ca-a188-4717-9fa5-f2b351596d25 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:01.703912 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432929f8-ee3e-436b-a055-72bb782fd082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:01.704634 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432929f8-ee3e-436b-a055-72bb782fd082 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:01.704918 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432929f8-ee3e-436b-a055-72bb782fd082 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:01.705184 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432929f8-ee3e-436b-a055-72bb782fd082 admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:01.705922 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432929f8-ee3e-436b-a055-72bb782fd082 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:01.707825 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432929f8-ee3e-436b-a055-72bb782fd082 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:01.806348 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 983/1936] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:20:01 2022] POST /identity/v3/projects => generated 373 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:20:01.815010 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4b0abf-e72c-4560-be13-dc48a653b8c7 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:01.826312 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4b0abf-e72c-4560-be13-dc48a653b8c7 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:01.897151 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485131f-2f11-4aef-90c9-05a77705165a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:01.898406 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485131f-2f11-4aef-90c9-05a77705165a admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:01.898687 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485131f-2f11-4aef-90c9-05a77705165a admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:01.898956 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485131f-2f11-4aef-90c9-05a77705165a admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:01.899651 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1485131f-2f11-4aef-90c9-05a77705165a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:01.901599 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1485131f-2f11-4aef-90c9-05a77705165a admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:01.989691 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 954/1937] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:20:01 2022] POST /identity/v3/users => generated 287 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:20:01.993758 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432929f8-ee3e-436b-a055-72bb782fd082 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:02.004604 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432929f8-ee3e-436b-a055-72bb782fd082 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:02.009281 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8091861b-28fd-47c6-9995-f53f3752cecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:02.011075 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8091861b-28fd-47c6-9995-f53f3752cecf admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:02.011075 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8091861b-28fd-47c6-9995-f53f3752cecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:02.011075 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8091861b-28fd-47c6-9995-f53f3752cecf admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:02.011406 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8091861b-28fd-47c6-9995-f53f3752cecf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:02.012795 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8091861b-28fd-47c6-9995-f53f3752cecf admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:02.023831 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 984/1938] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:20:02.030064 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485131f-2f11-4aef-90c9-05a77705165a admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:02.040076 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485131f-2f11-4aef-90c9-05a77705165a admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:02.044803 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a6596-3307-49b3-9548-c1a8d6b969b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:02.045481 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a6596-3307-49b3-9548-c1a8d6b969b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:02.045758 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a6596-3307-49b3-9548-c1a8d6b969b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:02.046101 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a6596-3307-49b3-9548-c1a8d6b969b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:02.046797 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754a6596-3307-49b3-9548-c1a8d6b969b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:02.048373 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754a6596-3307-49b3-9548-c1a8d6b969b1 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:02.063848 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 955/1939] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:20:02.066621 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8091861b-28fd-47c6-9995-f53f3752cecf admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:02.076987 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8091861b-28fd-47c6-9995-f53f3752cecf admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:02.081610 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff88d4b-c278-41af-85bd-6d81ad835673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:02.082538 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff88d4b-c278-41af-85bd-6d81ad835673 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:02.082758 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff88d4b-c278-41af-85bd-6d81ad835673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:02.083026 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff88d4b-c278-41af-85bd-6d81ad835673 admin admin] PATH_INFO: `/v3/projects/e56c0b8e227e42a687bbaa79f78baa22/users/06a1988c95714ea38cbc1c1ede7c1fc6/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:02.098279 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff88d4b-c278-41af-85bd-6d81ad835673 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e56c0b8e227e42a687bbaa79f78baa22, user_id=06a1988c95714ea38cbc1c1ede7c1fc6, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:02.100997 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff88d4b-c278-41af-85bd-6d81ad835673 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:02.190034 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 985/1940] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:20:02 2022] PUT /identity/v3/projects/e56c0b8e227e42a687bbaa79f78baa22/users/06a1988c95714ea38cbc1c1ede7c1fc6/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:02.200941 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16184ae-a75f-4eef-a413-c35fd889fe03 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:02.201282 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16184ae-a75f-4eef-a413-c35fd889fe03 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:02.201650 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16184ae-a75f-4eef-a413-c35fd889fe03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:02.236410 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-a16184ae-a75f-4eef-a413-c35fd889fe03 None None] MFA Rules not processed for user `06a1988c95714ea38cbc1c1ede7c1fc6`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:02.238303 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-a16184ae-a75f-4eef-a413-c35fd889fe03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:02.315646 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 956/1941] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:20:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:02.328088 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff88d4b-c278-41af-85bd-6d81ad835673 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:02.329800 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-eff88d4b-c278-41af-85bd-6d81ad835673 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:02.387443 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff88d4b-c278-41af-85bd-6d81ad835673 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:02.391230 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def7a956-80cc-4ba6-937a-41d0b65cffc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:02.391879 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def7a956-80cc-4ba6-937a-41d0b65cffc6 service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:02.392241 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def7a956-80cc-4ba6-937a-41d0b65cffc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:02.392539 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def7a956-80cc-4ba6-937a-41d0b65cffc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:02.402004 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def7a956-80cc-4ba6-937a-41d0b65cffc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:02.403448 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def7a956-80cc-4ba6-937a-41d0b65cffc6 service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:02.412580 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 986/1942] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:20:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:20:02.440913 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16184ae-a75f-4eef-a413-c35fd889fe03 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:02.506453 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16184ae-a75f-4eef-a413-c35fd889fe03 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:02.512134 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87859ddf-4cdf-4e06-b481-a2e17098bb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:02.516169 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87859ddf-4cdf-4e06-b481-a2e17098bb98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:02.516169 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87859ddf-4cdf-4e06-b481-a2e17098bb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:02.516169 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87859ddf-4cdf-4e06-b481-a2e17098bb98 admin admin] PATH_INFO: `/v3/users/06a1988c95714ea38cbc1c1ede7c1fc6` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:02.516169 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87859ddf-4cdf-4e06-b481-a2e17098bb98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06a1988c95714ea38cbc1c1ede7c1fc6)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:02.517043 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87859ddf-4cdf-4e06-b481-a2e17098bb98 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:02.702569 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-87859ddf-4cdf-4e06-b481-a2e17098bb98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06a1988c95714ea38cbc1c1ede7c1fc6'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:02.703128 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-87859ddf-4cdf-4e06-b481-a2e17098bb98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06a1988c95714ea38cbc1c1ede7c1fc6'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:02.710145 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-87859ddf-4cdf-4e06-b481-a2e17098bb98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06a1988c95714ea38cbc1c1ede7c1fc6'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:02.746939 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def7a956-80cc-4ba6-937a-41d0b65cffc6 service cinder] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:02.748408 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-def7a956-80cc-4ba6-937a-41d0b65cffc6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:02.763010 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def7a956-80cc-4ba6-937a-41d0b65cffc6 service cinder] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:02.767634 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0581c070-23b1-4b9c-81c8-eba0ac79edd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:02.768553 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581c070-23b1-4b9c-81c8-eba0ac79edd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:02.768827 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581c070-23b1-4b9c-81c8-eba0ac79edd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:02.769099 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581c070-23b1-4b9c-81c8-eba0ac79edd1 admin admin] PATH_INFO: `/v3/users/93aa7b88ac3c475691a2bac55ea5c843` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:02.770281 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0581c070-23b1-4b9c-81c8-eba0ac79edd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93aa7b88ac3c475691a2bac55ea5c843)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:02.772235 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0581c070-23b1-4b9c-81c8-eba0ac79edd1 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:02.775756 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-87859ddf-4cdf-4e06-b481-a2e17098bb98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06a1988c95714ea38cbc1c1ede7c1fc6'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:02.776602 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-87859ddf-4cdf-4e06-b481-a2e17098bb98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06a1988c95714ea38cbc1c1ede7c1fc6'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:02.803176 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 957/1943] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:20:02 2022] DELETE /identity/v3/users/06a1988c95714ea38cbc1c1ede7c1fc6 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:02.808174 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee44ff1-ed55-4d2c-bf20-ad55668fb4b1 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:02.808464 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee44ff1-ed55-4d2c-bf20-ad55668fb4b1 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:02.808831 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee44ff1-ed55-4d2c-bf20-ad55668fb4b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:02.826305 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-4ee44ff1-ed55-4d2c-bf20-ad55668fb4b1 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:02.827491 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-4ee44ff1-ed55-4d2c-bf20-ad55668fb4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:02.893924 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 958/1944] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:20:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:02.905757 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee44ff1-ed55-4d2c-bf20-ad55668fb4b1 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:02.907209 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-4ee44ff1-ed55-4d2c-bf20-ad55668fb4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:02.962898 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee44ff1-ed55-4d2c-bf20-ad55668fb4b1 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:02.966617 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc8f96a-25d9-4b6c-b06b-bdc679ff9165 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:02.967266 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8f96a-25d9-4b6c-b06b-bdc679ff9165 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:02.967552 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8f96a-25d9-4b6c-b06b-bdc679ff9165 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:02.967826 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8f96a-25d9-4b6c-b06b-bdc679ff9165 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:02.977034 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc8f96a-25d9-4b6c-b06b-bdc679ff9165 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:02.978662 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc8f96a-25d9-4b6c-b06b-bdc679ff9165 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:02.985162 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-0581c070-23b1-4b9c-81c8-eba0ac79edd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93aa7b88ac3c475691a2bac55ea5c843'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:02.988041 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 959/1945] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:20:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:20:02.992121 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-0581c070-23b1-4b9c-81c8-eba0ac79edd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93aa7b88ac3c475691a2bac55ea5c843'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:03.008985 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-0581c070-23b1-4b9c-81c8-eba0ac79edd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93aa7b88ac3c475691a2bac55ea5c843'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:03.009702 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-0581c070-23b1-4b9c-81c8-eba0ac79edd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93aa7b88ac3c475691a2bac55ea5c843'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:03.010312 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-0581c070-23b1-4b9c-81c8-eba0ac79edd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93aa7b88ac3c475691a2bac55ea5c843'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:03.080564 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 987/1946] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:20:02 2022] DELETE /identity/v3/users/93aa7b88ac3c475691a2bac55ea5c843 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:03.085719 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5871c-86b2-472c-84f2-a0b169c56230 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:03.086013 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5871c-86b2-472c-84f2-a0b169c56230 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:03.086318 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5871c-86b2-472c-84f2-a0b169c56230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:03.103304 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-c1a5871c-86b2-472c-84f2-a0b169c56230 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:03.104530 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-c1a5871c-86b2-472c-84f2-a0b169c56230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:03.161714 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 960/1947] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:03.172344 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0581c070-23b1-4b9c-81c8-eba0ac79edd1 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:03.179341 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-0581c070-23b1-4b9c-81c8-eba0ac79edd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:03.237832 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0581c070-23b1-4b9c-81c8-eba0ac79edd1 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:03.242958 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cace43-dab7-4ac5-8a72-4934f1557434 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:03.243620 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cace43-dab7-4ac5-8a72-4934f1557434 service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:03.244105 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cace43-dab7-4ac5-8a72-4934f1557434 service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:03.244567 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cace43-dab7-4ac5-8a72-4934f1557434 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:03.255405 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cace43-dab7-4ac5-8a72-4934f1557434 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:03.256901 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cace43-dab7-4ac5-8a72-4934f1557434 service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:03.268471 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 988/1948] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:20:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:20:03.500019 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a5871c-86b2-472c-84f2-a0b169c56230 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:03.501533 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-c1a5871c-86b2-472c-84f2-a0b169c56230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:03.513361 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a5871c-86b2-472c-84f2-a0b169c56230 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:03.518410 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c6e166-e112-4ca2-ad25-baca615e005a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:03.518978 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6e166-e112-4ca2-ad25-baca615e005a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:03.519259 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6e166-e112-4ca2-ad25-baca615e005a admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:03.519531 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6e166-e112-4ca2-ad25-baca615e005a admin admin] PATH_INFO: `/v3/projects/e56c0b8e227e42a687bbaa79f78baa22` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:03.520744 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c6e166-e112-4ca2-ad25-baca615e005a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e56c0b8e227e42a687bbaa79f78baa22)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:03.523140 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c6e166-e112-4ca2-ad25-baca615e005a admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:03.633874 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d2c6e166-e112-4ca2-ad25-baca615e005a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e56c0b8e227e42a687bbaa79f78baa22', 'request_id': 'req-d2c6e166-e112-4ca2-ad25-baca615e005a'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:03.640655 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d2c6e166-e112-4ca2-ad25-baca615e005a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e56c0b8e227e42a687bbaa79f78baa22', 'request_id': 'req-d2c6e166-e112-4ca2-ad25-baca615e005a'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:03.647004 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d2c6e166-e112-4ca2-ad25-baca615e005a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e56c0b8e227e42a687bbaa79f78baa22', 'request_id': 'req-d2c6e166-e112-4ca2-ad25-baca615e005a'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:03.705540 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d2c6e166-e112-4ca2-ad25-baca615e005a admin admin] The token cache is being invalidate because project e56c0b8e227e42a687bbaa79f78baa22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:20:03.711269 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d2c6e166-e112-4ca2-ad25-baca615e005a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:03.711269 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d2c6e166-e112-4ca2-ad25-baca615e005a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:03.711765 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 961/1949] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:20:03 2022] DELETE /identity/v3/projects/e56c0b8e227e42a687bbaa79f78baa22 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:03.713203 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f77ae-4667-4ee1-9268-7ad0d0aa132d None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:03.713511 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f77ae-4667-4ee1-9268-7ad0d0aa132d None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:03.713818 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f77ae-4667-4ee1-9268-7ad0d0aa132d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:03.733582 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-a25f77ae-4667-4ee1-9268-7ad0d0aa132d None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:03.734852 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-a25f77ae-4667-4ee1-9268-7ad0d0aa132d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:03.807426 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c6e166-e112-4ca2-ad25-baca615e005a admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:03.809037 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-d2c6e166-e112-4ca2-ad25-baca615e005a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:03.826119 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 989/1950] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:03.833767 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffeb788-1474-4d11-9efe-ca3040573406 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:03.834052 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffeb788-1474-4d11-9efe-ca3040573406 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:03.834325 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffeb788-1474-4d11-9efe-ca3040573406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:03.864837 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-dffeb788-1474-4d11-9efe-ca3040573406 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:03.867081 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-dffeb788-1474-4d11-9efe-ca3040573406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:03.883832 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 990/1951] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:20:03.887919 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffeb788-1474-4d11-9efe-ca3040573406 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:03.897536 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffeb788-1474-4d11-9efe-ca3040573406 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:03.902704 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c9ce7d-baf5-469e-b63a-c4eea5636a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:03.904902 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c9ce7d-baf5-469e-b63a-c4eea5636a5f admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:03.904902 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c9ce7d-baf5-469e-b63a-c4eea5636a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:03.904902 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c9ce7d-baf5-469e-b63a-c4eea5636a5f admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:03.905301 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c6e166-e112-4ca2-ad25-baca615e005a admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:03.905379 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c9ce7d-baf5-469e-b63a-c4eea5636a5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:20:03.905379 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c9ce7d-baf5-469e-b63a-c4eea5636a5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:03.907530 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c9ce7d-baf5-469e-b63a-c4eea5636a5f admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:03.909854 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e6c367-7106-4e53-99c1-bb50b9133bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:03.910797 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6c367-7106-4e53-99c1-bb50b9133bdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:03.911152 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6c367-7106-4e53-99c1-bb50b9133bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:03.911496 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6c367-7106-4e53-99c1-bb50b9133bdc admin admin] PATH_INFO: `/v3/projects/635aa0651e7147e988933e9ad3503b9d` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:03.912811 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e6c367-7106-4e53-99c1-bb50b9133bdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=635aa0651e7147e988933e9ad3503b9d)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:03.915611 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e6c367-7106-4e53-99c1-bb50b9133bdc admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:03.924047 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 991/1952] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 10 03:20:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:20:03.929912 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c9ce7d-baf5-469e-b63a-c4eea5636a5f admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:03.941695 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c9ce7d-baf5-469e-b63a-c4eea5636a5f admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:03.947655 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803dc30e-b19b-4ae8-9aff-6cac595eee49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:03.947941 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803dc30e-b19b-4ae8-9aff-6cac595eee49 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:03.948657 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803dc30e-b19b-4ae8-9aff-6cac595eee49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:03.948994 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803dc30e-b19b-4ae8-9aff-6cac595eee49 admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:03.950189 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803dc30e-b19b-4ae8-9aff-6cac595eee49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:03.952549 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803dc30e-b19b-4ae8-9aff-6cac595eee49 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:04.067947 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 992/1953] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:20:03 2022] POST /identity/v3/projects => generated 373 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:20:04.078121 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803dc30e-b19b-4ae8-9aff-6cac595eee49 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:04.078558 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-20e6c367-7106-4e53-99c1-bb50b9133bdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '635aa0651e7147e988933e9ad3503b9d', 'request_id': 'req-20e6c367-7106-4e53-99c1-bb50b9133bdc'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:04.084501 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-20e6c367-7106-4e53-99c1-bb50b9133bdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '635aa0651e7147e988933e9ad3503b9d', 'request_id': 'req-20e6c367-7106-4e53-99c1-bb50b9133bdc'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:04.091883 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-20e6c367-7106-4e53-99c1-bb50b9133bdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '635aa0651e7147e988933e9ad3503b9d', 'request_id': 'req-20e6c367-7106-4e53-99c1-bb50b9133bdc'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:04.146495 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803dc30e-b19b-4ae8-9aff-6cac595eee49 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:04.151780 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2642ffba-23bc-4339-8a93-f3e82f0b787d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:04.152480 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642ffba-23bc-4339-8a93-f3e82f0b787d admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:04.152796 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642ffba-23bc-4339-8a93-f3e82f0b787d admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:04.153070 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642ffba-23bc-4339-8a93-f3e82f0b787d admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:04.155033 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2642ffba-23bc-4339-8a93-f3e82f0b787d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:04.155882 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2642ffba-23bc-4339-8a93-f3e82f0b787d admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:04.169646 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-20e6c367-7106-4e53-99c1-bb50b9133bdc admin admin] The token cache is being invalidate because project 635aa0651e7147e988933e9ad3503b9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:20:04.170068 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-20e6c367-7106-4e53-99c1-bb50b9133bdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:04.170749 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-20e6c367-7106-4e53-99c1-bb50b9133bdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:04.172616 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 962/1954] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:20:03 2022] DELETE /identity/v3/projects/635aa0651e7147e988933e9ad3503b9d => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:20:04.178715 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff4d65-8ff0-4eca-b5e0-fabd36c06b1c None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:04.179005 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff4d65-8ff0-4eca-b5e0-fabd36c06b1c None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:04.179287 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff4d65-8ff0-4eca-b5e0-fabd36c06b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:04.202500 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-c6ff4d65-8ff0-4eca-b5e0-fabd36c06b1c None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:04.202500 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-c6ff4d65-8ff0-4eca-b5e0-fabd36c06b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:04.209544 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 963/1955] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:20:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:20:04.218866 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b38b5-c802-46d5-bc84-8f6e34e7d074 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:04.219157 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b38b5-c802-46d5-bc84-8f6e34e7d074 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:04.219438 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b38b5-c802-46d5-bc84-8f6e34e7d074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:04.241089 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-b47b38b5-c802-46d5-bc84-8f6e34e7d074 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:04.242302 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-b47b38b5-c802-46d5-bc84-8f6e34e7d074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:04.250095 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 964/1956] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:20:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:20:04.254232 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47b38b5-c802-46d5-bc84-8f6e34e7d074 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:04.263013 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47b38b5-c802-46d5-bc84-8f6e34e7d074 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:04.263375 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 993/1957] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:20:04 2022] POST /identity/v3/users => generated 287 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:20:04.267376 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2642ffba-23bc-4339-8a93-f3e82f0b787d admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:04.268469 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a781370-af29-482d-b5ee-f0cc8e463b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:04.269070 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-2642ffba-23bc-4339-8a93-f3e82f0b787d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:04.269168 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a781370-af29-482d-b5ee-f0cc8e463b70 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:04.269365 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a781370-af29-482d-b5ee-f0cc8e463b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:04.269637 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a781370-af29-482d-b5ee-f0cc8e463b70 admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:04.270356 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a781370-af29-482d-b5ee-f0cc8e463b70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:20:04.270689 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a781370-af29-482d-b5ee-f0cc8e463b70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:04.272339 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a781370-af29-482d-b5ee-f0cc8e463b70 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:04.281661 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2642ffba-23bc-4339-8a93-f3e82f0b787d admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:04.285208 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 965/1958] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 10 03:20:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:20:04.286953 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cfbb1e-534f-408e-84f7-c42ecaf4a7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:04.287616 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cfbb1e-534f-408e-84f7-c42ecaf4a7bd admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:04.297641 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cfbb1e-534f-408e-84f7-c42ecaf4a7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:04.297641 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cfbb1e-534f-408e-84f7-c42ecaf4a7bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:04.297641 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cfbb1e-534f-408e-84f7-c42ecaf4a7bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:04.297641 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cfbb1e-534f-408e-84f7-c42ecaf4a7bd admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:04.300665 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a781370-af29-482d-b5ee-f0cc8e463b70 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:04.304513 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 994/1959] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:20:04.305719 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cfbb1e-534f-408e-84f7-c42ecaf4a7bd admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:04.311200 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a781370-af29-482d-b5ee-f0cc8e463b70 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:04.316380 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cfbb1e-534f-408e-84f7-c42ecaf4a7bd admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:04.317456 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d24b9-f4e4-4832-b1f9-890bbf007404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:04.318095 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d24b9-f4e4-4832-b1f9-890bbf007404 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:04.318413 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d24b9-f4e4-4832-b1f9-890bbf007404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:04.318655 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d24b9-f4e4-4832-b1f9-890bbf007404 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:04.319891 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d24b9-f4e4-4832-b1f9-890bbf007404 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:04.321959 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d24b9-f4e4-4832-b1f9-890bbf007404 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:04.322239 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f5442-72ea-4d56-aedc-d112580325d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:04.323115 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f5442-72ea-4d56-aedc-d112580325d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:04.323454 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f5442-72ea-4d56-aedc-d112580325d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:04.323796 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f5442-72ea-4d56-aedc-d112580325d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:04.324626 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414f5442-72ea-4d56-aedc-d112580325d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:04.326400 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414f5442-72ea-4d56-aedc-d112580325d7 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:04.338200 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 995/1960] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:20:04.350257 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f5442-72ea-4d56-aedc-d112580325d7 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:04.360023 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f5442-72ea-4d56-aedc-d112580325d7 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:04.364828 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39498a86-8ce4-4bcc-af58-72ed3201b0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:04.365698 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39498a86-8ce4-4bcc-af58-72ed3201b0a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:04.366009 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39498a86-8ce4-4bcc-af58-72ed3201b0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:04.370299 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39498a86-8ce4-4bcc-af58-72ed3201b0a8 admin admin] PATH_INFO: `/v3/projects/e657807af1e04591867ba2415bd24e6f/users/3683d2f5f2a648a6b2405df0377477d9/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:04.381736 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39498a86-8ce4-4bcc-af58-72ed3201b0a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e657807af1e04591867ba2415bd24e6f, user_id=3683d2f5f2a648a6b2405df0377477d9, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:04.385021 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39498a86-8ce4-4bcc-af58-72ed3201b0a8 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:04.444411 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 966/1961] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:20:04 2022] POST /identity/v3/projects => generated 375 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:20:04.448629 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d24b9-f4e4-4832-b1f9-890bbf007404 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:04.521255 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d24b9-f4e4-4832-b1f9-890bbf007404 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:04.526080 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d824f-7ff1-4408-bdb8-4f26c721633e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:04.526743 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d824f-7ff1-4408-bdb8-4f26c721633e admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:04.527113 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d824f-7ff1-4408-bdb8-4f26c721633e admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:04.527366 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d824f-7ff1-4408-bdb8-4f26c721633e admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:04.528133 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1d824f-7ff1-4408-bdb8-4f26c721633e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:04.530049 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1d824f-7ff1-4408-bdb8-4f26c721633e admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:04.664752 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 996/1962] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:20:04 2022] PUT /identity/v3/projects/e657807af1e04591867ba2415bd24e6f/users/3683d2f5f2a648a6b2405df0377477d9/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:20:04.664967 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 967/1963] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:20:04 2022] POST /identity/v3/users => generated 288 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:20:04.673808 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39498a86-8ce4-4bcc-af58-72ed3201b0a8 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:04.675215 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eeffce-9256-4154-acb7-b4a544ebf428 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:04.675510 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eeffce-9256-4154-acb7-b4a544ebf428 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:04.675897 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eeffce-9256-4154-acb7-b4a544ebf428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:04.701971 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-a2eeffce-9256-4154-acb7-b4a544ebf428 None None] MFA Rules not processed for user `3683d2f5f2a648a6b2405df0377477d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:04.703427 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-a2eeffce-9256-4154-acb7-b4a544ebf428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:04.734342 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39498a86-8ce4-4bcc-af58-72ed3201b0a8 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:04.739052 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e3e193-f7e3-4dfe-83cb-01426427e802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:04.739724 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e3e193-f7e3-4dfe-83cb-01426427e802 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:04.740033 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e3e193-f7e3-4dfe-83cb-01426427e802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:04.740346 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e3e193-f7e3-4dfe-83cb-01426427e802 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:04.741120 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e3e193-f7e3-4dfe-83cb-01426427e802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:04.742762 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e3e193-f7e3-4dfe-83cb-01426427e802 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:04.752879 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 997/1964] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:20:04.756817 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e3e193-f7e3-4dfe-83cb-01426427e802 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:04.766179 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e3e193-f7e3-4dfe-83cb-01426427e802 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:04.769884 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 968/1965] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:20:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:20:04.770817 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a89b97-c990-43bf-a690-686829692c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:04.771478 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a89b97-c990-43bf-a690-686829692c8a admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:04.771760 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a89b97-c990-43bf-a690-686829692c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:04.772073 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a89b97-c990-43bf-a690-686829692c8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:04.773389 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a89b97-c990-43bf-a690-686829692c8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:04.774702 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eeffce-9256-4154-acb7-b4a544ebf428 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:04.774937 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a89b97-c990-43bf-a690-686829692c8a admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:04.784700 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eeffce-9256-4154-acb7-b4a544ebf428 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:04.787770 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 998/1966] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:20:04.789406 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a89b97-c990-43bf-a690-686829692c8a admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:04.790871 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbc90ec-1c99-49d2-b757-52d43cbcb142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:04.791531 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc90ec-1c99-49d2-b757-52d43cbcb142 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:04.791816 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc90ec-1c99-49d2-b757-52d43cbcb142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:04.792135 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc90ec-1c99-49d2-b757-52d43cbcb142 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:04.792927 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbc90ec-1c99-49d2-b757-52d43cbcb142 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:04.794840 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbc90ec-1c99-49d2-b757-52d43cbcb142 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:04.798770 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a89b97-c990-43bf-a690-686829692c8a admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:04.803463 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0defe9-4adc-410d-a96b-f0ff5841f7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:04.804425 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0defe9-4adc-410d-a96b-f0ff5841f7de admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:04.804709 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0defe9-4adc-410d-a96b-f0ff5841f7de admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:04.805025 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0defe9-4adc-410d-a96b-f0ff5841f7de admin admin] PATH_INFO: `/v3/projects/ff940a5a38f043c0a8c96208f7e10ac2/users/2482b199e87f429ebb93a305f5c92c86/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:04.820696 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0defe9-4adc-410d-a96b-f0ff5841f7de admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff940a5a38f043c0a8c96208f7e10ac2, user_id=2482b199e87f429ebb93a305f5c92c86, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:04.823404 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0defe9-4adc-410d-a96b-f0ff5841f7de admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:04.922307 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 969/1967] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:20:04 2022] POST /identity/v3/projects => generated 373 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:20:04.926091 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbc90ec-1c99-49d2-b757-52d43cbcb142 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:04.933857 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 999/1968] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:20:04 2022] PUT /identity/v3/projects/ff940a5a38f043c0a8c96208f7e10ac2/users/2482b199e87f429ebb93a305f5c92c86/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:04.945372 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617db113-0939-495d-9152-c4f989a6d9a3 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:04.945652 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617db113-0939-495d-9152-c4f989a6d9a3 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:04.945923 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617db113-0939-495d-9152-c4f989a6d9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:04.977068 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-617db113-0939-495d-9152-c4f989a6d9a3 None None] MFA Rules not processed for user `2482b199e87f429ebb93a305f5c92c86`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:04.978279 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-617db113-0939-495d-9152-c4f989a6d9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:05.001275 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbc90ec-1c99-49d2-b757-52d43cbcb142 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:05.053834 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1000/1969] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:20:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:05.055593 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617db113-0939-495d-9152-c4f989a6d9a3 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:05.057235 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-617db113-0939-495d-9152-c4f989a6d9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:05.070612 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e482af0-b5d7-41ae-82fb-b0d45f034028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:05.071333 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e482af0-b5d7-41ae-82fb-b0d45f034028 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:05.071614 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e482af0-b5d7-41ae-82fb-b0d45f034028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:05.071892 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e482af0-b5d7-41ae-82fb-b0d45f034028 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:05.072945 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e482af0-b5d7-41ae-82fb-b0d45f034028 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:05.075168 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e482af0-b5d7-41ae-82fb-b0d45f034028 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:05.122914 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617db113-0939-495d-9152-c4f989a6d9a3 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:05.127963 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1563946-c424-4d12-bb8a-44726243bfef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:05.128881 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1563946-c424-4d12-bb8a-44726243bfef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:05.129162 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1563946-c424-4d12-bb8a-44726243bfef admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:05.129433 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1563946-c424-4d12-bb8a-44726243bfef admin admin] PATH_INFO: `/v3/users/78995d7eaec244918df57d35fec4ab1e` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:05.130636 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1563946-c424-4d12-bb8a-44726243bfef admin admin] RBAC: Authorizing `identity:delete_user(user_id=78995d7eaec244918df57d35fec4ab1e)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:05.132741 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1563946-c424-4d12-bb8a-44726243bfef admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:05.174741 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 970/1970] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:20:04 2022] POST /identity/v3/users => generated 293 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:20:05.174741 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e482af0-b5d7-41ae-82fb-b0d45f034028 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:05.182732 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e482af0-b5d7-41ae-82fb-b0d45f034028 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:05.187437 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74610ca-f485-4298-b82b-20622bcd90d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:05.188090 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74610ca-f485-4298-b82b-20622bcd90d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:05.188372 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74610ca-f485-4298-b82b-20622bcd90d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:05.188645 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74610ca-f485-4298-b82b-20622bcd90d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:05.189324 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74610ca-f485-4298-b82b-20622bcd90d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:05.191202 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74610ca-f485-4298-b82b-20622bcd90d4 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:05.290994 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 971/1971] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:20:05 2022] POST /identity/v3/projects => generated 373 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:20:05.291618 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74610ca-f485-4298-b82b-20622bcd90d4 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:05.332166 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-d1563946-c424-4d12-bb8a-44726243bfef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78995d7eaec244918df57d35fec4ab1e'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:05.340377 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-d1563946-c424-4d12-bb8a-44726243bfef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78995d7eaec244918df57d35fec4ab1e'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:05.353945 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-d1563946-c424-4d12-bb8a-44726243bfef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78995d7eaec244918df57d35fec4ab1e'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:05.354301 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-d1563946-c424-4d12-bb8a-44726243bfef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78995d7eaec244918df57d35fec4ab1e'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:05.354927 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-d1563946-c424-4d12-bb8a-44726243bfef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78995d7eaec244918df57d35fec4ab1e'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:05.357543 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74610ca-f485-4298-b82b-20622bcd90d4 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:05.362736 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271017ce-845c-45fb-8145-495e10b0b6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:05.363437 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271017ce-845c-45fb-8145-495e10b0b6fd admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:05.363720 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271017ce-845c-45fb-8145-495e10b0b6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:05.363993 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271017ce-845c-45fb-8145-495e10b0b6fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:05.364744 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271017ce-845c-45fb-8145-495e10b0b6fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:05.366923 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271017ce-845c-45fb-8145-495e10b0b6fd admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:05.377085 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 972/1972] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:20:05.378172 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271017ce-845c-45fb-8145-495e10b0b6fd admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:05.379854 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-271017ce-845c-45fb-8145-495e10b0b6fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:05.392116 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271017ce-845c-45fb-8145-495e10b0b6fd admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:05.396969 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6eac03-7c78-4e06-918f-02349413cdfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:05.397684 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6eac03-7c78-4e06-918f-02349413cdfa admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:05.397979 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6eac03-7c78-4e06-918f-02349413cdfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:05.398284 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6eac03-7c78-4e06-918f-02349413cdfa admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:05.398964 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6eac03-7c78-4e06-918f-02349413cdfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:05.400905 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6eac03-7c78-4e06-918f-02349413cdfa admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:05.451525 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1001/1973] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:20:05 2022] DELETE /identity/v3/users/78995d7eaec244918df57d35fec4ab1e => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:05.452384 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1563946-c424-4d12-bb8a-44726243bfef admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:05.453897 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-d1563946-c424-4d12-bb8a-44726243bfef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:05.515714 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1563946-c424-4d12-bb8a-44726243bfef admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:05.520772 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 973/1974] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:20:05 2022] POST /identity/v3/users => generated 293 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:20:05.520889 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f11958c-48fd-4998-a155-3374706e7a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:05.521566 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11958c-48fd-4998-a155-3374706e7a2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:05.521849 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11958c-48fd-4998-a155-3374706e7a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:05.521931 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b7114-75a5-4ebe-8ea8-91e51752762d None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:05.522839 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11958c-48fd-4998-a155-3374706e7a2a admin admin] PATH_INFO: `/v3/projects/66d45ae2a09b423e9366a544374b6e0f/users/ffc513bad22b42bfb043b02c43a931ed/roles/43105000610f402ca2486e7648018cca` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:05.522939 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b7114-75a5-4ebe-8ea8-91e51752762d None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:05.522939 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b7114-75a5-4ebe-8ea8-91e51752762d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:05.537867 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f11958c-48fd-4998-a155-3374706e7a2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=66d45ae2a09b423e9366a544374b6e0f, user_id=ffc513bad22b42bfb043b02c43a931ed, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:05.541070 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-b71b7114-75a5-4ebe-8ea8-91e51752762d None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:05.541474 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f11958c-48fd-4998-a155-3374706e7a2a admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:05.542243 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-b71b7114-75a5-4ebe-8ea8-91e51752762d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:05.549877 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 974/1975] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:20:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:05.550706 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b7114-75a5-4ebe-8ea8-91e51752762d None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:05.560325 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b7114-75a5-4ebe-8ea8-91e51752762d None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:05.565185 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5676015a-0643-488d-a931-f734aa1ce8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:05.565850 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676015a-0643-488d-a931-f734aa1ce8b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:05.566150 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676015a-0643-488d-a931-f734aa1ce8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:05.566428 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676015a-0643-488d-a931-f734aa1ce8b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:05.567149 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5676015a-0643-488d-a931-f734aa1ce8b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:05.568791 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5676015a-0643-488d-a931-f734aa1ce8b1 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:05.578571 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 975/1976] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:20:05.579310 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5676015a-0643-488d-a931-f734aa1ce8b1 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:05.580888 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-5676015a-0643-488d-a931-f734aa1ce8b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:05.611985 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1002/1977] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:20:05 2022] PUT /identity/v3/projects/66d45ae2a09b423e9366a544374b6e0f/users/ffc513bad22b42bfb043b02c43a931ed/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:05.612851 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f11958c-48fd-4998-a155-3374706e7a2a admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:05.640588 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5676015a-0643-488d-a931-f734aa1ce8b1 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:05.672680 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f11958c-48fd-4998-a155-3374706e7a2a admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:05.677588 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9130dd56-2ce5-487c-88cd-fa2bfa2eb247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:05.678474 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9130dd56-2ce5-487c-88cd-fa2bfa2eb247 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:05.678758 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9130dd56-2ce5-487c-88cd-fa2bfa2eb247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:05.679036 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9130dd56-2ce5-487c-88cd-fa2bfa2eb247 admin admin] PATH_INFO: `/v3/projects/bc96016842844bffb9e95d3b0fe0e626/users/5e064143f4714341921b10669250c159/roles/43105000610f402ca2486e7648018cca` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:05.690855 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dcbf2c-5fb7-4df2-94be-58bf03ba0091 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:05.691508 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dcbf2c-5fb7-4df2-94be-58bf03ba0091 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:05.691803 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dcbf2c-5fb7-4df2-94be-58bf03ba0091 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:05.692109 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dcbf2c-5fb7-4df2-94be-58bf03ba0091 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:05.693189 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9130dd56-2ce5-487c-88cd-fa2bfa2eb247 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc96016842844bffb9e95d3b0fe0e626, user_id=5e064143f4714341921b10669250c159, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:05.695839 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9130dd56-2ce5-487c-88cd-fa2bfa2eb247 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:05.701141 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dcbf2c-5fb7-4df2-94be-58bf03ba0091 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:05.702550 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dcbf2c-5fb7-4df2-94be-58bf03ba0091 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:05.712397 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 976/1978] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:20:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:20:05.714169 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dcbf2c-5fb7-4df2-94be-58bf03ba0091 service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:05.723936 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dcbf2c-5fb7-4df2-94be-58bf03ba0091 service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:05.729741 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705521c4-1cae-4891-bfea-5632c9e557e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:05.730481 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705521c4-1cae-4891-bfea-5632c9e557e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:05.730735 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705521c4-1cae-4891-bfea-5632c9e557e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:05.731011 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705521c4-1cae-4891-bfea-5632c9e557e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:05.731766 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705521c4-1cae-4891-bfea-5632c9e557e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:05.733405 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705521c4-1cae-4891-bfea-5632c9e557e1 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:05.744318 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 977/1979] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:20:05.748258 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705521c4-1cae-4891-bfea-5632c9e557e1 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:05.757806 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705521c4-1cae-4891-bfea-5632c9e557e1 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:05.762882 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cad67e-68f2-4078-936c-d6e5d652fe2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:05.763755 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cad67e-68f2-4078-936c-d6e5d652fe2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:05.764081 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cad67e-68f2-4078-936c-d6e5d652fe2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:05.764401 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cad67e-68f2-4078-936c-d6e5d652fe2d admin admin] PATH_INFO: `/v3/projects/66d45ae2a09b423e9366a544374b6e0f/users/ffc513bad22b42bfb043b02c43a931ed/roles/43105000610f402ca2486e7648018cca` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:05.770123 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cad67e-68f2-4078-936c-d6e5d652fe2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=66d45ae2a09b423e9366a544374b6e0f, user_id=ffc513bad22b42bfb043b02c43a931ed, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:05.770123 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cad67e-68f2-4078-936c-d6e5d652fe2d admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:05.780273 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 978/1980] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:20:05 2022] PUT /identity/v3/projects/66d45ae2a09b423e9366a544374b6e0f/users/ffc513bad22b42bfb043b02c43a931ed/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:20:05.792343 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1fed2-cf1d-4064-a163-1244e818c9ea None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:05.792558 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1fed2-cf1d-4064-a163-1244e818c9ea None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:05.792856 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1fed2-cf1d-4064-a163-1244e818c9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:05.798475 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1003/1981] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:20:05 2022] PUT /identity/v3/projects/bc96016842844bffb9e95d3b0fe0e626/users/5e064143f4714341921b10669250c159/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:05.802322 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9130dd56-2ce5-487c-88cd-fa2bfa2eb247 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:05.820569 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-48e1fed2-cf1d-4064-a163-1244e818c9ea None None] MFA Rules not processed for user `ffc513bad22b42bfb043b02c43a931ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:05.821809 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-48e1fed2-cf1d-4064-a163-1244e818c9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:05.866548 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9130dd56-2ce5-487c-88cd-fa2bfa2eb247 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:05.871637 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757bed63-b7e0-443a-9b57-779e68bfca01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:05.872698 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757bed63-b7e0-443a-9b57-779e68bfca01 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:05.873038 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757bed63-b7e0-443a-9b57-779e68bfca01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:05.873320 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757bed63-b7e0-443a-9b57-779e68bfca01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:05.874077 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757bed63-b7e0-443a-9b57-779e68bfca01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:05.875838 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757bed63-b7e0-443a-9b57-779e68bfca01 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:05.888508 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1004/1982] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:20:05.891917 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757bed63-b7e0-443a-9b57-779e68bfca01 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:05.893852 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 979/1983] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:20:05 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:20:05.906007 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757bed63-b7e0-443a-9b57-779e68bfca01 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:05.907743 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e1fed2-cf1d-4064-a163-1244e818c9ea None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:05.909310 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-48e1fed2-cf1d-4064-a163-1244e818c9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:05.913065 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b3e63-3eaf-4aaf-95b7-a295410f12aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:05.914965 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b3e63-3eaf-4aaf-95b7-a295410f12aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:05.915198 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b3e63-3eaf-4aaf-95b7-a295410f12aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:05.915999 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b3e63-3eaf-4aaf-95b7-a295410f12aa admin admin] PATH_INFO: `/v3/projects/bc96016842844bffb9e95d3b0fe0e626/users/5e064143f4714341921b10669250c159/roles/43105000610f402ca2486e7648018cca` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:05.922103 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3b3e63-3eaf-4aaf-95b7-a295410f12aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc96016842844bffb9e95d3b0fe0e626, user_id=5e064143f4714341921b10669250c159, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:05.925572 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3b3e63-3eaf-4aaf-95b7-a295410f12aa admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:05.938770 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1005/1984] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:20:05 2022] PUT /identity/v3/projects/bc96016842844bffb9e95d3b0fe0e626/users/5e064143f4714341921b10669250c159/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:05.951643 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ab2c6-beb3-4eb6-897a-c054ffc8d3a7 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:05.951940 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ab2c6-beb3-4eb6-897a-c054ffc8d3a7 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:05.952310 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ab2c6-beb3-4eb6-897a-c054ffc8d3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:05.982260 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-d21ab2c6-beb3-4eb6-897a-c054ffc8d3a7 None None] MFA Rules not processed for user `5e064143f4714341921b10669250c159`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:05.983485 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-d21ab2c6-beb3-4eb6-897a-c054ffc8d3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:05.988265 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e1fed2-cf1d-4064-a163-1244e818c9ea None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:06.043574 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3945d80a-bf3d-4712-8cca-f1f119d860b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:06.043574 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945d80a-bf3d-4712-8cca-f1f119d860b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:06.043938 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945d80a-bf3d-4712-8cca-f1f119d860b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:06.044103 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945d80a-bf3d-4712-8cca-f1f119d860b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:06.045798 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-3945d80a-bf3d-4712-8cca-f1f119d860b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:06.064380 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1006/1985] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:20:05 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:06.074596 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21ab2c6-beb3-4eb6-897a-c054ffc8d3a7 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:06.076024 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-d21ab2c6-beb3-4eb6-897a-c054ffc8d3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:06.088760 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21ab2c6-beb3-4eb6-897a-c054ffc8d3a7 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:06.093297 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa7698-222f-4bca-8512-4adc53da0d2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:06.093950 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa7698-222f-4bca-8512-4adc53da0d2e service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:06.094262 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa7698-222f-4bca-8512-4adc53da0d2e service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:06.094509 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa7698-222f-4bca-8512-4adc53da0d2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:06.096360 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-6eaa7698-222f-4bca-8512-4adc53da0d2e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:06.111550 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3945d80a-bf3d-4712-8cca-f1f119d860b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:06.113055 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3945d80a-bf3d-4712-8cca-f1f119d860b4 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:06.125322 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 980/1986] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:20:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:20:06.129700 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3945d80a-bf3d-4712-8cca-f1f119d860b4 service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:06.129700 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-3945d80a-bf3d-4712-8cca-f1f119d860b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:06.189562 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaa7698-222f-4bca-8512-4adc53da0d2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:06.191021 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaa7698-222f-4bca-8512-4adc53da0d2e service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:06.213410 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1007/1987] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:20:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:20:06.213977 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3945d80a-bf3d-4712-8cca-f1f119d860b4 service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:06.220834 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e12f64a-f8cd-4f1b-b0dd-f539f0871772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:06.221871 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12f64a-f8cd-4f1b-b0dd-f539f0871772 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:06.222163 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12f64a-f8cd-4f1b-b0dd-f539f0871772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:06.222492 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12f64a-f8cd-4f1b-b0dd-f539f0871772 admin admin] PATH_INFO: `/v3/projects/c87fcab3cf8c4638a8b1aca7561f3aa2` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:06.224402 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e12f64a-f8cd-4f1b-b0dd-f539f0871772 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c87fcab3cf8c4638a8b1aca7561f3aa2)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:06.227525 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e12f64a-f8cd-4f1b-b0dd-f539f0871772 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:06.386480 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3e12f64a-f8cd-4f1b-b0dd-f539f0871772 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c87fcab3cf8c4638a8b1aca7561f3aa2', 'request_id': 'req-3e12f64a-f8cd-4f1b-b0dd-f539f0871772'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:06.391913 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3e12f64a-f8cd-4f1b-b0dd-f539f0871772 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c87fcab3cf8c4638a8b1aca7561f3aa2', 'request_id': 'req-3e12f64a-f8cd-4f1b-b0dd-f539f0871772'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:06.398679 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3e12f64a-f8cd-4f1b-b0dd-f539f0871772 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c87fcab3cf8c4638a8b1aca7561f3aa2', 'request_id': 'req-3e12f64a-f8cd-4f1b-b0dd-f539f0871772'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:06.510498 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3e12f64a-f8cd-4f1b-b0dd-f539f0871772 admin admin] The token cache is being invalidate because project c87fcab3cf8c4638a8b1aca7561f3aa2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:20:06.510790 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3e12f64a-f8cd-4f1b-b0dd-f539f0871772 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:06.511451 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3e12f64a-f8cd-4f1b-b0dd-f539f0871772 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:06.516781 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 981/1988] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:20:06 2022] DELETE /identity/v3/projects/c87fcab3cf8c4638a8b1aca7561f3aa2 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:06.518030 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa7698-222f-4bca-8512-4adc53da0d2e service cinder] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:06.542373 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa7698-222f-4bca-8512-4adc53da0d2e service cinder] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:06.621171 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e7170b-8422-4cc0-b4a1-1c8b3d62325a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:06.622017 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e7170b-8422-4cc0-b4a1-1c8b3d62325a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:06.622294 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e7170b-8422-4cc0-b4a1-1c8b3d62325a admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:06.622565 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e7170b-8422-4cc0-b4a1-1c8b3d62325a admin admin] PATH_INFO: `/v3/users/02441431d5c1453d9995f7280a0907b3` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:06.623723 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e7170b-8422-4cc0-b4a1-1c8b3d62325a admin admin] RBAC: Authorizing `identity:delete_user(user_id=02441431d5c1453d9995f7280a0907b3)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:06.625749 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e7170b-8422-4cc0-b4a1-1c8b3d62325a admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:06.818926 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-69e7170b-8422-4cc0-b4a1-1c8b3d62325a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02441431d5c1453d9995f7280a0907b3'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:06.826282 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-69e7170b-8422-4cc0-b4a1-1c8b3d62325a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02441431d5c1453d9995f7280a0907b3'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:06.840846 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-69e7170b-8422-4cc0-b4a1-1c8b3d62325a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02441431d5c1453d9995f7280a0907b3'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:06.841835 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-69e7170b-8422-4cc0-b4a1-1c8b3d62325a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02441431d5c1453d9995f7280a0907b3'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:06.842467 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-69e7170b-8422-4cc0-b4a1-1c8b3d62325a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02441431d5c1453d9995f7280a0907b3'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:06.966278 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1008/1989] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:20:06 2022] DELETE /identity/v3/users/02441431d5c1453d9995f7280a0907b3 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:20:07.445109 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e12f64a-f8cd-4f1b-b0dd-f539f0871772 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:07.446661 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-3e12f64a-f8cd-4f1b-b0dd-f539f0871772 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:07.478607 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e12f64a-f8cd-4f1b-b0dd-f539f0871772 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:07.547034 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b043b0-2215-43d7-ab84-488081b45611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:07.547894 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b043b0-2215-43d7-ab84-488081b45611 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:07.548201 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b043b0-2215-43d7-ab84-488081b45611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:07.548473 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b043b0-2215-43d7-ab84-488081b45611 admin admin] PATH_INFO: `/v3/projects/b1649cb2e0cd4262aad421c14c0b0e8e` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:07.549641 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b043b0-2215-43d7-ab84-488081b45611 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1649cb2e0cd4262aad421c14c0b0e8e)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:07.551544 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b043b0-2215-43d7-ab84-488081b45611 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:07.667310 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e7b043b0-2215-43d7-ab84-488081b45611 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1649cb2e0cd4262aad421c14c0b0e8e', 'request_id': 'req-e7b043b0-2215-43d7-ab84-488081b45611'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:07.672972 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e7b043b0-2215-43d7-ab84-488081b45611 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1649cb2e0cd4262aad421c14c0b0e8e', 'request_id': 'req-e7b043b0-2215-43d7-ab84-488081b45611'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:07.686109 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e7b043b0-2215-43d7-ab84-488081b45611 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1649cb2e0cd4262aad421c14c0b0e8e', 'request_id': 'req-e7b043b0-2215-43d7-ab84-488081b45611'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:07.760310 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e7b043b0-2215-43d7-ab84-488081b45611 admin admin] The token cache is being invalidate because project b1649cb2e0cd4262aad421c14c0b0e8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:20:07.760598 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e7b043b0-2215-43d7-ab84-488081b45611 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:07.761218 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e7b043b0-2215-43d7-ab84-488081b45611 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:07.763014 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 982/1990] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:20:07 2022] DELETE /identity/v3/projects/b1649cb2e0cd4262aad421c14c0b0e8e => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:07.767944 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd3cda-da1d-4751-908a-c0b02ad32dec None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:07.768428 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd3cda-da1d-4751-908a-c0b02ad32dec None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:07.768539 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd3cda-da1d-4751-908a-c0b02ad32dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:07.786297 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-21cd3cda-da1d-4751-908a-c0b02ad32dec None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:07.787489 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-21cd3cda-da1d-4751-908a-c0b02ad32dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:07.846157 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1009/1991] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:20:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:07.853924 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124d99e-3eb3-44d2-b207-f3ccc9cc21c3 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:07.854236 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124d99e-3eb3-44d2-b207-f3ccc9cc21c3 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:07.854504 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124d99e-3eb3-44d2-b207-f3ccc9cc21c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:07.873800 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-6124d99e-3eb3-44d2-b207-f3ccc9cc21c3 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:07.875001 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-6124d99e-3eb3-44d2-b207-f3ccc9cc21c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:07.883765 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 983/1992] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:20:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:20:07.888021 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd3cda-da1d-4751-908a-c0b02ad32dec None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:07.897879 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd3cda-da1d-4751-908a-c0b02ad32dec None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:07.902475 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b02cbd-7eeb-4c01-800e-c67fd645f6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:07.903141 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b02cbd-7eeb-4c01-800e-c67fd645f6b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:07.903408 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b02cbd-7eeb-4c01-800e-c67fd645f6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:07.903682 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b02cbd-7eeb-4c01-800e-c67fd645f6b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:07.904454 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b02cbd-7eeb-4c01-800e-c67fd645f6b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:20:07.904760 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b02cbd-7eeb-4c01-800e-c67fd645f6b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:07.906337 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b02cbd-7eeb-4c01-800e-c67fd645f6b5 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:07.921713 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1010/1993] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 10 03:20:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:20:07.922779 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6124d99e-3eb3-44d2-b207-f3ccc9cc21c3 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:07.939042 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6124d99e-3eb3-44d2-b207-f3ccc9cc21c3 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:07.943943 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92940e-82dc-4b27-b56d-60339d7e79d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:07.945292 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92940e-82dc-4b27-b56d-60339d7e79d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:07.945645 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92940e-82dc-4b27-b56d-60339d7e79d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:07.945990 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92940e-82dc-4b27-b56d-60339d7e79d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:07.946756 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c92940e-82dc-4b27-b56d-60339d7e79d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:07.948938 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c92940e-82dc-4b27-b56d-60339d7e79d9 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:08.036252 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 984/1994] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:20:07 2022] POST /identity/v3/projects => generated 389 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:20:08.041472 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b02cbd-7eeb-4c01-800e-c67fd645f6b5 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:08.051526 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b02cbd-7eeb-4c01-800e-c67fd645f6b5 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:08.106006 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa81512-75f7-4c6f-b76c-2db132bdeac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:08.106676 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa81512-75f7-4c6f-b76c-2db132bdeac6 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:08.106952 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa81512-75f7-4c6f-b76c-2db132bdeac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:08.107291 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa81512-75f7-4c6f-b76c-2db132bdeac6 admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:08.108037 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa81512-75f7-4c6f-b76c-2db132bdeac6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:08.109946 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa81512-75f7-4c6f-b76c-2db132bdeac6 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:08.191258 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1011/1995] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:20:08 2022] POST /identity/v3/users => generated 295 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:20:08.204113 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92940e-82dc-4b27-b56d-60339d7e79d9 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:08.214495 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92940e-82dc-4b27-b56d-60339d7e79d9 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:08.219161 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d98e2e-1138-41bd-9846-8dd29ff78506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:08.219827 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d98e2e-1138-41bd-9846-8dd29ff78506 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:08.220177 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d98e2e-1138-41bd-9846-8dd29ff78506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:08.220456 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d98e2e-1138-41bd-9846-8dd29ff78506 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:08.221183 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d98e2e-1138-41bd-9846-8dd29ff78506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:08.222814 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d98e2e-1138-41bd-9846-8dd29ff78506 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:08.234476 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 985/1996] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:20:08.238332 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa81512-75f7-4c6f-b76c-2db132bdeac6 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:08.249418 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa81512-75f7-4c6f-b76c-2db132bdeac6 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:08.253953 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a0c681-0cf7-4fb3-a5b9-20ad24875f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:08.257343 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0c681-0cf7-4fb3-a5b9-20ad24875f81 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:08.257343 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0c681-0cf7-4fb3-a5b9-20ad24875f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:08.257343 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0c681-0cf7-4fb3-a5b9-20ad24875f81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:08.257343 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a0c681-0cf7-4fb3-a5b9-20ad24875f81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:08.257664 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a0c681-0cf7-4fb3-a5b9-20ad24875f81 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:08.267321 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1012/1997] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:20:08.271446 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d98e2e-1138-41bd-9846-8dd29ff78506 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:08.281274 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d98e2e-1138-41bd-9846-8dd29ff78506 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:08.286105 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fabd9c-3eea-4f0c-8511-e03a32d9ffc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:08.288725 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fabd9c-3eea-4f0c-8511-e03a32d9ffc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:08.288725 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fabd9c-3eea-4f0c-8511-e03a32d9ffc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:08.288725 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fabd9c-3eea-4f0c-8511-e03a32d9ffc0 admin admin] PATH_INFO: `/v3/projects/58416df47383407d905c8573ed3e3dde/users/4a33636a03d34188b0f97b98732d3615/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:08.303418 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fabd9c-3eea-4f0c-8511-e03a32d9ffc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58416df47383407d905c8573ed3e3dde, user_id=4a33636a03d34188b0f97b98732d3615, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:08.307131 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fabd9c-3eea-4f0c-8511-e03a32d9ffc0 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:08.405926 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 986/1998] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:20:08 2022] PUT /identity/v3/projects/58416df47383407d905c8573ed3e3dde/users/4a33636a03d34188b0f97b98732d3615/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:08.418218 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed1d83-8870-4f0a-9fa9-978f27258267 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:08.418450 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed1d83-8870-4f0a-9fa9-978f27258267 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:08.418733 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed1d83-8870-4f0a-9fa9-978f27258267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:08.445218 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-e3ed1d83-8870-4f0a-9fa9-978f27258267 None None] MFA Rules not processed for user `4a33636a03d34188b0f97b98732d3615`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:08.446449 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-e3ed1d83-8870-4f0a-9fa9-978f27258267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:08.509855 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1013/1999] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:20:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:08.514315 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fabd9c-3eea-4f0c-8511-e03a32d9ffc0 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:08.577682 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fabd9c-3eea-4f0c-8511-e03a32d9ffc0 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:08.582682 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1955fee-25f9-48da-817a-f9d511487dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:08.583403 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1955fee-25f9-48da-817a-f9d511487dac admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:08.583742 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1955fee-25f9-48da-817a-f9d511487dac admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:08.584106 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1955fee-25f9-48da-817a-f9d511487dac admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:08.584850 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1955fee-25f9-48da-817a-f9d511487dac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:08.587459 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1955fee-25f9-48da-817a-f9d511487dac admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:08.676396 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 987/2000] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:20:08 2022] POST /identity/v3/projects => generated 387 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:20:08.679746 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed1d83-8870-4f0a-9fa9-978f27258267 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:08.690638 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed1d83-8870-4f0a-9fa9-978f27258267 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:08.750232 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6103f41-1003-4ef1-b33e-f4c5b88c6b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:08.751340 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6103f41-1003-4ef1-b33e-f4c5b88c6b3d admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:08.751632 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6103f41-1003-4ef1-b33e-f4c5b88c6b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:08.751923 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6103f41-1003-4ef1-b33e-f4c5b88c6b3d admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:08.752684 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6103f41-1003-4ef1-b33e-f4c5b88c6b3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:08.754599 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6103f41-1003-4ef1-b33e-f4c5b88c6b3d admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:08.841889 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1014/2001] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:20:08 2022] POST /identity/v3/users => generated 300 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:20:08.843190 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1955fee-25f9-48da-817a-f9d511487dac admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:08.853845 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1955fee-25f9-48da-817a-f9d511487dac admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:08.858740 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c6fce-e13b-4e7c-9e46-7fba28268ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:08.859401 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c6fce-e13b-4e7c-9e46-7fba28268ed2 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:08.859686 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c6fce-e13b-4e7c-9e46-7fba28268ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:08.859958 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c6fce-e13b-4e7c-9e46-7fba28268ed2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:08.860716 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459c6fce-e13b-4e7c-9e46-7fba28268ed2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:08.862285 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459c6fce-e13b-4e7c-9e46-7fba28268ed2 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:08.872924 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 988/2002] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:20:08.877164 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6103f41-1003-4ef1-b33e-f4c5b88c6b3d admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:08.887760 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6103f41-1003-4ef1-b33e-f4c5b88c6b3d admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:08.892493 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c2bdfb-b26d-4163-9def-d21d1e78a83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:08.893368 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2bdfb-b26d-4163-9def-d21d1e78a83e admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:08.893653 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2bdfb-b26d-4163-9def-d21d1e78a83e admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:08.893936 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2bdfb-b26d-4163-9def-d21d1e78a83e admin admin] PATH_INFO: `/v3/projects/46c85f8741744681a6260106a1cf4760/users/04b0b054c0da426e8320be1498ad0ef5/roles/43105000610f402ca2486e7648018cca` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:08.909433 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c2bdfb-b26d-4163-9def-d21d1e78a83e admin admin] RBAC: Authorizing `identity:create_grant(project_id=46c85f8741744681a6260106a1cf4760, user_id=04b0b054c0da426e8320be1498ad0ef5, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:08.912119 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c2bdfb-b26d-4163-9def-d21d1e78a83e admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:08.965980 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6737c219-d66f-4088-af79-d17ee8547f8c None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:08.966273 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6737c219-d66f-4088-af79-d17ee8547f8c None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:08.966554 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6737c219-d66f-4088-af79-d17ee8547f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:08.972020 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1015/2003] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:20:08 2022] PUT /identity/v3/projects/46c85f8741744681a6260106a1cf4760/users/04b0b054c0da426e8320be1498ad0ef5/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:08.976431 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c2bdfb-b26d-4163-9def-d21d1e78a83e admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:08.984216 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-6737c219-d66f-4088-af79-d17ee8547f8c None None] MFA Rules not processed for user `6ebfab3ff0b24f4aaabb8c6bb0ad10c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:08.985492 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-6737c219-d66f-4088-af79-d17ee8547f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:09.037840 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c2bdfb-b26d-4163-9def-d21d1e78a83e admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:09.041308 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 989/2004] 10.222.0.65 () {58 vars in 1009 bytes} [Tue May 10 03:20:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:20:09.043138 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a189d0bb-3ca3-48fa-86d3-8dac9bb830c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:09.043804 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a189d0bb-3ca3-48fa-86d3-8dac9bb830c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:09.044132 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a189d0bb-3ca3-48fa-86d3-8dac9bb830c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:09.044449 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a189d0bb-3ca3-48fa-86d3-8dac9bb830c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:09.045190 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a189d0bb-3ca3-48fa-86d3-8dac9bb830c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:09.046905 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a189d0bb-3ca3-48fa-86d3-8dac9bb830c6 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:09.060046 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1016/2005] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:20:09.062281 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6737c219-d66f-4088-af79-d17ee8547f8c None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:09.075035 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6737c219-d66f-4088-af79-d17ee8547f8c None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:09.080320 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce5b65-a4ea-4a1d-91ab-4a080cdeb7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:09.081375 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce5b65-a4ea-4a1d-91ab-4a080cdeb7f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:09.081613 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce5b65-a4ea-4a1d-91ab-4a080cdeb7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:09.081895 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce5b65-a4ea-4a1d-91ab-4a080cdeb7f8 admin admin] PATH_INFO: `/v3/projects/46c85f8741744681a6260106a1cf4760/users/04b0b054c0da426e8320be1498ad0ef5/roles/43105000610f402ca2486e7648018cca` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:09.084078 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcce5b65-a4ea-4a1d-91ab-4a080cdeb7f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46c85f8741744681a6260106a1cf4760, user_id=04b0b054c0da426e8320be1498ad0ef5, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:09.084396 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a189d0bb-3ca3-48fa-86d3-8dac9bb830c6 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:09.086752 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-a189d0bb-3ca3-48fa-86d3-8dac9bb830c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:09.087515 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcce5b65-a4ea-4a1d-91ab-4a080cdeb7f8 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:09.098447 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 990/2006] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:20:09 2022] PUT /identity/v3/projects/46c85f8741744681a6260106a1cf4760/users/04b0b054c0da426e8320be1498ad0ef5/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:09.108433 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e5ed5-5fed-4881-912d-68192143680e None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:09.108729 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e5ed5-5fed-4881-912d-68192143680e None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:09.109010 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e5ed5-5fed-4881-912d-68192143680e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:09.135170 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-2c4e5ed5-5fed-4881-912d-68192143680e None None] MFA Rules not processed for user `04b0b054c0da426e8320be1498ad0ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:09.136428 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-2c4e5ed5-5fed-4881-912d-68192143680e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:09.161137 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a189d0bb-3ca3-48fa-86d3-8dac9bb830c6 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:09.216339 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 991/2007] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:20:09 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:20:09.223435 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db35be-3310-4978-a74f-45df5e91c049 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1cb8ad43a234233ad602f451f0f8ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:09.224183 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db35be-3310-4978-a74f-45df5e91c049 service swift] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:09.224478 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db35be-3310-4978-a74f-45df5e91c049 service swift] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:09.224815 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db35be-3310-4978-a74f-45df5e91c049 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:09.227718 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4e5ed5-5fed-4881-912d-68192143680e None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:09.229379 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-2c4e5ed5-5fed-4881-912d-68192143680e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:09.281912 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4db35be-3310-4978-a74f-45df5e91c049 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:09.283501 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4db35be-3310-4978-a74f-45df5e91c049 service swift] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:09.286726 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4e5ed5-5fed-4881-912d-68192143680e None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:09.291340 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4ba3ba-d546-4c93-ade0-580961ff4d10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:09.291900 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1017/2008] 10.222.0.65 () {60 vars in 1384 bytes} [Tue May 10 03:20:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 10 03:20:09.292046 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ba3ba-d546-4c93-ade0-580961ff4d10 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:09.292321 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ba3ba-d546-4c93-ade0-580961ff4d10 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:09.292715 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ba3ba-d546-4c93-ade0-580961ff4d10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:09.292927 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db35be-3310-4978-a74f-45df5e91c049 service swift] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:09.294345 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-a4db35be-3310-4978-a74f-45df5e91c049 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:09.305075 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4ba3ba-d546-4c93-ade0-580961ff4d10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:09.306569 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4ba3ba-d546-4c93-ade0-580961ff4d10 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:09.316808 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 992/2009] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:20:09 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:20:09.368297 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db35be-3310-4978-a74f-45df5e91c049 service swift] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:09.378159 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd7740d-52b7-49cb-8149-c8f3686a8c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:09.378159 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7740d-52b7-49cb-8149-c8f3686a8c5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:09.378159 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7740d-52b7-49cb-8149-c8f3686a8c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:09.378159 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7740d-52b7-49cb-8149-c8f3686a8c5f admin admin] PATH_INFO: `/v3/users/3683d2f5f2a648a6b2405df0377477d9` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:09.378519 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd7740d-52b7-49cb-8149-c8f3686a8c5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3683d2f5f2a648a6b2405df0377477d9)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:09.378519 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd7740d-52b7-49cb-8149-c8f3686a8c5f admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:09.461910 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4ba3ba-d546-4c93-ade0-580961ff4d10 service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:09.474705 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4ba3ba-d546-4c93-ade0-580961ff4d10 service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:09.477399 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4037f7-4fe4-4825-8f84-9b1a0db24dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:09.478259 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4037f7-4fe4-4825-8f84-9b1a0db24dcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:09.478538 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4037f7-4fe4-4825-8f84-9b1a0db24dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:09.478811 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4037f7-4fe4-4825-8f84-9b1a0db24dcd admin admin] PATH_INFO: `/v3/users/4a33636a03d34188b0f97b98732d3615` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:09.479994 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4037f7-4fe4-4825-8f84-9b1a0db24dcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a33636a03d34188b0f97b98732d3615)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:09.481980 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4037f7-4fe4-4825-8f84-9b1a0db24dcd admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:09.676177 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-6dd7740d-52b7-49cb-8149-c8f3686a8c5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3683d2f5f2a648a6b2405df0377477d9'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:09.683403 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-6dd7740d-52b7-49cb-8149-c8f3686a8c5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3683d2f5f2a648a6b2405df0377477d9'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:09.696108 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-6dd7740d-52b7-49cb-8149-c8f3686a8c5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3683d2f5f2a648a6b2405df0377477d9'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:09.696867 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-6dd7740d-52b7-49cb-8149-c8f3686a8c5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3683d2f5f2a648a6b2405df0377477d9'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:09.698941 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-6dd7740d-52b7-49cb-8149-c8f3686a8c5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3683d2f5f2a648a6b2405df0377477d9'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:09.730579 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8a4037f7-4fe4-4825-8f84-9b1a0db24dcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a33636a03d34188b0f97b98732d3615'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:09.731179 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8a4037f7-4fe4-4825-8f84-9b1a0db24dcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a33636a03d34188b0f97b98732d3615'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:09.738080 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8a4037f7-4fe4-4825-8f84-9b1a0db24dcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a33636a03d34188b0f97b98732d3615'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:09.809264 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1018/2010] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:20:09 2022] DELETE /identity/v3/users/3683d2f5f2a648a6b2405df0377477d9 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:09.811411 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd7740d-52b7-49cb-8149-c8f3686a8c5f admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:09.814026 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-6dd7740d-52b7-49cb-8149-c8f3686a8c5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:09.866721 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8a4037f7-4fe4-4825-8f84-9b1a0db24dcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a33636a03d34188b0f97b98732d3615'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:09.866721 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8a4037f7-4fe4-4825-8f84-9b1a0db24dcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a33636a03d34188b0f97b98732d3615'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:09.876443 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 993/2011] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:20:09 2022] DELETE /identity/v3/users/4a33636a03d34188b0f97b98732d3615 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:09.877925 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffd54b-ecda-4494-bad7-034c54d289b2 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:09.878276 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffd54b-ecda-4494-bad7-034c54d289b2 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:09.878562 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffd54b-ecda-4494-bad7-034c54d289b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:09.884163 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd7740d-52b7-49cb-8149-c8f3686a8c5f admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:09.902353 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-6dffd54b-ecda-4494-bad7-034c54d289b2 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:09.903555 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-6dffd54b-ecda-4494-bad7-034c54d289b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:09.939173 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c60631-da29-4d37-9ccb-b0cfc7f9123d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:09.939830 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c60631-da29-4d37-9ccb-b0cfc7f9123d service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:09.940143 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c60631-da29-4d37-9ccb-b0cfc7f9123d service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:09.940415 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c60631-da29-4d37-9ccb-b0cfc7f9123d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:09.942212 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-34c60631-da29-4d37-9ccb-b0cfc7f9123d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:09.978834 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 994/2012] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:20:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:09.980149 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c220a8d-3e0d-4f6a-8bea-72abb2baf5de None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:09.980540 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c220a8d-3e0d-4f6a-8bea-72abb2baf5de None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:09.981083 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c220a8d-3e0d-4f6a-8bea-72abb2baf5de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:09.999106 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-1c220a8d-3e0d-4f6a-8bea-72abb2baf5de None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:10.000442 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-1c220a8d-3e0d-4f6a-8bea-72abb2baf5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:10.009208 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 995/2013] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:20:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:10.012107 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c60631-da29-4d37-9ccb-b0cfc7f9123d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:10.013477 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c220a8d-3e0d-4f6a-8bea-72abb2baf5de None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:10.013589 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c60631-da29-4d37-9ccb-b0cfc7f9123d service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:10.014924 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-1c220a8d-3e0d-4f6a-8bea-72abb2baf5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:10.024984 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1019/2014] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:20:09 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:20:10.025721 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c60631-da29-4d37-9ccb-b0cfc7f9123d service cinder] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:10.027158 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-34c60631-da29-4d37-9ccb-b0cfc7f9123d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:10.082989 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c220a8d-3e0d-4f6a-8bea-72abb2baf5de None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:10.087675 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bcc120-32f5-400c-acd3-53cdcfbf932b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:10.088644 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bcc120-32f5-400c-acd3-53cdcfbf932b service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:10.095288 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bcc120-32f5-400c-acd3-53cdcfbf932b service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:10.095288 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bcc120-32f5-400c-acd3-53cdcfbf932b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:10.095480 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c60631-da29-4d37-9ccb-b0cfc7f9123d service cinder] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:10.095480 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e31f0-3a91-4e66-8fdd-1576237c1edf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:10.095480 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e31f0-3a91-4e66-8fdd-1576237c1edf service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:10.095480 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e31f0-3a91-4e66-8fdd-1576237c1edf service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:10.095832 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e31f0-3a91-4e66-8fdd-1576237c1edf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:10.099792 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bcc120-32f5-400c-acd3-53cdcfbf932b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:10.102086 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bcc120-32f5-400c-acd3-53cdcfbf932b service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:10.105820 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18e31f0-3a91-4e66-8fdd-1576237c1edf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:10.107504 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18e31f0-3a91-4e66-8fdd-1576237c1edf service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:10.111724 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 996/2015] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:20:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:20:10.121199 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1020/2016] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:20:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:20:10.251742 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba3c4f-3dc0-48b5-ad90-f2b1f675e024 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:10.252553 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba3c4f-3dc0-48b5-ad90-f2b1f675e024 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:10.253046 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba3c4f-3dc0-48b5-ad90-f2b1f675e024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:10.276405 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-70ba3c4f-3dc0-48b5-ad90-f2b1f675e024 None None] MFA Rules not processed for user `6ebfab3ff0b24f4aaabb8c6bb0ad10c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:10.277712 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-70ba3c4f-3dc0-48b5-ad90-f2b1f675e024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:10.331709 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 997/2017] 10.222.0.65 () {58 vars in 967 bytes} [Tue May 10 03:20:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:10.345547 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e31f0-3a91-4e66-8fdd-1576237c1edf service neutron] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:10.350542 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-c18e31f0-3a91-4e66-8fdd-1576237c1edf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:10.441959 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e31f0-3a91-4e66-8fdd-1576237c1edf service neutron] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:10.450304 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccac86a-db3d-4663-be47-dddad3675de1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1cb8ad43a234233ad602f451f0f8ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:10.451180 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccac86a-db3d-4663-be47-dddad3675de1 service swift] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:10.456088 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccac86a-db3d-4663-be47-dddad3675de1 service swift] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:10.456088 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccac86a-db3d-4663-be47-dddad3675de1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:10.462618 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccac86a-db3d-4663-be47-dddad3675de1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:10.464289 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccac86a-db3d-4663-be47-dddad3675de1 service swift] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:10.474414 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1021/2018] 10.222.0.65 () {60 vars in 1384 bytes} [Tue May 10 03:20:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 03:20:10.711010 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ba3c4f-3dc0-48b5-ad90-f2b1f675e024 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:10.712154 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccac86a-db3d-4663-be47-dddad3675de1 service swift] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:10.712481 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-70ba3c4f-3dc0-48b5-ad90-f2b1f675e024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:10.713986 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-9ccac86a-db3d-4663-be47-dddad3675de1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:10.729038 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ba3c4f-3dc0-48b5-ad90-f2b1f675e024 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:10.734976 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5b11d-4f9a-488d-b009-f297d19380fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:10.735705 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5b11d-4f9a-488d-b009-f297d19380fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:10.735705 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5b11d-4f9a-488d-b009-f297d19380fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:10.735938 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5b11d-4f9a-488d-b009-f297d19380fd admin admin] PATH_INFO: `/v3/projects/e657807af1e04591867ba2415bd24e6f` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:10.737346 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd5b11d-4f9a-488d-b009-f297d19380fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e657807af1e04591867ba2415bd24e6f)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:10.739513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd5b11d-4f9a-488d-b009-f297d19380fd admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:10.747087 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccac86a-db3d-4663-be47-dddad3675de1 service swift] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:10.752551 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f122b96f-7e44-4121-8ac3-f1ea199bba64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:10.753572 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122b96f-7e44-4121-8ac3-f1ea199bba64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:10.753888 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122b96f-7e44-4121-8ac3-f1ea199bba64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:10.754118 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122b96f-7e44-4121-8ac3-f1ea199bba64 admin admin] PATH_INFO: `/v3/projects/58416df47383407d905c8573ed3e3dde` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:10.755303 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f122b96f-7e44-4121-8ac3-f1ea199bba64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58416df47383407d905c8573ed3e3dde)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:10.757757 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f122b96f-7e44-4121-8ac3-f1ea199bba64 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:10.915097 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-f122b96f-7e44-4121-8ac3-f1ea199bba64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58416df47383407d905c8573ed3e3dde', 'request_id': 'req-f122b96f-7e44-4121-8ac3-f1ea199bba64'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:10.915731 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-fdd5b11d-4f9a-488d-b009-f297d19380fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e657807af1e04591867ba2415bd24e6f', 'request_id': 'req-fdd5b11d-4f9a-488d-b009-f297d19380fd'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:10.921607 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-fdd5b11d-4f9a-488d-b009-f297d19380fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e657807af1e04591867ba2415bd24e6f', 'request_id': 'req-fdd5b11d-4f9a-488d-b009-f297d19380fd'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:10.924115 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-f122b96f-7e44-4121-8ac3-f1ea199bba64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58416df47383407d905c8573ed3e3dde', 'request_id': 'req-f122b96f-7e44-4121-8ac3-f1ea199bba64'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:10.928141 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-fdd5b11d-4f9a-488d-b009-f297d19380fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e657807af1e04591867ba2415bd24e6f', 'request_id': 'req-fdd5b11d-4f9a-488d-b009-f297d19380fd'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:10.931487 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-f122b96f-7e44-4121-8ac3-f1ea199bba64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58416df47383407d905c8573ed3e3dde', 'request_id': 'req-f122b96f-7e44-4121-8ac3-f1ea199bba64'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:11.019647 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-fdd5b11d-4f9a-488d-b009-f297d19380fd admin admin] The token cache is being invalidate because project e657807af1e04591867ba2415bd24e6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:20:11.019945 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-fdd5b11d-4f9a-488d-b009-f297d19380fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:11.022961 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-fdd5b11d-4f9a-488d-b009-f297d19380fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:11.024580 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 998/2019] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:20:10 2022] DELETE /identity/v3/projects/e657807af1e04591867ba2415bd24e6f => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:11.028351 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5b11d-4f9a-488d-b009-f297d19380fd admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:11.029660 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-fdd5b11d-4f9a-488d-b009-f297d19380fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:11.089648 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-f122b96f-7e44-4121-8ac3-f1ea199bba64 admin admin] The token cache is being invalidate because project 58416df47383407d905c8573ed3e3dde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:20:11.090200 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-f122b96f-7e44-4121-8ac3-f1ea199bba64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:11.091659 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-f122b96f-7e44-4121-8ac3-f1ea199bba64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:11.093842 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1022/2020] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:20:10 2022] DELETE /identity/v3/projects/58416df47383407d905c8573ed3e3dde => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:11.097699 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5b11d-4f9a-488d-b009-f297d19380fd admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:11.101322 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f122b96f-7e44-4121-8ac3-f1ea199bba64 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:11.102911 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-f122b96f-7e44-4121-8ac3-f1ea199bba64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:11.156134 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e62c9b-f198-4753-a9d3-a579062e7cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:11.157179 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e62c9b-f198-4753-a9d3-a579062e7cea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:11.157472 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e62c9b-f198-4753-a9d3-a579062e7cea admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:11.157750 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e62c9b-f198-4753-a9d3-a579062e7cea admin admin] PATH_INFO: `/v3/users/ffc513bad22b42bfb043b02c43a931ed` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:11.158959 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e62c9b-f198-4753-a9d3-a579062e7cea admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffc513bad22b42bfb043b02c43a931ed)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:11.160986 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e62c9b-f198-4753-a9d3-a579062e7cea admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:11.168190 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f122b96f-7e44-4121-8ac3-f1ea199bba64 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:11.174757 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa18d5e3-ddbd-4d08-a3f3-b5f6e1a79770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:11.175751 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18d5e3-ddbd-4d08-a3f3-b5f6e1a79770 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:11.176156 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18d5e3-ddbd-4d08-a3f3-b5f6e1a79770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:11.176506 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18d5e3-ddbd-4d08-a3f3-b5f6e1a79770 admin admin] PATH_INFO: `/v3/users/04b0b054c0da426e8320be1498ad0ef5` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:11.177861 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa18d5e3-ddbd-4d08-a3f3-b5f6e1a79770 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04b0b054c0da426e8320be1498ad0ef5)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:11.179959 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa18d5e3-ddbd-4d08-a3f3-b5f6e1a79770 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:11.318136 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-31e62c9b-f198-4753-a9d3-a579062e7cea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffc513bad22b42bfb043b02c43a931ed'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:11.318722 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-31e62c9b-f198-4753-a9d3-a579062e7cea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffc513bad22b42bfb043b02c43a931ed'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:11.325299 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-31e62c9b-f198-4753-a9d3-a579062e7cea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffc513bad22b42bfb043b02c43a931ed'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:11.375308 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-aa18d5e3-ddbd-4d08-a3f3-b5f6e1a79770 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04b0b054c0da426e8320be1498ad0ef5'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:11.381965 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-aa18d5e3-ddbd-4d08-a3f3-b5f6e1a79770 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04b0b054c0da426e8320be1498ad0ef5'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:11.390899 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-31e62c9b-f198-4753-a9d3-a579062e7cea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffc513bad22b42bfb043b02c43a931ed'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:11.391549 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-31e62c9b-f198-4753-a9d3-a579062e7cea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffc513bad22b42bfb043b02c43a931ed'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:11.393245 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-aa18d5e3-ddbd-4d08-a3f3-b5f6e1a79770 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04b0b054c0da426e8320be1498ad0ef5'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:11.393928 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-aa18d5e3-ddbd-4d08-a3f3-b5f6e1a79770 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04b0b054c0da426e8320be1498ad0ef5'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:11.394554 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-aa18d5e3-ddbd-4d08-a3f3-b5f6e1a79770 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04b0b054c0da426e8320be1498ad0ef5'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:11.409530 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 999/2021] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:20:11 2022] DELETE /identity/v3/users/ffc513bad22b42bfb043b02c43a931ed => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:20:11.410797 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b5438-e89d-4584-b6a6-5aed2f1250be None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:11.411089 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b5438-e89d-4584-b6a6-5aed2f1250be None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:11.411478 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b5438-e89d-4584-b6a6-5aed2f1250be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:11.429613 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-c40b5438-e89d-4584-b6a6-5aed2f1250be None None] MFA Rules not processed for user `6ebfab3ff0b24f4aaabb8c6bb0ad10c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:11.430977 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-c40b5438-e89d-4584-b6a6-5aed2f1250be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:11.483569 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1023/2022] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:20:11 2022] DELETE /identity/v3/users/04b0b054c0da426e8320be1498ad0ef5 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:11.491058 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1000/2023] 10.222.0.65 () {58 vars in 1009 bytes} [Tue May 10 03:20:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:11.511414 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa18d5e3-ddbd-4d08-a3f3-b5f6e1a79770 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:11.512875 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-aa18d5e3-ddbd-4d08-a3f3-b5f6e1a79770 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:11.586871 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa18d5e3-ddbd-4d08-a3f3-b5f6e1a79770 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:11.592316 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9970d00-50ff-4d48-adad-10044c345b97 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1cb8ad43a234233ad602f451f0f8ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:11.592988 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9970d00-50ff-4d48-adad-10044c345b97 service swift] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:11.593271 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9970d00-50ff-4d48-adad-10044c345b97 service swift] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:11.593552 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9970d00-50ff-4d48-adad-10044c345b97 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:11.651994 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9970d00-50ff-4d48-adad-10044c345b97 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:11.654126 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9970d00-50ff-4d48-adad-10044c345b97 service swift] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:11.662361 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1024/2024] 10.222.0.65 () {60 vars in 1384 bytes} [Tue May 10 03:20:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 03:20:11.899813 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b5438-e89d-4584-b6a6-5aed2f1250be None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:11.901381 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-c40b5438-e89d-4584-b6a6-5aed2f1250be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:11.923960 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9970d00-50ff-4d48-adad-10044c345b97 service swift] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:11.932484 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-f9970d00-50ff-4d48-adad-10044c345b97 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:11.995287 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b5438-e89d-4584-b6a6-5aed2f1250be None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:12.016353 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9970d00-50ff-4d48-adad-10044c345b97 service swift] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:12.024287 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a602e-6f1f-4b82-8b64-70f5fd52aab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:12.024287 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a602e-6f1f-4b82-8b64-70f5fd52aab3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:12.024287 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a602e-6f1f-4b82-8b64-70f5fd52aab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:12.024287 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a602e-6f1f-4b82-8b64-70f5fd52aab3 admin admin] PATH_INFO: `/v3/projects/46c85f8741744681a6260106a1cf4760` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:12.024651 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71a602e-6f1f-4b82-8b64-70f5fd52aab3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46c85f8741744681a6260106a1cf4760)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:12.025419 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71a602e-6f1f-4b82-8b64-70f5fd52aab3 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:12.062377 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da858c9-8ddb-424d-bf50-a06fbbe363b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:12.063666 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da858c9-8ddb-424d-bf50-a06fbbe363b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:12.064464 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da858c9-8ddb-424d-bf50-a06fbbe363b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:12.064815 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da858c9-8ddb-424d-bf50-a06fbbe363b5 admin admin] PATH_INFO: `/v3/projects/66d45ae2a09b423e9366a544374b6e0f` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:12.066248 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da858c9-8ddb-424d-bf50-a06fbbe363b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66d45ae2a09b423e9366a544374b6e0f)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:12.068642 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da858c9-8ddb-424d-bf50-a06fbbe363b5 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:12.175384 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-e71a602e-6f1f-4b82-8b64-70f5fd52aab3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46c85f8741744681a6260106a1cf4760', 'request_id': 'req-e71a602e-6f1f-4b82-8b64-70f5fd52aab3'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:12.182127 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-e71a602e-6f1f-4b82-8b64-70f5fd52aab3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46c85f8741744681a6260106a1cf4760', 'request_id': 'req-e71a602e-6f1f-4b82-8b64-70f5fd52aab3'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:12.189140 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-e71a602e-6f1f-4b82-8b64-70f5fd52aab3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46c85f8741744681a6260106a1cf4760', 'request_id': 'req-e71a602e-6f1f-4b82-8b64-70f5fd52aab3'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:12.201168 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-5da858c9-8ddb-424d-bf50-a06fbbe363b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66d45ae2a09b423e9366a544374b6e0f', 'request_id': 'req-5da858c9-8ddb-424d-bf50-a06fbbe363b5'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:12.208517 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-5da858c9-8ddb-424d-bf50-a06fbbe363b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66d45ae2a09b423e9366a544374b6e0f', 'request_id': 'req-5da858c9-8ddb-424d-bf50-a06fbbe363b5'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:12.217663 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-5da858c9-8ddb-424d-bf50-a06fbbe363b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66d45ae2a09b423e9366a544374b6e0f', 'request_id': 'req-5da858c9-8ddb-424d-bf50-a06fbbe363b5'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:12.277231 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-e71a602e-6f1f-4b82-8b64-70f5fd52aab3 admin admin] The token cache is being invalidate because project 46c85f8741744681a6260106a1cf4760 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:20:12.277724 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-e71a602e-6f1f-4b82-8b64-70f5fd52aab3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:12.280146 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-e71a602e-6f1f-4b82-8b64-70f5fd52aab3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:12.285027 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1025/2025] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:20:11 2022] DELETE /identity/v3/projects/46c85f8741744681a6260106a1cf4760 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:20:12.290669 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25edf870-2fa0-4119-9aa3-01edca90a0b7 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:12.290961 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25edf870-2fa0-4119-9aa3-01edca90a0b7 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:12.291246 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25edf870-2fa0-4119-9aa3-01edca90a0b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:12.310810 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-25edf870-2fa0-4119-9aa3-01edca90a0b7 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:12.312026 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-25edf870-2fa0-4119-9aa3-01edca90a0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:12.358133 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-5da858c9-8ddb-424d-bf50-a06fbbe363b5 admin admin] The token cache is being invalidate because project 66d45ae2a09b423e9366a544374b6e0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:20:12.358133 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-5da858c9-8ddb-424d-bf50-a06fbbe363b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:12.358133 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-5da858c9-8ddb-424d-bf50-a06fbbe363b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:12.358133 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1001/2026] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:20:11 2022] DELETE /identity/v3/projects/66d45ae2a09b423e9366a544374b6e0f => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:12.358133 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c298d2-cce9-452f-8149-41bf5ea5b5b3 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:12.358648 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c298d2-cce9-452f-8149-41bf5ea5b5b3 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:12.358648 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c298d2-cce9-452f-8149-41bf5ea5b5b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:12.375443 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1026/2027] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:20:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:20:12.376950 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-42c298d2-cce9-452f-8149-41bf5ea5b5b3 None None] MFA Rules not processed for user `6ebfab3ff0b24f4aaabb8c6bb0ad10c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:12.378179 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-42c298d2-cce9-452f-8149-41bf5ea5b5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:12.381988 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69b228-a7c3-4513-81be-57780b443c0e None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:12.382182 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69b228-a7c3-4513-81be-57780b443c0e None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:12.382490 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69b228-a7c3-4513-81be-57780b443c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:12.400641 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-aa69b228-a7c3-4513-81be-57780b443c0e None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:12.401827 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-aa69b228-a7c3-4513-81be-57780b443c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:12.410356 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1027/2028] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:20:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:12.411859 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b571430-f8e1-49ca-b979-f976455f70e2 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:12.412180 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b571430-f8e1-49ca-b979-f976455f70e2 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:12.412460 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b571430-f8e1-49ca-b979-f976455f70e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:12.430995 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-6b571430-f8e1-49ca-b979-f976455f70e2 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:12.432306 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-6b571430-f8e1-49ca-b979-f976455f70e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:12.436507 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1002/2029] 10.222.0.65 () {58 vars in 967 bytes} [Tue May 10 03:20:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:12.437926 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c857a-bf31-4dd5-be7a-dce8792b13d0 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:12.438235 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c857a-bf31-4dd5-be7a-dce8792b13d0 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:12.438600 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c857a-bf31-4dd5-be7a-dce8792b13d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:12.440913 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1028/2030] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:20:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:12.444918 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b571430-f8e1-49ca-b979-f976455f70e2 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:12.455370 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b571430-f8e1-49ca-b979-f976455f70e2 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:12.459491 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9025972-8d65-497d-98d5-6fb8bb34a3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:12.460317 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9025972-8d65-497d-98d5-6fb8bb34a3ec admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:12.460811 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9025972-8d65-497d-98d5-6fb8bb34a3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:12.461165 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9025972-8d65-497d-98d5-6fb8bb34a3ec admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:12.461969 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9025972-8d65-497d-98d5-6fb8bb34a3ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:20:12.462347 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9025972-8d65-497d-98d5-6fb8bb34a3ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:12.464088 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9025972-8d65-497d-98d5-6fb8bb34a3ec admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:12.465067 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-2c3c857a-bf31-4dd5-be7a-dce8792b13d0 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:12.466275 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-2c3c857a-bf31-4dd5-be7a-dce8792b13d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:12.474930 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1003/2031] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:20:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:12.477000 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3c857a-bf31-4dd5-be7a-dce8792b13d0 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:12.477120 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1029/2032] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 10 03:20:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:20:12.479582 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9025972-8d65-497d-98d5-6fb8bb34a3ec admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:12.481273 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-2c3c857a-bf31-4dd5-be7a-dce8792b13d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:12.489590 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9025972-8d65-497d-98d5-6fb8bb34a3ec admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:12.495161 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ee255f-8be8-4ff7-96e3-11f4ba98068f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:12.495833 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee255f-8be8-4ff7-96e3-11f4ba98068f admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:12.496156 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee255f-8be8-4ff7-96e3-11f4ba98068f admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:12.496447 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee255f-8be8-4ff7-96e3-11f4ba98068f admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:12.497177 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ee255f-8be8-4ff7-96e3-11f4ba98068f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:20:12.497484 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ee255f-8be8-4ff7-96e3-11f4ba98068f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:12.499068 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ee255f-8be8-4ff7-96e3-11f4ba98068f admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:12.514728 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1030/2033] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 10 03:20:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:20:12.514728 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ee255f-8be8-4ff7-96e3-11f4ba98068f admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:12.522847 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ee255f-8be8-4ff7-96e3-11f4ba98068f admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:12.527459 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fc4230-3aa1-49e7-ba16-d1f3322e9cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:12.528121 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc4230-3aa1-49e7-ba16-d1f3322e9cbb admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:12.528407 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc4230-3aa1-49e7-ba16-d1f3322e9cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:12.528685 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc4230-3aa1-49e7-ba16-d1f3322e9cbb admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:12.529368 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fc4230-3aa1-49e7-ba16-d1f3322e9cbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:12.531362 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fc4230-3aa1-49e7-ba16-d1f3322e9cbb admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:12.551419 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3c857a-bf31-4dd5-be7a-dce8792b13d0 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:12.557152 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59ecb64-f703-46f4-ac02-e65007654f44 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1cb8ad43a234233ad602f451f0f8ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:12.557807 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ecb64-f703-46f4-ac02-e65007654f44 service swift] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:12.558089 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ecb64-f703-46f4-ac02-e65007654f44 service swift] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:12.558364 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ecb64-f703-46f4-ac02-e65007654f44 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:12.566307 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59ecb64-f703-46f4-ac02-e65007654f44 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:12.567975 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59ecb64-f703-46f4-ac02-e65007654f44 service swift] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:12.576596 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1004/2034] 10.222.0.65 () {60 vars in 1384 bytes} [Tue May 10 03:20:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 03:20:12.577276 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59ecb64-f703-46f4-ac02-e65007654f44 service swift] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:12.587611 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59ecb64-f703-46f4-ac02-e65007654f44 service swift] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:12.592724 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611295b5-e782-46f5-a651-35ea7b4e26e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:12.593443 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611295b5-e782-46f5-a651-35ea7b4e26e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:12.593674 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611295b5-e782-46f5-a651-35ea7b4e26e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:12.593949 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611295b5-e782-46f5-a651-35ea7b4e26e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:12.594639 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611295b5-e782-46f5-a651-35ea7b4e26e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:12.596705 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611295b5-e782-46f5-a651-35ea7b4e26e4 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:12.638710 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1031/2035] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:20:12 2022] POST /identity/v3/projects => generated 383 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:20:12.643196 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fc4230-3aa1-49e7-ba16-d1f3322e9cbb admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:12.703626 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fc4230-3aa1-49e7-ba16-d1f3322e9cbb admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:12.708342 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b00f9b0-3bd0-4100-ac50-699e1b3ec92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:12.709047 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b00f9b0-3bd0-4100-ac50-699e1b3ec92d admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:12.709331 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b00f9b0-3bd0-4100-ac50-699e1b3ec92d admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:12.709661 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b00f9b0-3bd0-4100-ac50-699e1b3ec92d admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:12.710848 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b00f9b0-3bd0-4100-ac50-699e1b3ec92d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:12.712814 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b00f9b0-3bd0-4100-ac50-699e1b3ec92d admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:12.758151 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1005/2036] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:20:12 2022] POST /identity/v3/projects => generated 373 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:20:12.762511 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611295b5-e782-46f5-a651-35ea7b4e26e4 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:12.822214 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611295b5-e782-46f5-a651-35ea7b4e26e4 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:12.827087 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b5e66-856a-4bec-82c6-760f93208f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:12.827908 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b5e66-856a-4bec-82c6-760f93208f88 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:12.828222 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b5e66-856a-4bec-82c6-760f93208f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:12.828500 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b5e66-856a-4bec-82c6-760f93208f88 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:12.829204 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6b5e66-856a-4bec-82c6-760f93208f88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:12.831110 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6b5e66-856a-4bec-82c6-760f93208f88 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:12.841225 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1032/2037] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:20:12 2022] POST /identity/v3/users => generated 292 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:20:12.845165 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b00f9b0-3bd0-4100-ac50-699e1b3ec92d admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:12.855704 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b00f9b0-3bd0-4100-ac50-699e1b3ec92d admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:12.860561 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b31bf5-3002-4982-9fb6-631c7a7857d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:12.861211 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b31bf5-3002-4982-9fb6-631c7a7857d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:12.861538 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b31bf5-3002-4982-9fb6-631c7a7857d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:12.861815 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b31bf5-3002-4982-9fb6-631c7a7857d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:12.862618 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b31bf5-3002-4982-9fb6-631c7a7857d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:12.864293 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b31bf5-3002-4982-9fb6-631c7a7857d0 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:12.874606 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1033/2038] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:20:12.878201 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b31bf5-3002-4982-9fb6-631c7a7857d0 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:12.888230 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b31bf5-3002-4982-9fb6-631c7a7857d0 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:12.892922 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0062da8c-c0bb-4055-88a3-769a6eedd2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:12.893498 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062da8c-c0bb-4055-88a3-769a6eedd2f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:12.893768 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062da8c-c0bb-4055-88a3-769a6eedd2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:12.894034 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062da8c-c0bb-4055-88a3-769a6eedd2f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:12.894738 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0062da8c-c0bb-4055-88a3-769a6eedd2f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:12.896330 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0062da8c-c0bb-4055-88a3-769a6eedd2f0 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:12.906661 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1034/2039] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:20:12.910710 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0062da8c-c0bb-4055-88a3-769a6eedd2f0 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:12.915385 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1006/2040] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:20:12 2022] POST /identity/v3/users => generated 287 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:20:12.916372 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b5e66-856a-4bec-82c6-760f93208f88 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:12.922067 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0062da8c-c0bb-4055-88a3-769a6eedd2f0 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:12.926471 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b5e66-856a-4bec-82c6-760f93208f88 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:12.926815 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b510f-f641-4fc7-a18d-9a2b90dde15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:12.927700 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b510f-f641-4fc7-a18d-9a2b90dde15a admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:12.927982 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b510f-f641-4fc7-a18d-9a2b90dde15a admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:12.928290 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b510f-f641-4fc7-a18d-9a2b90dde15a admin admin] PATH_INFO: `/v3/projects/cb57d611df674f368bc3959381f7104f/users/10297cb71d73421c9785b80bbdf5b668/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:12.931364 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d3e34b-fa0a-472e-9527-fa33ad2f7fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:12.932062 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3e34b-fa0a-472e-9527-fa33ad2f7fab admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:12.932406 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3e34b-fa0a-472e-9527-fa33ad2f7fab admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:12.932689 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3e34b-fa0a-472e-9527-fa33ad2f7fab admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:12.933442 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d3e34b-fa0a-472e-9527-fa33ad2f7fab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:12.935042 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d3e34b-fa0a-472e-9527-fa33ad2f7fab admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:12.942879 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85b510f-f641-4fc7-a18d-9a2b90dde15a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb57d611df674f368bc3959381f7104f, user_id=10297cb71d73421c9785b80bbdf5b668, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:12.945934 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1007/2041] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:20:12.946450 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85b510f-f641-4fc7-a18d-9a2b90dde15a admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:12.950203 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d3e34b-fa0a-472e-9527-fa33ad2f7fab admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:12.960553 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d3e34b-fa0a-472e-9527-fa33ad2f7fab admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:12.965337 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c5501-ae71-402d-93f0-96fd27fd81f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:12.965985 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c5501-ae71-402d-93f0-96fd27fd81f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:12.966272 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c5501-ae71-402d-93f0-96fd27fd81f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:12.966553 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c5501-ae71-402d-93f0-96fd27fd81f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:12.967303 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4c5501-ae71-402d-93f0-96fd27fd81f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:12.968955 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4c5501-ae71-402d-93f0-96fd27fd81f0 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:12.979378 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1008/2042] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:20:12.984320 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c5501-ae71-402d-93f0-96fd27fd81f0 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:12.997309 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c5501-ae71-402d-93f0-96fd27fd81f0 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:12.999585 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79a5acf-e072-4c58-b6aa-a02ac66eba65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:13.000544 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a5acf-e072-4c58-b6aa-a02ac66eba65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:13.000831 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a5acf-e072-4c58-b6aa-a02ac66eba65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:13.001112 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a5acf-e072-4c58-b6aa-a02ac66eba65 admin admin] PATH_INFO: `/v3/projects/f1e4972138fb46aab245d4dc96f0cfa5/users/e3109b48624a4623ac30860aaca66c3c/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:13.020529 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79a5acf-e072-4c58-b6aa-a02ac66eba65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1e4972138fb46aab245d4dc96f0cfa5, user_id=e3109b48624a4623ac30860aaca66c3c, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:13.023772 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79a5acf-e072-4c58-b6aa-a02ac66eba65 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:13.054678 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1035/2043] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:20:12 2022] PUT /identity/v3/projects/cb57d611df674f368bc3959381f7104f/users/10297cb71d73421c9785b80bbdf5b668/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:20:13.065467 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf7211-8b26-49ca-a73f-faa4e46915ca None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:13.065966 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf7211-8b26-49ca-a73f-faa4e46915ca None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:13.066256 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf7211-8b26-49ca-a73f-faa4e46915ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:13.099830 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-bbaf7211-8b26-49ca-a73f-faa4e46915ca None None] MFA Rules not processed for user `10297cb71d73421c9785b80bbdf5b668`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:13.099830 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-bbaf7211-8b26-49ca-a73f-faa4e46915ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:13.127129 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1009/2044] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:20:12 2022] PUT /identity/v3/projects/f1e4972138fb46aab245d4dc96f0cfa5/users/e3109b48624a4623ac30860aaca66c3c/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:13.138009 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc35c07-4ade-4fb0-a2bc-32818e2bece1 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:13.138300 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc35c07-4ade-4fb0-a2bc-32818e2bece1 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:13.138575 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc35c07-4ade-4fb0-a2bc-32818e2bece1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:13.165895 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1036/2045] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:20:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:20:13.170278 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf7211-8b26-49ca-a73f-faa4e46915ca None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:13.171837 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-2fc35c07-4ade-4fb0-a2bc-32818e2bece1 None None] MFA Rules not processed for user `e3109b48624a4623ac30860aaca66c3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:13.173186 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-2fc35c07-4ade-4fb0-a2bc-32818e2bece1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:13.246550 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1010/2046] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:20:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:13.261217 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc35c07-4ade-4fb0-a2bc-32818e2bece1 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:13.261217 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-2fc35c07-4ade-4fb0-a2bc-32818e2bece1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:13.262804 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf7211-8b26-49ca-a73f-faa4e46915ca None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:13.347519 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe760f4-8043-43e4-93d1-4646ce3fde4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:13.348214 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe760f4-8043-43e4-93d1-4646ce3fde4e admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:13.348498 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe760f4-8043-43e4-93d1-4646ce3fde4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:13.348994 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe760f4-8043-43e4-93d1-4646ce3fde4e admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:13.349691 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe760f4-8043-43e4-93d1-4646ce3fde4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:13.351714 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc35c07-4ade-4fb0-a2bc-32818e2bece1 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:13.351841 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe760f4-8043-43e4-93d1-4646ce3fde4e admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:13.359124 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d5a4a7-083b-493f-9d34-44afe7990025 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:13.359124 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5a4a7-083b-493f-9d34-44afe7990025 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:13.359124 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5a4a7-083b-493f-9d34-44afe7990025 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:13.359124 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5a4a7-083b-493f-9d34-44afe7990025 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:13.373813 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d5a4a7-083b-493f-9d34-44afe7990025 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:13.375575 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d5a4a7-083b-493f-9d34-44afe7990025 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:13.388043 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1011/2047] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:20:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:20:13.472039 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1037/2048] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:20:13 2022] POST /identity/v3/projects => generated 379 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:20:13.474277 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d5a4a7-083b-493f-9d34-44afe7990025 service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:13.485588 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d5a4a7-083b-493f-9d34-44afe7990025 service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:13.568332 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b8a95e-929e-425b-bddb-636b80b33acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:13.570203 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8a95e-929e-425b-bddb-636b80b33acd admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:13.570857 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8a95e-929e-425b-bddb-636b80b33acd admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:13.571736 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8a95e-929e-425b-bddb-636b80b33acd admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:13.572749 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b8a95e-929e-425b-bddb-636b80b33acd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:13.576453 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b8a95e-929e-425b-bddb-636b80b33acd admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:13.658396 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1012/2049] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:20:13 2022] POST /identity/v3/users => generated 296 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:20:13.671308 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe760f4-8043-43e4-93d1-4646ce3fde4e admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:13.682150 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe760f4-8043-43e4-93d1-4646ce3fde4e admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:13.687244 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9c5f34-00bd-4ea8-a0e0-41d3d5f3cd8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:13.688062 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c5f34-00bd-4ea8-a0e0-41d3d5f3cd8a admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:13.688409 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c5f34-00bd-4ea8-a0e0-41d3d5f3cd8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:13.688760 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c5f34-00bd-4ea8-a0e0-41d3d5f3cd8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:13.689683 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9c5f34-00bd-4ea8-a0e0-41d3d5f3cd8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:13.691357 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9c5f34-00bd-4ea8-a0e0-41d3d5f3cd8a admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:13.706511 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1038/2050] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:20:13.711606 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b8a95e-929e-425b-bddb-636b80b33acd admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:13.721870 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b8a95e-929e-425b-bddb-636b80b33acd admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:13.727152 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63662767-ee0b-4cd2-a532-c5d0c9ee0eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:13.728066 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63662767-ee0b-4cd2-a532-c5d0c9ee0eef admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:13.728351 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63662767-ee0b-4cd2-a532-c5d0c9ee0eef admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:13.728625 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63662767-ee0b-4cd2-a532-c5d0c9ee0eef admin admin] PATH_INFO: `/v3/projects/14cdd9cc2cb64c3d88e9fdf2a3d2a8c3/users/5fd84988a1a149a08e812548ce60e266/roles/43105000610f402ca2486e7648018cca` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:13.745798 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63662767-ee0b-4cd2-a532-c5d0c9ee0eef admin admin] RBAC: Authorizing `identity:create_grant(project_id=14cdd9cc2cb64c3d88e9fdf2a3d2a8c3, user_id=5fd84988a1a149a08e812548ce60e266, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:13.748582 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63662767-ee0b-4cd2-a532-c5d0c9ee0eef admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:13.837722 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1013/2051] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:20:13 2022] PUT /identity/v3/projects/14cdd9cc2cb64c3d88e9fdf2a3d2a8c3/users/5fd84988a1a149a08e812548ce60e266/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:13.844025 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9c5f34-00bd-4ea8-a0e0-41d3d5f3cd8a admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:13.854286 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9c5f34-00bd-4ea8-a0e0-41d3d5f3cd8a admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:13.912723 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79344c5b-a83c-49d8-994f-601baa016aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:13.913342 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79344c5b-a83c-49d8-994f-601baa016aed admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:13.913627 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79344c5b-a83c-49d8-994f-601baa016aed admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:13.913903 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79344c5b-a83c-49d8-994f-601baa016aed admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:13.914908 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79344c5b-a83c-49d8-994f-601baa016aed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:13.916535 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79344c5b-a83c-49d8-994f-601baa016aed admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:13.931586 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1039/2052] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:20:13.933593 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63662767-ee0b-4cd2-a532-c5d0c9ee0eef admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:13.945171 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63662767-ee0b-4cd2-a532-c5d0c9ee0eef admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:13.950081 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9bc7ad-db1a-4b36-bcc9-d9a0b2de3ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:13.951300 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9bc7ad-db1a-4b36-bcc9-d9a0b2de3ad6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:13.951653 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9bc7ad-db1a-4b36-bcc9-d9a0b2de3ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:13.951992 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9bc7ad-db1a-4b36-bcc9-d9a0b2de3ad6 admin admin] PATH_INFO: `/v3/projects/14cdd9cc2cb64c3d88e9fdf2a3d2a8c3/users/5fd84988a1a149a08e812548ce60e266/roles/43105000610f402ca2486e7648018cca` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:13.955245 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9bc7ad-db1a-4b36-bcc9-d9a0b2de3ad6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14cdd9cc2cb64c3d88e9fdf2a3d2a8c3, user_id=5fd84988a1a149a08e812548ce60e266, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:13.958263 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9bc7ad-db1a-4b36-bcc9-d9a0b2de3ad6 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:13.969835 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1014/2053] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:20:13 2022] PUT /identity/v3/projects/14cdd9cc2cb64c3d88e9fdf2a3d2a8c3/users/5fd84988a1a149a08e812548ce60e266/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:20:13.981536 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462dbda8-1851-4591-80ca-44d5e3ad9a3a None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:13.981830 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462dbda8-1851-4591-80ca-44d5e3ad9a3a None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:13.982141 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462dbda8-1851-4591-80ca-44d5e3ad9a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:14.019379 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-462dbda8-1851-4591-80ca-44d5e3ad9a3a None None] MFA Rules not processed for user `5fd84988a1a149a08e812548ce60e266`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:14.020839 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-462dbda8-1851-4591-80ca-44d5e3ad9a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:14.093671 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1040/2054] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:20:13 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:20:14.177325 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9bc7ad-db1a-4b36-bcc9-d9a0b2de3ad6 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:14.179923 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-fe9bc7ad-db1a-4b36-bcc9-d9a0b2de3ad6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:14.253854 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9bc7ad-db1a-4b36-bcc9-d9a0b2de3ad6 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:14.258052 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec60847-a4ab-4eb5-9376-958e4c96faf2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:14.258746 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec60847-a4ab-4eb5-9376-958e4c96faf2 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:14.259030 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec60847-a4ab-4eb5-9376-958e4c96faf2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:14.259305 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec60847-a4ab-4eb5-9376-958e4c96faf2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:14.268697 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec60847-a4ab-4eb5-9376-958e4c96faf2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:14.270174 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec60847-a4ab-4eb5-9376-958e4c96faf2 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:14.280424 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1015/2055] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:20:14 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:20:14.463301 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462dbda8-1851-4591-80ca-44d5e3ad9a3a None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:14.474295 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462dbda8-1851-4591-80ca-44d5e3ad9a3a None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:14.478963 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ec1198-0dbe-415b-8c7c-0d6fa54c8342 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:14.479811 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec1198-0dbe-415b-8c7c-0d6fa54c8342 service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:14.483673 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec1198-0dbe-415b-8c7c-0d6fa54c8342 service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:14.483673 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec1198-0dbe-415b-8c7c-0d6fa54c8342 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:14.547619 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ec1198-0dbe-415b-8c7c-0d6fa54c8342 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:14.549537 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ec1198-0dbe-415b-8c7c-0d6fa54c8342 service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:14.560099 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1041/2056] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:20:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:20:15.050111 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec60847-a4ab-4eb5-9376-958e4c96faf2 service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:15.110584 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec60847-a4ab-4eb5-9376-958e4c96faf2 service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:15.115126 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e53ebbd-17e9-449c-a99b-8c6bd848e380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:15.115987 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53ebbd-17e9-449c-a99b-8c6bd848e380 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:15.116802 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53ebbd-17e9-449c-a99b-8c6bd848e380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:15.117079 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53ebbd-17e9-449c-a99b-8c6bd848e380 admin admin] PATH_INFO: `/v3/users/10297cb71d73421c9785b80bbdf5b668` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:15.118252 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e53ebbd-17e9-449c-a99b-8c6bd848e380 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10297cb71d73421c9785b80bbdf5b668)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:15.120185 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e53ebbd-17e9-449c-a99b-8c6bd848e380 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:15.375521 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-9e53ebbd-17e9-449c-a99b-8c6bd848e380 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10297cb71d73421c9785b80bbdf5b668'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:15.376333 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-9e53ebbd-17e9-449c-a99b-8c6bd848e380 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10297cb71d73421c9785b80bbdf5b668'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:15.384137 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-9e53ebbd-17e9-449c-a99b-8c6bd848e380 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10297cb71d73421c9785b80bbdf5b668'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:15.525479 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-9e53ebbd-17e9-449c-a99b-8c6bd848e380 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10297cb71d73421c9785b80bbdf5b668'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:15.526109 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-9e53ebbd-17e9-449c-a99b-8c6bd848e380 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10297cb71d73421c9785b80bbdf5b668'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:15.544459 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1016/2057] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:20:15 2022] DELETE /identity/v3/users/10297cb71d73421c9785b80bbdf5b668 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:15.548824 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54bffd-0643-45e4-baf7-fa75a2de83b7 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:15.549360 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54bffd-0643-45e4-baf7-fa75a2de83b7 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:15.549642 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54bffd-0643-45e4-baf7-fa75a2de83b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:15.571462 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-fa54bffd-0643-45e4-baf7-fa75a2de83b7 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:15.572710 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-fa54bffd-0643-45e4-baf7-fa75a2de83b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:15.632509 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1042/2058] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:20:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:15.642928 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e53ebbd-17e9-449c-a99b-8c6bd848e380 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:15.644405 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-9e53ebbd-17e9-449c-a99b-8c6bd848e380 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:15.703040 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e53ebbd-17e9-449c-a99b-8c6bd848e380 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:15.713090 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9175b6-4891-43a5-b8d8-93897745f8f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:15.714656 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9175b6-4891-43a5-b8d8-93897745f8f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:15.714656 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9175b6-4891-43a5-b8d8-93897745f8f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:15.715407 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9175b6-4891-43a5-b8d8-93897745f8f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:15.727257 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9175b6-4891-43a5-b8d8-93897745f8f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:15.728814 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9175b6-4891-43a5-b8d8-93897745f8f4 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:15.748139 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1017/2059] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:20:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:20:15.871838 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa54bffd-0643-45e4-baf7-fa75a2de83b7 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:15.873288 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-fa54bffd-0643-45e4-baf7-fa75a2de83b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:15.884936 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa54bffd-0643-45e4-baf7-fa75a2de83b7 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:15.889610 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab61ee8a-a945-44c6-aab4-606d7c41cb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:15.890451 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61ee8a-a945-44c6-aab4-606d7c41cb61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:15.890727 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61ee8a-a945-44c6-aab4-606d7c41cb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:15.890993 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61ee8a-a945-44c6-aab4-606d7c41cb61 admin admin] PATH_INFO: `/v3/users/7b91d4485efb4a689a892233333959ba` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:15.892195 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab61ee8a-a945-44c6-aab4-606d7c41cb61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b91d4485efb4a689a892233333959ba)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:15.894159 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab61ee8a-a945-44c6-aab4-606d7c41cb61 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:16.156098 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-ab61ee8a-a945-44c6-aab4-606d7c41cb61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b91d4485efb4a689a892233333959ba'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:16.160891 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-ab61ee8a-a945-44c6-aab4-606d7c41cb61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b91d4485efb4a689a892233333959ba'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:16.175068 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-ab61ee8a-a945-44c6-aab4-606d7c41cb61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b91d4485efb4a689a892233333959ba'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:16.175854 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-ab61ee8a-a945-44c6-aab4-606d7c41cb61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b91d4485efb4a689a892233333959ba'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:16.176501 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-ab61ee8a-a945-44c6-aab4-606d7c41cb61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b91d4485efb4a689a892233333959ba'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:16.246040 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1043/2060] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:20:15 2022] DELETE /identity/v3/users/7b91d4485efb4a689a892233333959ba => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:16.250741 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7f08b-85fa-4794-99e4-cce0a88e3179 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:16.251219 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7f08b-85fa-4794-99e4-cce0a88e3179 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:16.251308 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7f08b-85fa-4794-99e4-cce0a88e3179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:16.268987 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-99f7f08b-85fa-4794-99e4-cce0a88e3179 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:16.270436 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-99f7f08b-85fa-4794-99e4-cce0a88e3179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:16.330847 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1018/2061] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:20:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:20:16.340881 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab61ee8a-a945-44c6-aab4-606d7c41cb61 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:16.342369 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-ab61ee8a-a945-44c6-aab4-606d7c41cb61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:16.350101 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f7f08b-85fa-4794-99e4-cce0a88e3179 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:16.351839 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-99f7f08b-85fa-4794-99e4-cce0a88e3179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:16.364218 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f7f08b-85fa-4794-99e4-cce0a88e3179 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:16.370078 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a816128-531b-480a-ba9b-1b9d0656cf69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:16.371235 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a816128-531b-480a-ba9b-1b9d0656cf69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:16.371521 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a816128-531b-480a-ba9b-1b9d0656cf69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:16.371976 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a816128-531b-480a-ba9b-1b9d0656cf69 admin admin] PATH_INFO: `/v3/projects/cb57d611df674f368bc3959381f7104f` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:16.373412 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a816128-531b-480a-ba9b-1b9d0656cf69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb57d611df674f368bc3959381f7104f)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:16.375700 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a816128-531b-480a-ba9b-1b9d0656cf69 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:16.413111 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab61ee8a-a945-44c6-aab4-606d7c41cb61 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:16.416979 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d1da4-1ace-4185-b612-52a4aa9a3351 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:16.417628 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d1da4-1ace-4185-b612-52a4aa9a3351 service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:16.417912 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d1da4-1ace-4185-b612-52a4aa9a3351 service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:16.418187 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d1da4-1ace-4185-b612-52a4aa9a3351 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:16.427153 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1d1da4-1ace-4185-b612-52a4aa9a3351 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:16.429150 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1d1da4-1ace-4185-b612-52a4aa9a3351 service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:16.438472 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1044/2062] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:20:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:20:16.477794 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3a816128-531b-480a-ba9b-1b9d0656cf69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb57d611df674f368bc3959381f7104f', 'request_id': 'req-3a816128-531b-480a-ba9b-1b9d0656cf69'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:16.484286 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3a816128-531b-480a-ba9b-1b9d0656cf69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb57d611df674f368bc3959381f7104f', 'request_id': 'req-3a816128-531b-480a-ba9b-1b9d0656cf69'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:16.490675 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3a816128-531b-480a-ba9b-1b9d0656cf69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb57d611df674f368bc3959381f7104f', 'request_id': 'req-3a816128-531b-480a-ba9b-1b9d0656cf69'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:16.606491 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3a816128-531b-480a-ba9b-1b9d0656cf69 admin admin] The token cache is being invalidate because project cb57d611df674f368bc3959381f7104f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:20:16.606491 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3a816128-531b-480a-ba9b-1b9d0656cf69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:16.606491 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3a816128-531b-480a-ba9b-1b9d0656cf69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:16.606491 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1019/2063] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:20:16 2022] DELETE /identity/v3/projects/cb57d611df674f368bc3959381f7104f => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:20:16.608692 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d1da4-1ace-4185-b612-52a4aa9a3351 service neutron] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:16.618817 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d1da4-1ace-4185-b612-52a4aa9a3351 service neutron] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:16.680187 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252905d6-3c06-4fd1-ad42-a0becda2cd8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:16.681107 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252905d6-3c06-4fd1-ad42-a0becda2cd8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:16.681337 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252905d6-3c06-4fd1-ad42-a0becda2cd8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:16.681614 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252905d6-3c06-4fd1-ad42-a0becda2cd8d admin admin] PATH_INFO: `/v3/users/5fd84988a1a149a08e812548ce60e266` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:16.682820 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252905d6-3c06-4fd1-ad42-a0becda2cd8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fd84988a1a149a08e812548ce60e266)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:16.684797 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252905d6-3c06-4fd1-ad42-a0becda2cd8d admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:16.689962 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a816128-531b-480a-ba9b-1b9d0656cf69 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:16.691469 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-3a816128-531b-480a-ba9b-1b9d0656cf69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:16.711029 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a816128-531b-480a-ba9b-1b9d0656cf69 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:16.716057 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71300c61-8220-410c-9596-6c5bfb3c740a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:16.716934 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71300c61-8220-410c-9596-6c5bfb3c740a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:16.721308 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71300c61-8220-410c-9596-6c5bfb3c740a admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:16.721308 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71300c61-8220-410c-9596-6c5bfb3c740a admin admin] PATH_INFO: `/v3/projects/895dbe17859e43a18bb013a98f83a45e` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:16.721308 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71300c61-8220-410c-9596-6c5bfb3c740a admin admin] RBAC: Authorizing `identity:delete_project(project_id=895dbe17859e43a18bb013a98f83a45e)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:16.721308 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71300c61-8220-410c-9596-6c5bfb3c740a admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:16.929501 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-252905d6-3c06-4fd1-ad42-a0becda2cd8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fd84988a1a149a08e812548ce60e266'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:16.930590 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-71300c61-8220-410c-9596-6c5bfb3c740a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '895dbe17859e43a18bb013a98f83a45e', 'request_id': 'req-71300c61-8220-410c-9596-6c5bfb3c740a'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:16.937637 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-71300c61-8220-410c-9596-6c5bfb3c740a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '895dbe17859e43a18bb013a98f83a45e', 'request_id': 'req-71300c61-8220-410c-9596-6c5bfb3c740a'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:16.937768 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-252905d6-3c06-4fd1-ad42-a0becda2cd8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fd84988a1a149a08e812548ce60e266'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:16.944545 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-71300c61-8220-410c-9596-6c5bfb3c740a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '895dbe17859e43a18bb013a98f83a45e', 'request_id': 'req-71300c61-8220-410c-9596-6c5bfb3c740a'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:16.951668 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-252905d6-3c06-4fd1-ad42-a0becda2cd8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fd84988a1a149a08e812548ce60e266'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:16.952559 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-252905d6-3c06-4fd1-ad42-a0becda2cd8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fd84988a1a149a08e812548ce60e266'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:16.953228 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-252905d6-3c06-4fd1-ad42-a0becda2cd8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fd84988a1a149a08e812548ce60e266'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:17.042813 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-71300c61-8220-410c-9596-6c5bfb3c740a admin admin] The token cache is being invalidate because project 895dbe17859e43a18bb013a98f83a45e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:20:17.043103 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-71300c61-8220-410c-9596-6c5bfb3c740a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:17.043749 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-71300c61-8220-410c-9596-6c5bfb3c740a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:17.045356 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1020/2064] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:20:16 2022] DELETE /identity/v3/projects/895dbe17859e43a18bb013a98f83a45e => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:20:17.050920 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8dcea-1d23-4df9-bdb2-1b00b19e75ed None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:17.051213 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8dcea-1d23-4df9-bdb2-1b00b19e75ed None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:17.051497 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8dcea-1d23-4df9-bdb2-1b00b19e75ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:17.070105 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-3af8dcea-1d23-4df9-bdb2-1b00b19e75ed None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:17.071327 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-3af8dcea-1d23-4df9-bdb2-1b00b19e75ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:17.128740 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1045/2065] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:20:16 2022] DELETE /identity/v3/users/5fd84988a1a149a08e812548ce60e266 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:20:17.136905 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1021/2066] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:20:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:20:17.142511 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6bdfff-5d0a-4ad0-b160-96889603e18b None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:17.142888 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6bdfff-5d0a-4ad0-b160-96889603e18b None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:17.143303 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6bdfff-5d0a-4ad0-b160-96889603e18b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:17.170874 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-9c6bdfff-5d0a-4ad0-b160-96889603e18b None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:17.173075 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-9c6bdfff-5d0a-4ad0-b160-96889603e18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:17.260601 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1046/2067] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:20:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:17.264929 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af8dcea-1d23-4df9-bdb2-1b00b19e75ed None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:17.274977 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af8dcea-1d23-4df9-bdb2-1b00b19e75ed None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:17.281517 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76541b5-5624-4dc1-b0a6-3c3a432f4340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:17.282182 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76541b5-5624-4dc1-b0a6-3c3a432f4340 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:17.282467 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76541b5-5624-4dc1-b0a6-3c3a432f4340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:17.282745 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76541b5-5624-4dc1-b0a6-3c3a432f4340 admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:17.283473 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76541b5-5624-4dc1-b0a6-3c3a432f4340 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:20:17.283781 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76541b5-5624-4dc1-b0a6-3c3a432f4340 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:17.285448 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76541b5-5624-4dc1-b0a6-3c3a432f4340 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:17.300494 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1022/2068] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 10 03:20:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:20:17.305199 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6bdfff-5d0a-4ad0-b160-96889603e18b None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:17.318551 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6bdfff-5d0a-4ad0-b160-96889603e18b None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:17.325180 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7459cb-5c5e-4c15-898e-a551bfb23dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:17.325868 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7459cb-5c5e-4c15-898e-a551bfb23dd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:17.326150 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7459cb-5c5e-4c15-898e-a551bfb23dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:17.326424 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7459cb-5c5e-4c15-898e-a551bfb23dd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:17.327164 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7459cb-5c5e-4c15-898e-a551bfb23dd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:17.329091 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7459cb-5c5e-4c15-898e-a551bfb23dd1 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:17.466251 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1047/2069] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:20:17 2022] POST /identity/v3/projects => generated 371 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:20:17.467918 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76541b5-5624-4dc1-b0a6-3c3a432f4340 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:17.478173 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76541b5-5624-4dc1-b0a6-3c3a432f4340 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:17.535275 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7154d9-55fc-4856-bd76-81feb806e9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:17.535951 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7154d9-55fc-4856-bd76-81feb806e9b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:17.536268 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7154d9-55fc-4856-bd76-81feb806e9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:17.536591 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7154d9-55fc-4856-bd76-81feb806e9b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:17.537350 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7154d9-55fc-4856-bd76-81feb806e9b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:17.539812 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7154d9-55fc-4856-bd76-81feb806e9b0 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:17.550342 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7459cb-5c5e-4c15-898e-a551bfb23dd1 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:17.552259 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-0b7459cb-5c5e-4c15-898e-a551bfb23dd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:17.568250 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7459cb-5c5e-4c15-898e-a551bfb23dd1 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:17.581268 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87b8353-dbd0-41d4-aa33-fa84989f9c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:17.582160 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b8353-dbd0-41d4-aa33-fa84989f9c17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:17.582465 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b8353-dbd0-41d4-aa33-fa84989f9c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:17.582779 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b8353-dbd0-41d4-aa33-fa84989f9c17 admin admin] PATH_INFO: `/v3/projects/14cdd9cc2cb64c3d88e9fdf2a3d2a8c3` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:17.583977 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87b8353-dbd0-41d4-aa33-fa84989f9c17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14cdd9cc2cb64c3d88e9fdf2a3d2a8c3)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:17.587430 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87b8353-dbd0-41d4-aa33-fa84989f9c17 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:17.678785 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1023/2070] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:20:17 2022] POST /identity/v3/users => generated 286 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:20:17.685871 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-e87b8353-dbd0-41d4-aa33-fa84989f9c17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14cdd9cc2cb64c3d88e9fdf2a3d2a8c3', 'request_id': 'req-e87b8353-dbd0-41d4-aa33-fa84989f9c17'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:17.691443 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7154d9-55fc-4856-bd76-81feb806e9b0 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:17.696267 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-e87b8353-dbd0-41d4-aa33-fa84989f9c17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14cdd9cc2cb64c3d88e9fdf2a3d2a8c3', 'request_id': 'req-e87b8353-dbd0-41d4-aa33-fa84989f9c17'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:17.705083 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-e87b8353-dbd0-41d4-aa33-fa84989f9c17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14cdd9cc2cb64c3d88e9fdf2a3d2a8c3', 'request_id': 'req-e87b8353-dbd0-41d4-aa33-fa84989f9c17'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:17.705263 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7154d9-55fc-4856-bd76-81feb806e9b0 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:17.766600 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969aa13f-4187-4745-a503-8dc7fd836419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:17.767282 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969aa13f-4187-4745-a503-8dc7fd836419 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:17.767563 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969aa13f-4187-4745-a503-8dc7fd836419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:17.767840 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969aa13f-4187-4745-a503-8dc7fd836419 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:17.768645 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969aa13f-4187-4745-a503-8dc7fd836419 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:17.770241 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969aa13f-4187-4745-a503-8dc7fd836419 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:17.783250 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1024/2071] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:20:17.784994 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969aa13f-4187-4745-a503-8dc7fd836419 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:17.796534 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969aa13f-4187-4745-a503-8dc7fd836419 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:17.805772 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4bc8f9-cc41-4921-8081-4dc0ae97da91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:17.805772 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4bc8f9-cc41-4921-8081-4dc0ae97da91 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:17.805772 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4bc8f9-cc41-4921-8081-4dc0ae97da91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:17.805772 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4bc8f9-cc41-4921-8081-4dc0ae97da91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:17.806112 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4bc8f9-cc41-4921-8081-4dc0ae97da91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:17.806744 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4bc8f9-cc41-4921-8081-4dc0ae97da91 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:17.809519 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-e87b8353-dbd0-41d4-aa33-fa84989f9c17 admin admin] The token cache is being invalidate because project 14cdd9cc2cb64c3d88e9fdf2a3d2a8c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:20:17.809977 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-e87b8353-dbd0-41d4-aa33-fa84989f9c17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:17.810679 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-e87b8353-dbd0-41d4-aa33-fa84989f9c17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:17.815980 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1048/2072] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:20:17 2022] DELETE /identity/v3/projects/14cdd9cc2cb64c3d88e9fdf2a3d2a8c3 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:17.817303 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1025/2073] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:20:17.821063 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a725c9-da8f-4d85-ac8b-de1940272502 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:17.821190 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4bc8f9-cc41-4921-8081-4dc0ae97da91 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:17.821406 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a725c9-da8f-4d85-ac8b-de1940272502 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:17.821690 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a725c9-da8f-4d85-ac8b-de1940272502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:17.822879 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-4f4bc8f9-cc41-4921-8081-4dc0ae97da91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:17.835737 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4bc8f9-cc41-4921-8081-4dc0ae97da91 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:17.840931 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-c1a725c9-da8f-4d85-ac8b-de1940272502 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:17.841081 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e2c215-4685-4151-850d-f61c00d1a5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:17.842058 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2c215-4685-4151-850d-f61c00d1a5ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:17.842168 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-c1a725c9-da8f-4d85-ac8b-de1940272502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:17.842558 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2c215-4685-4151-850d-f61c00d1a5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:17.843292 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2c215-4685-4151-850d-f61c00d1a5ab admin admin] PATH_INFO: `/v3/projects/4524e2de8e8e4dbfa1cb85515dbeb90a/users/a49b27f57e9049518e157d39f6901bd7/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:17.849967 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1049/2074] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:20:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:17.858042 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7accd4-02fa-497f-93af-0ad9f35d942c None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:17.860138 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7accd4-02fa-497f-93af-0ad9f35d942c None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:17.860138 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7accd4-02fa-497f-93af-0ad9f35d942c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:17.860296 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e2c215-4685-4151-850d-f61c00d1a5ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=4524e2de8e8e4dbfa1cb85515dbeb90a, user_id=a49b27f57e9049518e157d39f6901bd7, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:17.861916 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e2c215-4685-4151-850d-f61c00d1a5ab admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:17.876145 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-4a7accd4-02fa-497f-93af-0ad9f35d942c None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:17.877363 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-4a7accd4-02fa-497f-93af-0ad9f35d942c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:17.885267 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1050/2075] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:20:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:20:17.889348 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7accd4-02fa-497f-93af-0ad9f35d942c None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:17.898902 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7accd4-02fa-497f-93af-0ad9f35d942c None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:17.903535 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27ad4ba-a591-47e5-87f4-12bd05f4b808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:17.904226 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ad4ba-a591-47e5-87f4-12bd05f4b808 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:17.904514 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ad4ba-a591-47e5-87f4-12bd05f4b808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:17.904793 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ad4ba-a591-47e5-87f4-12bd05f4b808 admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:17.905510 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27ad4ba-a591-47e5-87f4-12bd05f4b808 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:20:17.905819 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27ad4ba-a591-47e5-87f4-12bd05f4b808 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:17.907433 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27ad4ba-a591-47e5-87f4-12bd05f4b808 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:17.921203 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1051/2076] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 10 03:20:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:20:17.925347 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27ad4ba-a591-47e5-87f4-12bd05f4b808 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:17.936482 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27ad4ba-a591-47e5-87f4-12bd05f4b808 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:17.937457 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1026/2077] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:20:17 2022] PUT /identity/v3/projects/4524e2de8e8e4dbfa1cb85515dbeb90a/users/a49b27f57e9049518e157d39f6901bd7/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:20:17.942363 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae2e47a-cb9c-40b8-aedb-437f31a7b5d0 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:17.942650 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae2e47a-cb9c-40b8-aedb-437f31a7b5d0 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:17.942915 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae2e47a-cb9c-40b8-aedb-437f31a7b5d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:17.959231 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-bae2e47a-cb9c-40b8-aedb-437f31a7b5d0 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:17.960992 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-bae2e47a-cb9c-40b8-aedb-437f31a7b5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:17.993076 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b81e3e2-5979-49cf-b744-66b52a9d9fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:17.993835 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81e3e2-5979-49cf-b744-66b52a9d9fed admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:17.994172 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81e3e2-5979-49cf-b744-66b52a9d9fed admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:17.994453 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81e3e2-5979-49cf-b744-66b52a9d9fed admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:17.995137 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b81e3e2-5979-49cf-b744-66b52a9d9fed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:17.997112 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b81e3e2-5979-49cf-b744-66b52a9d9fed admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:18.030123 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1027/2078] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:20:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:20:18.044034 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae2e47a-cb9c-40b8-aedb-437f31a7b5d0 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:18.045084 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-bae2e47a-cb9c-40b8-aedb-437f31a7b5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:18.091578 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1052/2079] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:20:17 2022] POST /identity/v3/projects => generated 359 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:20:18.097231 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b81e3e2-5979-49cf-b744-66b52a9d9fed admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:18.107040 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae2e47a-cb9c-40b8-aedb-437f31a7b5d0 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:18.161925 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e33d4-2178-4db9-81be-97757abfac96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:18.163466 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e33d4-2178-4db9-81be-97757abfac96 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:18.163941 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e33d4-2178-4db9-81be-97757abfac96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:18.164512 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e33d4-2178-4db9-81be-97757abfac96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:18.169373 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b81e3e2-5979-49cf-b744-66b52a9d9fed admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:18.173711 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9e33d4-2178-4db9-81be-97757abfac96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:18.174479 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff4a87-ece3-41c7-acb6-2dedc96aa33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:18.175141 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff4a87-ece3-41c7-acb6-2dedc96aa33c admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:18.175246 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9e33d4-2178-4db9-81be-97757abfac96 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:18.175504 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff4a87-ece3-41c7-acb6-2dedc96aa33c admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:18.175727 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff4a87-ece3-41c7-acb6-2dedc96aa33c admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:18.176519 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ff4a87-ece3-41c7-acb6-2dedc96aa33c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:18.178515 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ff4a87-ece3-41c7-acb6-2dedc96aa33c admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:18.184612 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1028/2080] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:20:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:20:18.322960 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1053/2081] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:20:18 2022] POST /identity/v3/users => generated 280 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:20:18.326950 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e33d4-2178-4db9-81be-97757abfac96 service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:18.337134 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e33d4-2178-4db9-81be-97757abfac96 service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:18.341929 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e688197-2ba5-4713-bea2-96bf2eb820ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:18.342588 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e688197-2ba5-4713-bea2-96bf2eb820ee admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:18.342872 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e688197-2ba5-4713-bea2-96bf2eb820ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:18.343148 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e688197-2ba5-4713-bea2-96bf2eb820ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:18.343875 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e688197-2ba5-4713-bea2-96bf2eb820ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:18.345544 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e688197-2ba5-4713-bea2-96bf2eb820ee admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:18.356378 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1029/2082] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:20:18.364416 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff4a87-ece3-41c7-acb6-2dedc96aa33c admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:18.376981 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff4a87-ece3-41c7-acb6-2dedc96aa33c admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:18.382857 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9192a9-425f-48fe-a957-9f0640fa7ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:18.388257 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9192a9-425f-48fe-a957-9f0640fa7ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:18.388257 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9192a9-425f-48fe-a957-9f0640fa7ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:18.388257 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9192a9-425f-48fe-a957-9f0640fa7ac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:18.388257 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9192a9-425f-48fe-a957-9f0640fa7ac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:18.388257 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9192a9-425f-48fe-a957-9f0640fa7ac1 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:18.401279 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1054/2083] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:20:18.402595 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e688197-2ba5-4713-bea2-96bf2eb820ee admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:18.413228 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e688197-2ba5-4713-bea2-96bf2eb820ee admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:18.418240 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cce03a-3e40-4c12-b41c-350909e0b012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:18.419119 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cce03a-3e40-4c12-b41c-350909e0b012 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:18.419420 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cce03a-3e40-4c12-b41c-350909e0b012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:18.419687 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cce03a-3e40-4c12-b41c-350909e0b012 admin admin] PATH_INFO: `/v3/projects/49d37f94cb1a43bfad4995d895f310cd/users/8da85892c4e2491ea61ebd22d36f3dda/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:18.434965 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cce03a-3e40-4c12-b41c-350909e0b012 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49d37f94cb1a43bfad4995d895f310cd, user_id=8da85892c4e2491ea61ebd22d36f3dda, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:18.437682 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cce03a-3e40-4c12-b41c-350909e0b012 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:18.576521 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1030/2084] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:20:18 2022] PUT /identity/v3/projects/49d37f94cb1a43bfad4995d895f310cd/users/8da85892c4e2491ea61ebd22d36f3dda/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:18.590019 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a859674-c253-42dd-ab82-af404433d0b4 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:18.590311 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a859674-c253-42dd-ab82-af404433d0b4 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:18.590745 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a859674-c253-42dd-ab82-af404433d0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:18.625297 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-3a859674-c253-42dd-ab82-af404433d0b4 None None] MFA Rules not processed for user `8da85892c4e2491ea61ebd22d36f3dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:18.626524 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-3a859674-c253-42dd-ab82-af404433d0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:18.691860 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1055/2085] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:20:18 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:18.723278 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cce03a-3e40-4c12-b41c-350909e0b012 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:18.726077 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-d8cce03a-3e40-4c12-b41c-350909e0b012 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:18.788447 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cce03a-3e40-4c12-b41c-350909e0b012 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:18.792661 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0110c6-72db-4e1b-839a-1621c9dd4a7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:18.793517 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0110c6-72db-4e1b-839a-1621c9dd4a7f service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:18.794205 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0110c6-72db-4e1b-839a-1621c9dd4a7f service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:18.794205 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0110c6-72db-4e1b-839a-1621c9dd4a7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:18.810388 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0110c6-72db-4e1b-839a-1621c9dd4a7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:18.812560 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0110c6-72db-4e1b-839a-1621c9dd4a7f service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:18.822853 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1031/2086] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:20:18 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:20:18.840275 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a859674-c253-42dd-ab82-af404433d0b4 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:18.925062 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a859674-c253-42dd-ab82-af404433d0b4 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:18.930201 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6f86c-a7a0-43e8-b88f-46cabeb7f0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:18.931073 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6f86c-a7a0-43e8-b88f-46cabeb7f0fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:18.931371 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6f86c-a7a0-43e8-b88f-46cabeb7f0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:18.931660 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6f86c-a7a0-43e8-b88f-46cabeb7f0fe admin admin] PATH_INFO: `/v3/users/8da85892c4e2491ea61ebd22d36f3dda` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:18.933002 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f6f86c-a7a0-43e8-b88f-46cabeb7f0fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=8da85892c4e2491ea61ebd22d36f3dda)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:18.940336 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f6f86c-a7a0-43e8-b88f-46cabeb7f0fe admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:19.169564 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-d2f6f86c-a7a0-43e8-b88f-46cabeb7f0fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8da85892c4e2491ea61ebd22d36f3dda'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:19.177341 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-d2f6f86c-a7a0-43e8-b88f-46cabeb7f0fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8da85892c4e2491ea61ebd22d36f3dda'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:19.190412 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-d2f6f86c-a7a0-43e8-b88f-46cabeb7f0fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8da85892c4e2491ea61ebd22d36f3dda'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:19.191168 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-d2f6f86c-a7a0-43e8-b88f-46cabeb7f0fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8da85892c4e2491ea61ebd22d36f3dda'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:19.191777 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-d2f6f86c-a7a0-43e8-b88f-46cabeb7f0fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8da85892c4e2491ea61ebd22d36f3dda'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:19.293936 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1056/2087] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:20:18 2022] DELETE /identity/v3/users/8da85892c4e2491ea61ebd22d36f3dda => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:19.295737 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043215e-eabc-46ab-844e-27bd8b612e00 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:19.300140 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043215e-eabc-46ab-844e-27bd8b612e00 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:19.300140 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043215e-eabc-46ab-844e-27bd8b612e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:19.320223 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-0043215e-eabc-46ab-844e-27bd8b612e00 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:19.321762 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-0043215e-eabc-46ab-844e-27bd8b612e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:19.389357 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1032/2088] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:20:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:19.399740 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6f86c-a7a0-43e8-b88f-46cabeb7f0fe admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:19.404903 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-d2f6f86c-a7a0-43e8-b88f-46cabeb7f0fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:19.465466 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6f86c-a7a0-43e8-b88f-46cabeb7f0fe admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:19.469207 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c7bf8b-a1a6-4d2f-b4cf-2f343292413e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:19.469850 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7bf8b-a1a6-4d2f-b4cf-2f343292413e service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:19.470131 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7bf8b-a1a6-4d2f-b4cf-2f343292413e service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:19.470402 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7bf8b-a1a6-4d2f-b4cf-2f343292413e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:19.479653 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c7bf8b-a1a6-4d2f-b4cf-2f343292413e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:19.481140 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c7bf8b-a1a6-4d2f-b4cf-2f343292413e service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:19.490490 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1057/2089] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:20:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:20:20.300590 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0043215e-eabc-46ab-844e-27bd8b612e00 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:20.302656 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-0043215e-eabc-46ab-844e-27bd8b612e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:20.316363 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0043215e-eabc-46ab-844e-27bd8b612e00 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:20.321821 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcebbe5b-e511-48a8-8a02-1f24adbd9c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:20.322693 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcebbe5b-e511-48a8-8a02-1f24adbd9c8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:20.322982 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcebbe5b-e511-48a8-8a02-1f24adbd9c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:20.323254 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcebbe5b-e511-48a8-8a02-1f24adbd9c8a admin admin] PATH_INFO: `/v3/projects/49d37f94cb1a43bfad4995d895f310cd` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:20.324487 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcebbe5b-e511-48a8-8a02-1f24adbd9c8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=49d37f94cb1a43bfad4995d895f310cd)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:20.326645 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcebbe5b-e511-48a8-8a02-1f24adbd9c8a admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:20.496468 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-bcebbe5b-e511-48a8-8a02-1f24adbd9c8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49d37f94cb1a43bfad4995d895f310cd', 'request_id': 'req-bcebbe5b-e511-48a8-8a02-1f24adbd9c8a'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:20.510855 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-bcebbe5b-e511-48a8-8a02-1f24adbd9c8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49d37f94cb1a43bfad4995d895f310cd', 'request_id': 'req-bcebbe5b-e511-48a8-8a02-1f24adbd9c8a'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:20.518705 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-bcebbe5b-e511-48a8-8a02-1f24adbd9c8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49d37f94cb1a43bfad4995d895f310cd', 'request_id': 'req-bcebbe5b-e511-48a8-8a02-1f24adbd9c8a'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:20.610084 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-bcebbe5b-e511-48a8-8a02-1f24adbd9c8a admin admin] The token cache is being invalidate because project 49d37f94cb1a43bfad4995d895f310cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:20:20.610795 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-bcebbe5b-e511-48a8-8a02-1f24adbd9c8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:20.616102 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-bcebbe5b-e511-48a8-8a02-1f24adbd9c8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:20.623448 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61028f88-e279-487f-8c6b-e67974966e29 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:20.624084 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61028f88-e279-487f-8c6b-e67974966e29 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:20.624084 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61028f88-e279-487f-8c6b-e67974966e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:20.626457 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1033/2090] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:20:20 2022] DELETE /identity/v3/projects/49d37f94cb1a43bfad4995d895f310cd => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:20.663659 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-61028f88-e279-487f-8c6b-e67974966e29 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:20.665920 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-61028f88-e279-487f-8c6b-e67974966e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:20.759408 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1058/2091] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:20:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:20.765828 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56866c9d-7fa3-4618-8783-1d8482f92a2e None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:20.766316 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56866c9d-7fa3-4618-8783-1d8482f92a2e None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:20.766673 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56866c9d-7fa3-4618-8783-1d8482f92a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:20.789815 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-56866c9d-7fa3-4618-8783-1d8482f92a2e None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:20.791628 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-56866c9d-7fa3-4618-8783-1d8482f92a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:20.804393 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1034/2092] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:20:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:20.809577 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61028f88-e279-487f-8c6b-e67974966e29 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:20.821850 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61028f88-e279-487f-8c6b-e67974966e29 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:20.827410 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b72ee86-4fba-4c68-8907-09f9da66b723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:20.828277 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b72ee86-4fba-4c68-8907-09f9da66b723 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:20.828579 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b72ee86-4fba-4c68-8907-09f9da66b723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:20.828923 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b72ee86-4fba-4c68-8907-09f9da66b723 admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:20.829839 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b72ee86-4fba-4c68-8907-09f9da66b723 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:20:20.830309 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b72ee86-4fba-4c68-8907-09f9da66b723 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:20.832406 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b72ee86-4fba-4c68-8907-09f9da66b723 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:20.852061 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1059/2093] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 10 03:20:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:20:20.854387 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56866c9d-7fa3-4618-8783-1d8482f92a2e None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:20.864533 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56866c9d-7fa3-4618-8783-1d8482f92a2e None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:20.870545 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abce406e-204b-4e58-818e-48d4722a3a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:20.871245 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce406e-204b-4e58-818e-48d4722a3a4c admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:20.871527 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce406e-204b-4e58-818e-48d4722a3a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:20.871793 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce406e-204b-4e58-818e-48d4722a3a4c admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:20.872683 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abce406e-204b-4e58-818e-48d4722a3a4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:20.875147 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abce406e-204b-4e58-818e-48d4722a3a4c admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:20.986978 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1035/2094] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:20:20 2022] POST /identity/v3/projects => generated 385 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:20:20.994399 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b72ee86-4fba-4c68-8907-09f9da66b723 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:21.004305 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b72ee86-4fba-4c68-8907-09f9da66b723 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:21.071187 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e03a39-2aa5-4fb6-8e20-a30edd858ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:21.071866 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e03a39-2aa5-4fb6-8e20-a30edd858ebf admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:21.072192 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e03a39-2aa5-4fb6-8e20-a30edd858ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:21.072475 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e03a39-2aa5-4fb6-8e20-a30edd858ebf admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:21.073184 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e03a39-2aa5-4fb6-8e20-a30edd858ebf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:21.075101 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e03a39-2aa5-4fb6-8e20-a30edd858ebf admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:21.204248 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1060/2095] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:20:20 2022] POST /identity/v3/users => generated 293 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:20:21.208374 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abce406e-204b-4e58-818e-48d4722a3a4c admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:21.222531 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abce406e-204b-4e58-818e-48d4722a3a4c admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:21.228119 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1422ec62-fc96-4a73-8f34-d210eb4ff018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:21.233200 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1422ec62-fc96-4a73-8f34-d210eb4ff018 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:21.233200 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1422ec62-fc96-4a73-8f34-d210eb4ff018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:21.233200 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1422ec62-fc96-4a73-8f34-d210eb4ff018 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:21.233200 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1422ec62-fc96-4a73-8f34-d210eb4ff018 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:21.233200 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1422ec62-fc96-4a73-8f34-d210eb4ff018 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:21.248276 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1036/2096] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:20:21.252280 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e03a39-2aa5-4fb6-8e20-a30edd858ebf admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:21.262456 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e03a39-2aa5-4fb6-8e20-a30edd858ebf admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:21.268942 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26962b8-1377-4fea-91b5-5c61b3071473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:21.269570 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26962b8-1377-4fea-91b5-5c61b3071473 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:21.269852 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26962b8-1377-4fea-91b5-5c61b3071473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:21.270128 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26962b8-1377-4fea-91b5-5c61b3071473 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:21.270864 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26962b8-1377-4fea-91b5-5c61b3071473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:21.272543 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26962b8-1377-4fea-91b5-5c61b3071473 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:21.288373 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1061/2097] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:20:21.289526 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1422ec62-fc96-4a73-8f34-d210eb4ff018 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:21.301817 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1422ec62-fc96-4a73-8f34-d210eb4ff018 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:21.307696 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998945aa-cd98-4954-b4da-bb9d5785faf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:21.308628 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998945aa-cd98-4954-b4da-bb9d5785faf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:21.309424 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998945aa-cd98-4954-b4da-bb9d5785faf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:21.309424 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998945aa-cd98-4954-b4da-bb9d5785faf2 admin admin] PATH_INFO: `/v3/projects/20a3135ddfe74a938a8621abca888882/users/69091b6421a9462da041d7e0d39ef7d9/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:21.343654 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998945aa-cd98-4954-b4da-bb9d5785faf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20a3135ddfe74a938a8621abca888882, user_id=69091b6421a9462da041d7e0d39ef7d9, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:21.346480 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998945aa-cd98-4954-b4da-bb9d5785faf2 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:21.460055 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1037/2098] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:20:21 2022] PUT /identity/v3/projects/20a3135ddfe74a938a8621abca888882/users/69091b6421a9462da041d7e0d39ef7d9/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:21.473524 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa15ad-afda-4b8e-90b2-50a75d345495 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:21.473845 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa15ad-afda-4b8e-90b2-50a75d345495 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:21.474129 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa15ad-afda-4b8e-90b2-50a75d345495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:21.502294 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-07fa15ad-afda-4b8e-90b2-50a75d345495 None None] MFA Rules not processed for user `69091b6421a9462da041d7e0d39ef7d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:21.503661 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-07fa15ad-afda-4b8e-90b2-50a75d345495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:21.578568 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1062/2099] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:20:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:21.618803 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998945aa-cd98-4954-b4da-bb9d5785faf2 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:21.620677 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-998945aa-cd98-4954-b4da-bb9d5785faf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:21.690078 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998945aa-cd98-4954-b4da-bb9d5785faf2 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:21.693203 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1a79c-4f61-40e9-bcc8-1ae2dbb7d56f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:21.694210 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1a79c-4f61-40e9-bcc8-1ae2dbb7d56f service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:21.694648 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1a79c-4f61-40e9-bcc8-1ae2dbb7d56f service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:21.695021 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1a79c-4f61-40e9-bcc8-1ae2dbb7d56f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:21.707621 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec1a79c-4f61-40e9-bcc8-1ae2dbb7d56f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:21.711740 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec1a79c-4f61-40e9-bcc8-1ae2dbb7d56f service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:21.742883 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1038/2100] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:20:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:20:24.820163 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df34d6-d7c3-4129-93d3-5c08cd889933 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:24.820683 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df34d6-d7c3-4129-93d3-5c08cd889933 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:24.820805 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df34d6-d7c3-4129-93d3-5c08cd889933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:24.848673 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-f2df34d6-d7c3-4129-93d3-5c08cd889933 None None] MFA Rules not processed for user `a49b27f57e9049518e157d39f6901bd7`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:24.849929 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-f2df34d6-d7c3-4129-93d3-5c08cd889933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:24.915974 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1063/2101] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:20:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:24.991400 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1a79c-4f61-40e9-bcc8-1ae2dbb7d56f service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:24.991400 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-5ec1a79c-4f61-40e9-bcc8-1ae2dbb7d56f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:25.079142 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1a79c-4f61-40e9-bcc8-1ae2dbb7d56f service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:25.079142 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9540304d-5fa5-4fba-9471-09f170b63f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:25.079142 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9540304d-5fa5-4fba-9471-09f170b63f20 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:25.079142 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9540304d-5fa5-4fba-9471-09f170b63f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:25.079527 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9540304d-5fa5-4fba-9471-09f170b63f20 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:25.079527 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9540304d-5fa5-4fba-9471-09f170b63f20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:25.079527 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9540304d-5fa5-4fba-9471-09f170b63f20 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:25.082251 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2df34d6-d7c3-4129-93d3-5c08cd889933 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:25.095039 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2df34d6-d7c3-4129-93d3-5c08cd889933 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:25.100191 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaa3e0a-8186-44a3-8ea0-81a73688f33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:25.101217 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa3e0a-8186-44a3-8ea0-81a73688f33d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:25.101497 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa3e0a-8186-44a3-8ea0-81a73688f33d admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:25.101770 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa3e0a-8186-44a3-8ea0-81a73688f33d admin admin] PATH_INFO: `/v3/users/69091b6421a9462da041d7e0d39ef7d9` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:25.102986 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaa3e0a-8186-44a3-8ea0-81a73688f33d admin admin] RBAC: Authorizing `identity:delete_user(user_id=69091b6421a9462da041d7e0d39ef7d9)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:25.104950 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaa3e0a-8186-44a3-8ea0-81a73688f33d admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:25.219698 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1039/2102] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:20:24 2022] POST /identity/v3/projects => generated 371 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:20:25.220967 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9540304d-5fa5-4fba-9471-09f170b63f20 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:25.290934 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9540304d-5fa5-4fba-9471-09f170b63f20 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:25.293382 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19755c9-4163-4836-8317-2f57f91cd0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:25.293912 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19755c9-4163-4836-8317-2f57f91cd0e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:25.294197 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19755c9-4163-4836-8317-2f57f91cd0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:25.294471 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19755c9-4163-4836-8317-2f57f91cd0e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:25.295165 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19755c9-4163-4836-8317-2f57f91cd0e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:25.297117 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19755c9-4163-4836-8317-2f57f91cd0e3 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:25.322769 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-faaa3e0a-8186-44a3-8ea0-81a73688f33d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69091b6421a9462da041d7e0d39ef7d9'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:25.329901 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-faaa3e0a-8186-44a3-8ea0-81a73688f33d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69091b6421a9462da041d7e0d39ef7d9'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:25.342115 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-faaa3e0a-8186-44a3-8ea0-81a73688f33d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69091b6421a9462da041d7e0d39ef7d9'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:25.342854 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-faaa3e0a-8186-44a3-8ea0-81a73688f33d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69091b6421a9462da041d7e0d39ef7d9'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:25.343570 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-faaa3e0a-8186-44a3-8ea0-81a73688f33d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69091b6421a9462da041d7e0d39ef7d9'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:25.414272 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1040/2103] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:20:25 2022] POST /identity/v3/users => generated 292 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:20:25.415381 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19755c9-4163-4836-8317-2f57f91cd0e3 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:25.416980 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-d19755c9-4163-4836-8317-2f57f91cd0e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:25.431701 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19755c9-4163-4836-8317-2f57f91cd0e3 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:25.436609 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4ebe2b-c90b-4f87-ae02-be5ebe15821b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:25.437550 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ebe2b-c90b-4f87-ae02-be5ebe15821b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:25.438149 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ebe2b-c90b-4f87-ae02-be5ebe15821b admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:25.438471 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ebe2b-c90b-4f87-ae02-be5ebe15821b admin admin] PATH_INFO: `/v3/users/e3109b48624a4623ac30860aaca66c3c` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:25.440386 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4ebe2b-c90b-4f87-ae02-be5ebe15821b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3109b48624a4623ac30860aaca66c3c)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:25.444784 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4ebe2b-c90b-4f87-ae02-be5ebe15821b admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:25.497170 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1064/2104] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:20:25 2022] DELETE /identity/v3/users/69091b6421a9462da041d7e0d39ef7d9 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:20:25.497983 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaa3e0a-8186-44a3-8ea0-81a73688f33d admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:25.499298 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-faaa3e0a-8186-44a3-8ea0-81a73688f33d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:25.566145 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaa3e0a-8186-44a3-8ea0-81a73688f33d admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:25.570727 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafc49b3-599b-49a1-b22d-95c79dc3c416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:25.571412 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc49b3-599b-49a1-b22d-95c79dc3c416 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:25.571741 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc49b3-599b-49a1-b22d-95c79dc3c416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:25.572197 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc49b3-599b-49a1-b22d-95c79dc3c416 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:25.572949 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafc49b3-599b-49a1-b22d-95c79dc3c416 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:25.574628 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafc49b3-599b-49a1-b22d-95c79dc3c416 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:25.589654 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1065/2105] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:20:25.589654 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f83aec-6321-4ae0-a310-8d9c3a800280 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:25.589654 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f83aec-6321-4ae0-a310-8d9c3a800280 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:25.589654 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f83aec-6321-4ae0-a310-8d9c3a800280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:25.605690 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-d2f83aec-6321-4ae0-a310-8d9c3a800280 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:25.607192 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-d2f83aec-6321-4ae0-a310-8d9c3a800280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:25.615418 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1066/2106] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:20:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:25.616942 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f83aec-6321-4ae0-a310-8d9c3a800280 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:25.626441 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f83aec-6321-4ae0-a310-8d9c3a800280 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:25.632049 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af79d7d-a854-4a31-9f59-8eae83e3fc6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:25.632955 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af79d7d-a854-4a31-9f59-8eae83e3fc6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:25.633374 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af79d7d-a854-4a31-9f59-8eae83e3fc6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:25.633649 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af79d7d-a854-4a31-9f59-8eae83e3fc6c admin admin] PATH_INFO: `/v3/projects/42abd48bea644edbb8241cc544fa58a9/users/d0a7ce96f7f545319669312c8f4590e3/roles/43105000610f402ca2486e7648018cca` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:25.649580 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af79d7d-a854-4a31-9f59-8eae83e3fc6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=42abd48bea644edbb8241cc544fa58a9, user_id=d0a7ce96f7f545319669312c8f4590e3, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:25.652485 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af79d7d-a854-4a31-9f59-8eae83e3fc6c admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:25.687594 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8d4ebe2b-c90b-4f87-ae02-be5ebe15821b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3109b48624a4623ac30860aaca66c3c'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:25.688600 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8d4ebe2b-c90b-4f87-ae02-be5ebe15821b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3109b48624a4623ac30860aaca66c3c'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:25.699432 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8d4ebe2b-c90b-4f87-ae02-be5ebe15821b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3109b48624a4623ac30860aaca66c3c'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:25.734030 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1067/2107] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:20:25 2022] PUT /identity/v3/projects/42abd48bea644edbb8241cc544fa58a9/users/d0a7ce96f7f545319669312c8f4590e3/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:25.734894 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af79d7d-a854-4a31-9f59-8eae83e3fc6c admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:25.736667 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-2af79d7d-a854-4a31-9f59-8eae83e3fc6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:25.805863 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8d4ebe2b-c90b-4f87-ae02-be5ebe15821b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3109b48624a4623ac30860aaca66c3c'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:25.807016 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8d4ebe2b-c90b-4f87-ae02-be5ebe15821b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3109b48624a4623ac30860aaca66c3c'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:25.812411 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af79d7d-a854-4a31-9f59-8eae83e3fc6c admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:25.816689 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65925dd2-8d73-4b1a-8df8-1dfbe86005f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:25.817187 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65925dd2-8d73-4b1a-8df8-1dfbe86005f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:25.817480 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65925dd2-8d73-4b1a-8df8-1dfbe86005f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:25.817808 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65925dd2-8d73-4b1a-8df8-1dfbe86005f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:25.819698 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-65925dd2-8d73-4b1a-8df8-1dfbe86005f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:25.841544 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1041/2108] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:20:25 2022] DELETE /identity/v3/users/e3109b48624a4623ac30860aaca66c3c => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:25.843146 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4ebe2b-c90b-4f87-ae02-be5ebe15821b admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:25.846063 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-8d4ebe2b-c90b-4f87-ae02-be5ebe15821b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:25.896556 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65925dd2-8d73-4b1a-8df8-1dfbe86005f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:25.898281 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65925dd2-8d73-4b1a-8df8-1dfbe86005f3 service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:25.909531 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1068/2109] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:20:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:20:25.910828 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffab7f7-920b-494a-8528-d5c373c09a8e None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:25.911117 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffab7f7-920b-494a-8528-d5c373c09a8e None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:25.911391 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffab7f7-920b-494a-8528-d5c373c09a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:25.933122 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-1ffab7f7-920b-494a-8528-d5c373c09a8e None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:25.934490 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-1ffab7f7-920b-494a-8528-d5c373c09a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:25.988249 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4ebe2b-c90b-4f87-ae02-be5ebe15821b admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:25.999007 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c0f259-1157-4bd1-b858-c87c8140b8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:26.001474 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0f259-1157-4bd1-b858-c87c8140b8bc admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:26.002302 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0f259-1157-4bd1-b858-c87c8140b8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:26.003120 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0f259-1157-4bd1-b858-c87c8140b8bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:26.005008 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c0f259-1157-4bd1-b858-c87c8140b8bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:26.005824 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1069/2110] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:20:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:26.010403 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c0f259-1157-4bd1-b858-c87c8140b8bc admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:26.016093 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffab7f7-920b-494a-8528-d5c373c09a8e None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:26.017780 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-1ffab7f7-920b-494a-8528-d5c373c09a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:26.033118 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1042/2111] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:20:26.037201 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c0f259-1157-4bd1-b858-c87c8140b8bc admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:26.048468 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c0f259-1157-4bd1-b858-c87c8140b8bc admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:26.054220 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3241f66-ec2a-423f-8ca6-a07df8e2c7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:26.058849 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3241f66-ec2a-423f-8ca6-a07df8e2c7ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:26.058849 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3241f66-ec2a-423f-8ca6-a07df8e2c7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:26.058849 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3241f66-ec2a-423f-8ca6-a07df8e2c7ea admin admin] PATH_INFO: `/v3/projects/42abd48bea644edbb8241cc544fa58a9/users/d0a7ce96f7f545319669312c8f4590e3/roles/43105000610f402ca2486e7648018cca` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:26.058849 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3241f66-ec2a-423f-8ca6-a07df8e2c7ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=42abd48bea644edbb8241cc544fa58a9, user_id=d0a7ce96f7f545319669312c8f4590e3, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:26.062151 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3241f66-ec2a-423f-8ca6-a07df8e2c7ea admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:26.077593 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1043/2112] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:20:26 2022] PUT /identity/v3/projects/42abd48bea644edbb8241cc544fa58a9/users/d0a7ce96f7f545319669312c8f4590e3/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:20:26.085927 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffab7f7-920b-494a-8528-d5c373c09a8e None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:26.140627 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6774e600-6a06-4561-a8b7-958c65d01f7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:26.141277 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6774e600-6a06-4561-a8b7-958c65d01f7e service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:26.141560 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6774e600-6a06-4561-a8b7-958c65d01f7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:26.142078 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6774e600-6a06-4561-a8b7-958c65d01f7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:26.214725 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6774e600-6a06-4561-a8b7-958c65d01f7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:26.216340 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6774e600-6a06-4561-a8b7-958c65d01f7e service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:26.228565 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1070/2113] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:20:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:20:26.337429 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3241f66-ec2a-423f-8ca6-a07df8e2c7ea admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:26.339294 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-b3241f66-ec2a-423f-8ca6-a07df8e2c7ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:26.353616 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3241f66-ec2a-423f-8ca6-a07df8e2c7ea admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:26.359412 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf1495c-741b-4d9b-8371-b04f13d7b2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:26.364080 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1495c-741b-4d9b-8371-b04f13d7b2a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:26.364080 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1495c-741b-4d9b-8371-b04f13d7b2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:26.364080 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1495c-741b-4d9b-8371-b04f13d7b2a0 admin admin] PATH_INFO: `/v3/users/2482b199e87f429ebb93a305f5c92c86` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:26.364080 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf1495c-741b-4d9b-8371-b04f13d7b2a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2482b199e87f429ebb93a305f5c92c86)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:26.364915 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf1495c-741b-4d9b-8371-b04f13d7b2a0 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:26.520161 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6774e600-6a06-4561-a8b7-958c65d01f7e service neutron] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:26.521605 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-6774e600-6a06-4561-a8b7-958c65d01f7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:26.537457 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6774e600-6a06-4561-a8b7-958c65d01f7e service neutron] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:26.542928 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e47d39-dcc6-4f0c-8236-ccbf727046c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:26.543622 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e47d39-dcc6-4f0c-8236-ccbf727046c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:26.543910 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e47d39-dcc6-4f0c-8236-ccbf727046c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:26.544538 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e47d39-dcc6-4f0c-8236-ccbf727046c3 admin admin] PATH_INFO: `/v3/projects/20a3135ddfe74a938a8621abca888882` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:26.545146 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-fcf1495c-741b-4d9b-8371-b04f13d7b2a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2482b199e87f429ebb93a305f5c92c86'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:26.545675 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e47d39-dcc6-4f0c-8236-ccbf727046c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20a3135ddfe74a938a8621abca888882)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:26.546128 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-fcf1495c-741b-4d9b-8371-b04f13d7b2a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2482b199e87f429ebb93a305f5c92c86'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:26.547662 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e47d39-dcc6-4f0c-8236-ccbf727046c3 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:26.554753 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-fcf1495c-741b-4d9b-8371-b04f13d7b2a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2482b199e87f429ebb93a305f5c92c86'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:26.649463 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-fcf1495c-741b-4d9b-8371-b04f13d7b2a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2482b199e87f429ebb93a305f5c92c86'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:26.650391 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-fcf1495c-741b-4d9b-8371-b04f13d7b2a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2482b199e87f429ebb93a305f5c92c86'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:26.679248 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1044/2114] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:20:26 2022] DELETE /identity/v3/users/2482b199e87f429ebb93a305f5c92c86 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:26.681143 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e1f689-b342-4a7c-8ad3-7125003eaacf None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:26.681747 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e1f689-b342-4a7c-8ad3-7125003eaacf None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:26.687076 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e1f689-b342-4a7c-8ad3-7125003eaacf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:26.703066 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-43e1f689-b342-4a7c-8ad3-7125003eaacf None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:26.704732 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-43e1f689-b342-4a7c-8ad3-7125003eaacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:26.740519 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-79e47d39-dcc6-4f0c-8236-ccbf727046c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20a3135ddfe74a938a8621abca888882', 'request_id': 'req-79e47d39-dcc6-4f0c-8236-ccbf727046c3'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:26.758663 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-79e47d39-dcc6-4f0c-8236-ccbf727046c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20a3135ddfe74a938a8621abca888882', 'request_id': 'req-79e47d39-dcc6-4f0c-8236-ccbf727046c3'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:26.769625 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-79e47d39-dcc6-4f0c-8236-ccbf727046c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20a3135ddfe74a938a8621abca888882', 'request_id': 'req-79e47d39-dcc6-4f0c-8236-ccbf727046c3'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:26.842440 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1045/2115] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:20:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:26.857259 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-79e47d39-dcc6-4f0c-8236-ccbf727046c3 admin admin] The token cache is being invalidate because project 20a3135ddfe74a938a8621abca888882 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:20:26.866109 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-79e47d39-dcc6-4f0c-8236-ccbf727046c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:26.866109 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-79e47d39-dcc6-4f0c-8236-ccbf727046c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:26.866109 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1071/2116] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:20:26 2022] DELETE /identity/v3/projects/20a3135ddfe74a938a8621abca888882 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:20:26.866526 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e1f689-b342-4a7c-8ad3-7125003eaacf None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:26.870787 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d44bd-2f45-4920-9844-ce8879495025 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:26.871156 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-43e1f689-b342-4a7c-8ad3-7125003eaacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:26.872979 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d44bd-2f45-4920-9844-ce8879495025 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:26.873625 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d44bd-2f45-4920-9844-ce8879495025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:26.911423 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-a50d44bd-2f45-4920-9844-ce8879495025 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:26.925819 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-a50d44bd-2f45-4920-9844-ce8879495025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:26.951449 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1072/2117] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:20:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:26.959806 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d31a8-fec0-4a8e-bf32-714ac7c18cf5 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:26.960375 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d31a8-fec0-4a8e-bf32-714ac7c18cf5 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:26.960763 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d31a8-fec0-4a8e-bf32-714ac7c18cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:26.973269 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e1f689-b342-4a7c-8ad3-7125003eaacf None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:26.978340 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c5a343-afe3-444c-b9ff-e304612d29b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:26.982209 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5a343-afe3-444c-b9ff-e304612d29b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:26.982209 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5a343-afe3-444c-b9ff-e304612d29b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:26.982209 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5a343-afe3-444c-b9ff-e304612d29b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:26.982209 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-63c5a343-afe3-444c-b9ff-e304612d29b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:27.015550 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c5a343-afe3-444c-b9ff-e304612d29b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:27.020756 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c5a343-afe3-444c-b9ff-e304612d29b4 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:27.037578 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1046/2118] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:20:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:20:27.039487 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-c90d31a8-fec0-4a8e-bf32-714ac7c18cf5 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:27.045726 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-c90d31a8-fec0-4a8e-bf32-714ac7c18cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:27.046062 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c5a343-afe3-444c-b9ff-e304612d29b4 service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:27.049789 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-63c5a343-afe3-444c-b9ff-e304612d29b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:27.063194 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1073/2119] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:20:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:27.074548 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c5a343-afe3-444c-b9ff-e304612d29b4 service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:27.074913 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90d31a8-fec0-4a8e-bf32-714ac7c18cf5 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:27.088574 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65793b5b-9b85-4edd-8c2d-ce5c4fdc74f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:27.091564 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65793b5b-9b85-4edd-8c2d-ce5c4fdc74f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:27.091564 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65793b5b-9b85-4edd-8c2d-ce5c4fdc74f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:27.091564 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65793b5b-9b85-4edd-8c2d-ce5c4fdc74f7 admin admin] PATH_INFO: `/v3/projects/f1e4972138fb46aab245d4dc96f0cfa5` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:27.094575 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65793b5b-9b85-4edd-8c2d-ce5c4fdc74f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1e4972138fb46aab245d4dc96f0cfa5)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:27.096204 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90d31a8-fec0-4a8e-bf32-714ac7c18cf5 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:27.098471 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65793b5b-9b85-4edd-8c2d-ce5c4fdc74f7 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:27.101600 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb00295-a5cd-452e-ac90-6662af536985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:27.102181 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb00295-a5cd-452e-ac90-6662af536985 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:27.102657 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb00295-a5cd-452e-ac90-6662af536985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:27.102974 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb00295-a5cd-452e-ac90-6662af536985 admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:27.103732 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb00295-a5cd-452e-ac90-6662af536985 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:20:27.104837 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb00295-a5cd-452e-ac90-6662af536985 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:27.106926 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb00295-a5cd-452e-ac90-6662af536985 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:27.127850 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1074/2120] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 10 03:20:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:20:27.129554 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb00295-a5cd-452e-ac90-6662af536985 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:27.145997 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb00295-a5cd-452e-ac90-6662af536985 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:27.157768 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e69294-83c9-400b-8ad5-86c007dfb216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:27.158600 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e69294-83c9-400b-8ad5-86c007dfb216 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:27.158964 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e69294-83c9-400b-8ad5-86c007dfb216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:27.159312 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e69294-83c9-400b-8ad5-86c007dfb216 admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:27.160115 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e69294-83c9-400b-8ad5-86c007dfb216 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:27.162098 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e69294-83c9-400b-8ad5-86c007dfb216 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:27.273436 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-65793b5b-9b85-4edd-8c2d-ce5c4fdc74f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1e4972138fb46aab245d4dc96f0cfa5', 'request_id': 'req-65793b5b-9b85-4edd-8c2d-ce5c4fdc74f7'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:27.275162 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1075/2121] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:20:27 2022] POST /identity/v3/projects => generated 371 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:20:27.279151 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e69294-83c9-400b-8ad5-86c007dfb216 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:27.286545 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-65793b5b-9b85-4edd-8c2d-ce5c4fdc74f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1e4972138fb46aab245d4dc96f0cfa5', 'request_id': 'req-65793b5b-9b85-4edd-8c2d-ce5c4fdc74f7'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:27.302852 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-65793b5b-9b85-4edd-8c2d-ce5c4fdc74f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1e4972138fb46aab245d4dc96f0cfa5', 'request_id': 'req-65793b5b-9b85-4edd-8c2d-ce5c4fdc74f7'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:27.407526 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-65793b5b-9b85-4edd-8c2d-ce5c4fdc74f7 admin admin] The token cache is being invalidate because project f1e4972138fb46aab245d4dc96f0cfa5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:20:27.408048 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-65793b5b-9b85-4edd-8c2d-ce5c4fdc74f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:27.415445 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-65793b5b-9b85-4edd-8c2d-ce5c4fdc74f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:27.417520 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e69294-83c9-400b-8ad5-86c007dfb216 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:27.417674 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1047/2122] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:20:27 2022] DELETE /identity/v3/projects/f1e4972138fb46aab245d4dc96f0cfa5 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:27.422409 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c712bc6-7538-4156-a8d1-9c1205c2ec14 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:27.422815 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c712bc6-7538-4156-a8d1-9c1205c2ec14 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:27.423192 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c712bc6-7538-4156-a8d1-9c1205c2ec14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:27.424232 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8ef960-8552-4566-8047-19049a220487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:27.424920 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ef960-8552-4566-8047-19049a220487 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:27.425207 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ef960-8552-4566-8047-19049a220487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:27.425486 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ef960-8552-4566-8047-19049a220487 admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:27.426187 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8ef960-8552-4566-8047-19049a220487 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:27.430009 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8ef960-8552-4566-8047-19049a220487 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:27.461794 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-0c712bc6-7538-4156-a8d1-9c1205c2ec14 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:27.467692 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-0c712bc6-7538-4156-a8d1-9c1205c2ec14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:27.476579 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1048/2123] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:20:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:20:27.489216 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124bd8f-f472-4263-a376-ac9790a30169 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:27.489381 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124bd8f-f472-4263-a376-ac9790a30169 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:27.492080 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124bd8f-f472-4263-a376-ac9790a30169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:27.516926 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-5124bd8f-f472-4263-a376-ac9790a30169 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:27.519900 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-5124bd8f-f472-4263-a376-ac9790a30169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:27.527855 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1049/2124] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:20:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:27.530772 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5124bd8f-f472-4263-a376-ac9790a30169 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:27.542549 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5124bd8f-f472-4263-a376-ac9790a30169 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:27.551624 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1076/2125] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:20:27 2022] POST /identity/v3/users => generated 286 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:20:27.556746 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8ef960-8552-4566-8047-19049a220487 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:27.558590 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-ff8ef960-8552-4566-8047-19049a220487 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:27.560418 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15730fb0-ae9c-4b1c-bc0c-aff0d6aa298b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:27.561185 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15730fb0-ae9c-4b1c-bc0c-aff0d6aa298b admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:27.561471 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15730fb0-ae9c-4b1c-bc0c-aff0d6aa298b admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:27.561748 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15730fb0-ae9c-4b1c-bc0c-aff0d6aa298b admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:27.562485 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15730fb0-ae9c-4b1c-bc0c-aff0d6aa298b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:20:27.562794 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15730fb0-ae9c-4b1c-bc0c-aff0d6aa298b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:27.564478 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15730fb0-ae9c-4b1c-bc0c-aff0d6aa298b admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:27.576150 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8ef960-8552-4566-8047-19049a220487 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:27.581713 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1050/2126] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 10 03:20:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:20:27.582850 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15730fb0-ae9c-4b1c-bc0c-aff0d6aa298b admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:27.585578 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bdd3fe-bfd2-4905-be4f-be1a91fbfec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:27.586365 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bdd3fe-bfd2-4905-be4f-be1a91fbfec8 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:27.586750 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bdd3fe-bfd2-4905-be4f-be1a91fbfec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:27.587319 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bdd3fe-bfd2-4905-be4f-be1a91fbfec8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:27.588239 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bdd3fe-bfd2-4905-be4f-be1a91fbfec8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:27.590415 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bdd3fe-bfd2-4905-be4f-be1a91fbfec8 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:27.593741 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15730fb0-ae9c-4b1c-bc0c-aff0d6aa298b admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:27.599430 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edb76a1-050a-4727-8de8-465a66957db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:27.601094 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb76a1-050a-4727-8de8-465a66957db1 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:27.607132 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb76a1-050a-4727-8de8-465a66957db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:27.607132 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb76a1-050a-4727-8de8-465a66957db1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:27.607132 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edb76a1-050a-4727-8de8-465a66957db1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:27.607423 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1077/2127] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:20:27 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:20:27.607534 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edb76a1-050a-4727-8de8-465a66957db1 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:27.609309 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bdd3fe-bfd2-4905-be4f-be1a91fbfec8 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:27.619567 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bdd3fe-bfd2-4905-be4f-be1a91fbfec8 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:27.627338 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb2339-438d-4cc1-8c2e-5276d6e51388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:27.628347 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb2339-438d-4cc1-8c2e-5276d6e51388 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:27.635851 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb2339-438d-4cc1-8c2e-5276d6e51388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:27.635851 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb2339-438d-4cc1-8c2e-5276d6e51388 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:27.635851 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cb2339-438d-4cc1-8c2e-5276d6e51388 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:27.635851 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cb2339-438d-4cc1-8c2e-5276d6e51388 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:27.648245 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1078/2128] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:20:27 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:20:27.649819 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb2339-438d-4cc1-8c2e-5276d6e51388 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:27.651765 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-01cb2339-438d-4cc1-8c2e-5276d6e51388 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:27.666376 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb2339-438d-4cc1-8c2e-5276d6e51388 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:27.671206 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c07e0d4-d181-4c7d-a075-c93017a80daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:27.672090 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07e0d4-d181-4c7d-a075-c93017a80daa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:27.672375 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07e0d4-d181-4c7d-a075-c93017a80daa admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:27.672709 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07e0d4-d181-4c7d-a075-c93017a80daa admin admin] PATH_INFO: `/v3/projects/ff940a5a38f043c0a8c96208f7e10ac2` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:27.673830 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c07e0d4-d181-4c7d-a075-c93017a80daa admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff940a5a38f043c0a8c96208f7e10ac2)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:27.675813 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c07e0d4-d181-4c7d-a075-c93017a80daa admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:27.721812 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1051/2129] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:20:27 2022] POST /identity/v3/projects => generated 391 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:20:27.721812 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edb76a1-050a-4727-8de8-465a66957db1 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:27.791069 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-3c07e0d4-d181-4c7d-a075-c93017a80daa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff940a5a38f043c0a8c96208f7e10ac2', 'request_id': 'req-3c07e0d4-d181-4c7d-a075-c93017a80daa'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:27.796961 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-3c07e0d4-d181-4c7d-a075-c93017a80daa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff940a5a38f043c0a8c96208f7e10ac2', 'request_id': 'req-3c07e0d4-d181-4c7d-a075-c93017a80daa'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:27.802004 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edb76a1-050a-4727-8de8-465a66957db1 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:27.803656 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-3c07e0d4-d181-4c7d-a075-c93017a80daa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff940a5a38f043c0a8c96208f7e10ac2', 'request_id': 'req-3c07e0d4-d181-4c7d-a075-c93017a80daa'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:27.864613 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f9b95e-1187-404d-bc1e-b41b60964332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:27.868111 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9b95e-1187-404d-bc1e-b41b60964332 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:27.868478 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9b95e-1187-404d-bc1e-b41b60964332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:27.868989 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9b95e-1187-404d-bc1e-b41b60964332 admin admin] PATH_INFO: `/v3/projects/872ea19a444444c4a3b0523189b6f377/users/ee562970cfe64dc58e0e8ba0cf4d643c/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:27.884263 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-3c07e0d4-d181-4c7d-a075-c93017a80daa admin admin] The token cache is being invalidate because project ff940a5a38f043c0a8c96208f7e10ac2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:20:27.886136 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-3c07e0d4-d181-4c7d-a075-c93017a80daa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:27.886136 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-3c07e0d4-d181-4c7d-a075-c93017a80daa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:27.888862 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1079/2130] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:20:27 2022] DELETE /identity/v3/projects/ff940a5a38f043c0a8c96208f7e10ac2 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:27.890229 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c07e0d4-d181-4c7d-a075-c93017a80daa admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:27.894705 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-3c07e0d4-d181-4c7d-a075-c93017a80daa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:27.896400 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f9b95e-1187-404d-bc1e-b41b60964332 admin admin] RBAC: Authorizing `identity:create_grant(project_id=872ea19a444444c4a3b0523189b6f377, user_id=ee562970cfe64dc58e0e8ba0cf4d643c, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:27.900214 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f9b95e-1187-404d-bc1e-b41b60964332 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:27.914408 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c07e0d4-d181-4c7d-a075-c93017a80daa admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:27.924284 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cbd23d-8458-470e-a564-21a99557a80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:27.925038 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cbd23d-8458-470e-a564-21a99557a80d admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:27.925385 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cbd23d-8458-470e-a564-21a99557a80d admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:27.925744 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cbd23d-8458-470e-a564-21a99557a80d admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:27.926595 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cbd23d-8458-470e-a564-21a99557a80d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:27.929103 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cbd23d-8458-470e-a564-21a99557a80d admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:28.005835 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1052/2131] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:20:27 2022] PUT /identity/v3/projects/872ea19a444444c4a3b0523189b6f377/users/ee562970cfe64dc58e0e8ba0cf4d643c/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:28.013121 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f9b95e-1187-404d-bc1e-b41b60964332 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:28.025961 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-45f9b95e-1187-404d-bc1e-b41b60964332 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:28.061375 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1080/2132] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:20:27 2022] POST /identity/v3/users => generated 296 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:20:28.063878 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1b3b2-ec1a-44fc-9cb1-ef61b97f264d None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:28.066046 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1b3b2-ec1a-44fc-9cb1-ef61b97f264d None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:28.066046 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1b3b2-ec1a-44fc-9cb1-ef61b97f264d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:28.115828 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-6de1b3b2-ec1a-44fc-9cb1-ef61b97f264d None None] MFA Rules not processed for user `ee562970cfe64dc58e0e8ba0cf4d643c`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:28.117918 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-6de1b3b2-ec1a-44fc-9cb1-ef61b97f264d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:28.158563 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f9b95e-1187-404d-bc1e-b41b60964332 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:28.163930 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219f9ea-3a3e-4d78-ae52-85ac4af9e1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:28.165351 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219f9ea-3a3e-4d78-ae52-85ac4af9e1f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:28.165786 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219f9ea-3a3e-4d78-ae52-85ac4af9e1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:28.166455 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219f9ea-3a3e-4d78-ae52-85ac4af9e1f1 admin admin] PATH_INFO: `/v3/users/5e064143f4714341921b10669250c159` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:28.176761 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1219f9ea-3a3e-4d78-ae52-85ac4af9e1f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e064143f4714341921b10669250c159)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:28.178868 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1219f9ea-3a3e-4d78-ae52-85ac4af9e1f1 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:28.274728 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1081/2133] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:20:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:28.276169 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de1b3b2-ec1a-44fc-9cb1-ef61b97f264d None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:28.314379 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de1b3b2-ec1a-44fc-9cb1-ef61b97f264d None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:28.330091 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a680d33-e0ab-4832-8ab8-59aaee825128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:28.330783 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a680d33-e0ab-4832-8ab8-59aaee825128 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:28.331062 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a680d33-e0ab-4832-8ab8-59aaee825128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:28.331385 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a680d33-e0ab-4832-8ab8-59aaee825128 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:28.332176 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a680d33-e0ab-4832-8ab8-59aaee825128 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:28.333806 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a680d33-e0ab-4832-8ab8-59aaee825128 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:28.349311 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1082/2134] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:20:28 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:20:28.350327 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a680d33-e0ab-4832-8ab8-59aaee825128 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:28.353629 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-4a680d33-e0ab-4832-8ab8-59aaee825128 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:28.457138 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-1219f9ea-3a3e-4d78-ae52-85ac4af9e1f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e064143f4714341921b10669250c159'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:28.457894 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-1219f9ea-3a3e-4d78-ae52-85ac4af9e1f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e064143f4714341921b10669250c159'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:28.472424 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-1219f9ea-3a3e-4d78-ae52-85ac4af9e1f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e064143f4714341921b10669250c159'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:28.486343 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a680d33-e0ab-4832-8ab8-59aaee825128 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:28.491907 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ac8ca-850c-4723-b3a5-53e0df28f7b4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c79f0a3a3223444c82589da07305469f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:28.492614 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ac8ca-850c-4723-b3a5-53e0df28f7b4 service glance] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:28.492913 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ac8ca-850c-4723-b3a5-53e0df28f7b4 service glance] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:28.493184 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ac8ca-850c-4723-b3a5-53e0df28f7b4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:28.503643 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2ac8ca-850c-4723-b3a5-53e0df28f7b4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:28.505366 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2ac8ca-850c-4723-b3a5-53e0df28f7b4 service glance] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:28.515617 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1083/2135] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:20:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:20:28.516330 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ac8ca-850c-4723-b3a5-53e0df28f7b4 service glance] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:28.527250 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ac8ca-850c-4723-b3a5-53e0df28f7b4 service glance] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:28.532316 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c0e43-5b53-42df-9d6e-f1494f46abd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:28.534766 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c0e43-5b53-42df-9d6e-f1494f46abd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:28.534766 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c0e43-5b53-42df-9d6e-f1494f46abd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:28.534766 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c0e43-5b53-42df-9d6e-f1494f46abd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:28.534766 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855c0e43-5b53-42df-9d6e-f1494f46abd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:28.536116 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855c0e43-5b53-42df-9d6e-f1494f46abd8 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:28.549198 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1084/2136] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:20:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:20:28.554108 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c0e43-5b53-42df-9d6e-f1494f46abd8 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:28.554575 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-1219f9ea-3a3e-4d78-ae52-85ac4af9e1f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e064143f4714341921b10669250c159'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:28.556972 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-1219f9ea-3a3e-4d78-ae52-85ac4af9e1f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e064143f4714341921b10669250c159'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:28.565890 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c0e43-5b53-42df-9d6e-f1494f46abd8 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:28.574074 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e86dc0-2329-4344-a4ce-55299d1cb640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:28.574974 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e86dc0-2329-4344-a4ce-55299d1cb640 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:28.576295 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e86dc0-2329-4344-a4ce-55299d1cb640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:28.576567 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e86dc0-2329-4344-a4ce-55299d1cb640 admin admin] PATH_INFO: `/v3/projects/b3edbd3c70c34107b8ead1333e2b97a2/users/5b9551d0e98545df8a99b37a5cb118df/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:28.588517 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1053/2137] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:20:28 2022] DELETE /identity/v3/users/5e064143f4714341921b10669250c159 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:28.613983 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e86dc0-2329-4344-a4ce-55299d1cb640 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3edbd3c70c34107b8ead1333e2b97a2, user_id=5b9551d0e98545df8a99b37a5cb118df, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:28.617269 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e86dc0-2329-4344-a4ce-55299d1cb640 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:28.718322 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1085/2138] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:20:28 2022] PUT /identity/v3/projects/b3edbd3c70c34107b8ead1333e2b97a2/users/5b9551d0e98545df8a99b37a5cb118df/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:20:28.730499 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913f0d3-2543-4356-9d5b-ab57ef0ed61f None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:28.730908 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913f0d3-2543-4356-9d5b-ab57ef0ed61f None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:28.731580 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913f0d3-2543-4356-9d5b-ab57ef0ed61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:28.804225 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-f913f0d3-2543-4356-9d5b-ab57ef0ed61f None None] MFA Rules not processed for user `5b9551d0e98545df8a99b37a5cb118df`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:28.809532 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-f913f0d3-2543-4356-9d5b-ab57ef0ed61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:28.946669 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1054/2139] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:20:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:28.959522 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e86dc0-2329-4344-a4ce-55299d1cb640 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:28.962120 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-12e86dc0-2329-4344-a4ce-55299d1cb640 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:29.104457 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e86dc0-2329-4344-a4ce-55299d1cb640 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:29.113003 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bc0ac9-bbd2-4c28-a1fa-94c964d41388 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:29.113670 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc0ac9-bbd2-4c28-a1fa-94c964d41388 service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:29.113953 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc0ac9-bbd2-4c28-a1fa-94c964d41388 service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:29.114599 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc0ac9-bbd2-4c28-a1fa-94c964d41388 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:29.133159 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bc0ac9-bbd2-4c28-a1fa-94c964d41388 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:29.134701 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bc0ac9-bbd2-4c28-a1fa-94c964d41388 service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:29.159129 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1086/2140] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:20:28 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:20:29.260434 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f913f0d3-2543-4356-9d5b-ab57ef0ed61f None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:29.262716 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-f913f0d3-2543-4356-9d5b-ab57ef0ed61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:29.363918 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f913f0d3-2543-4356-9d5b-ab57ef0ed61f None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:29.379205 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e0d1de-a1f4-4211-b52a-a13727560560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:29.380597 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0d1de-a1f4-4211-b52a-a13727560560 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:29.381032 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0d1de-a1f4-4211-b52a-a13727560560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:29.382683 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0d1de-a1f4-4211-b52a-a13727560560 admin admin] PATH_INFO: `/v3/projects/bc96016842844bffb9e95d3b0fe0e626` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:29.383131 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e0d1de-a1f4-4211-b52a-a13727560560 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc96016842844bffb9e95d3b0fe0e626)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:29.385263 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e0d1de-a1f4-4211-b52a-a13727560560 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:29.530774 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-b2e0d1de-a1f4-4211-b52a-a13727560560 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc96016842844bffb9e95d3b0fe0e626', 'request_id': 'req-b2e0d1de-a1f4-4211-b52a-a13727560560'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:29.541732 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-b2e0d1de-a1f4-4211-b52a-a13727560560 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc96016842844bffb9e95d3b0fe0e626', 'request_id': 'req-b2e0d1de-a1f4-4211-b52a-a13727560560'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:29.548886 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-b2e0d1de-a1f4-4211-b52a-a13727560560 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc96016842844bffb9e95d3b0fe0e626', 'request_id': 'req-b2e0d1de-a1f4-4211-b52a-a13727560560'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:29.649122 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-b2e0d1de-a1f4-4211-b52a-a13727560560 admin admin] The token cache is being invalidate because project bc96016842844bffb9e95d3b0fe0e626 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:20:29.649364 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-b2e0d1de-a1f4-4211-b52a-a13727560560 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:29.651273 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-b2e0d1de-a1f4-4211-b52a-a13727560560 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:29.655979 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1055/2141] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:20:29 2022] DELETE /identity/v3/projects/bc96016842844bffb9e95d3b0fe0e626 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:29.660937 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6772d-83be-46aa-b66e-fbf4ae616fc1 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:29.661227 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6772d-83be-46aa-b66e-fbf4ae616fc1 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:29.661508 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6772d-83be-46aa-b66e-fbf4ae616fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:29.686987 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-bbe6772d-83be-46aa-b66e-fbf4ae616fc1 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:29.688433 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-bbe6772d-83be-46aa-b66e-fbf4ae616fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:29.790993 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1087/2142] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:20:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:29.801324 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f48db-886e-42f1-b9a4-a8fdb93907d1 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:29.801643 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f48db-886e-42f1-b9a4-a8fdb93907d1 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:29.801926 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f48db-886e-42f1-b9a4-a8fdb93907d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:29.823699 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-ab4f48db-886e-42f1-b9a4-a8fdb93907d1 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:29.825481 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-ab4f48db-886e-42f1-b9a4-a8fdb93907d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:29.841812 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1056/2143] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:20:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:29.846413 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe6772d-83be-46aa-b66e-fbf4ae616fc1 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:29.858456 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe6772d-83be-46aa-b66e-fbf4ae616fc1 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:29.871635 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf9c35-2182-4008-a33c-abf90e9072b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:29.871635 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf9c35-2182-4008-a33c-abf90e9072b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:29.871635 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf9c35-2182-4008-a33c-abf90e9072b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:29.871635 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf9c35-2182-4008-a33c-abf90e9072b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:29.872181 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf9c35-2182-4008-a33c-abf90e9072b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:20:29.872181 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf9c35-2182-4008-a33c-abf90e9072b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:29.872181 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf9c35-2182-4008-a33c-abf90e9072b2 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:29.879981 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1088/2144] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 10 03:20:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:20:29.885108 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f48db-886e-42f1-b9a4-a8fdb93907d1 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:29.894543 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f48db-886e-42f1-b9a4-a8fdb93907d1 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:29.899408 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2882a2f6-a750-4006-8129-a51c614b3bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:29.900089 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882a2f6-a750-4006-8129-a51c614b3bb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:29.900371 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882a2f6-a750-4006-8129-a51c614b3bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:29.900673 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882a2f6-a750-4006-8129-a51c614b3bb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:29.901356 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2882a2f6-a750-4006-8129-a51c614b3bb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:29.903259 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2882a2f6-a750-4006-8129-a51c614b3bb6 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:30.047530 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1057/2145] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:20:29 2022] POST /identity/v3/projects => generated 377 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:20:30.051774 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf9c35-2182-4008-a33c-abf90e9072b2 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:30.063295 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf9c35-2182-4008-a33c-abf90e9072b2 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:30.133813 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9facabc-ff44-4778-b6ce-f58d92f0197d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:30.134681 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9facabc-ff44-4778-b6ce-f58d92f0197d admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:30.135210 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9facabc-ff44-4778-b6ce-f58d92f0197d admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:30.135489 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9facabc-ff44-4778-b6ce-f58d92f0197d admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:30.136663 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9facabc-ff44-4778-b6ce-f58d92f0197d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:30.138666 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9facabc-ff44-4778-b6ce-f58d92f0197d admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:30.279336 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1089/2146] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:20:30 2022] POST /identity/v3/users => generated 289 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:20:30.280459 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2882a2f6-a750-4006-8129-a51c614b3bb6 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:30.293759 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2882a2f6-a750-4006-8129-a51c614b3bb6 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:30.299215 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d43635-06bb-408c-91c6-a17bb0def02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:30.300184 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d43635-06bb-408c-91c6-a17bb0def02b admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:30.300616 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d43635-06bb-408c-91c6-a17bb0def02b admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:30.300900 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d43635-06bb-408c-91c6-a17bb0def02b admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:30.301642 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d43635-06bb-408c-91c6-a17bb0def02b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:30.303925 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d43635-06bb-408c-91c6-a17bb0def02b admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:30.320664 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1058/2147] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:20:30 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:20:30.325243 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9facabc-ff44-4778-b6ce-f58d92f0197d admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:30.336906 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9facabc-ff44-4778-b6ce-f58d92f0197d admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:30.343714 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1155b1-f058-48f2-9b5e-b999ab0c6463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:30.344516 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1155b1-f058-48f2-9b5e-b999ab0c6463 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:30.344867 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1155b1-f058-48f2-9b5e-b999ab0c6463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:30.345218 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1155b1-f058-48f2-9b5e-b999ab0c6463 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:30.346023 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1155b1-f058-48f2-9b5e-b999ab0c6463 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:30.347974 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1155b1-f058-48f2-9b5e-b999ab0c6463 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:30.365095 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1090/2148] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:20:30 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:20:30.368583 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d43635-06bb-408c-91c6-a17bb0def02b admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:30.380876 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d43635-06bb-408c-91c6-a17bb0def02b admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:30.387110 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7eb3c3-78af-4128-a51e-e8123271e9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:30.391165 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7eb3c3-78af-4128-a51e-e8123271e9af admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:30.391165 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7eb3c3-78af-4128-a51e-e8123271e9af admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:30.391165 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7eb3c3-78af-4128-a51e-e8123271e9af admin admin] PATH_INFO: `/v3/projects/08e3e3c271b44aa1a0e2e5e01eb76173/users/c8a842fbb2984f468acba75a56e65c8a/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:30.407798 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7eb3c3-78af-4128-a51e-e8123271e9af admin admin] RBAC: Authorizing `identity:create_grant(project_id=08e3e3c271b44aa1a0e2e5e01eb76173, user_id=c8a842fbb2984f468acba75a56e65c8a, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:30.411867 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7eb3c3-78af-4128-a51e-e8123271e9af admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:30.503478 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1059/2149] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:20:30 2022] PUT /identity/v3/projects/08e3e3c271b44aa1a0e2e5e01eb76173/users/c8a842fbb2984f468acba75a56e65c8a/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:30.516800 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c063b07-69df-4ffc-8676-3164bd5769b2 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:30.517243 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c063b07-69df-4ffc-8676-3164bd5769b2 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:30.518060 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c063b07-69df-4ffc-8676-3164bd5769b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:30.561905 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-5c063b07-69df-4ffc-8676-3164bd5769b2 None None] MFA Rules not processed for user `c8a842fbb2984f468acba75a56e65c8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:30.563763 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-5c063b07-69df-4ffc-8676-3164bd5769b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:30.696053 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1091/2150] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:20:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:30.699277 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7eb3c3-78af-4128-a51e-e8123271e9af admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:30.853435 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7eb3c3-78af-4128-a51e-e8123271e9af admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:30.870954 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c800e4a-8787-4f0c-9eb6-a397b446bf31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:30.872149 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c800e4a-8787-4f0c-9eb6-a397b446bf31 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:30.872888 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c800e4a-8787-4f0c-9eb6-a397b446bf31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:30.873312 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c800e4a-8787-4f0c-9eb6-a397b446bf31 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:30.874168 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c800e4a-8787-4f0c-9eb6-a397b446bf31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:30.881284 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c800e4a-8787-4f0c-9eb6-a397b446bf31 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:31.004340 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1060/2151] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:20:30 2022] POST /identity/v3/projects => generated 377 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:20:31.007051 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c063b07-69df-4ffc-8676-3164bd5769b2 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:31.034768 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c063b07-69df-4ffc-8676-3164bd5769b2 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:31.153270 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fafb2d-cfba-4343-8a03-43c674c6e25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:31.154744 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fafb2d-cfba-4343-8a03-43c674c6e25b admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:31.156720 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fafb2d-cfba-4343-8a03-43c674c6e25b admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:31.157183 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fafb2d-cfba-4343-8a03-43c674c6e25b admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:31.167723 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fafb2d-cfba-4343-8a03-43c674c6e25b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:31.167723 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fafb2d-cfba-4343-8a03-43c674c6e25b admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:31.292991 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1092/2152] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:20:31 2022] POST /identity/v3/users => generated 295 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:20:31.293681 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c800e4a-8787-4f0c-9eb6-a397b446bf31 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:31.307094 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c800e4a-8787-4f0c-9eb6-a397b446bf31 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:31.316873 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82ffca6-eace-4423-b39e-cedb9970f7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:31.319885 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ffca6-eace-4423-b39e-cedb9970f7c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:31.320393 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ffca6-eace-4423-b39e-cedb9970f7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:31.320829 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ffca6-eace-4423-b39e-cedb9970f7c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:31.321740 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82ffca6-eace-4423-b39e-cedb9970f7c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:31.323688 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82ffca6-eace-4423-b39e-cedb9970f7c8 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:31.335191 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1061/2153] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:20:31 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:20:31.339812 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fafb2d-cfba-4343-8a03-43c674c6e25b admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:31.356034 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fafb2d-cfba-4343-8a03-43c674c6e25b admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:31.361707 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8fbd9a-2444-4251-8e5f-7eb4c79a744d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:31.368609 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8fbd9a-2444-4251-8e5f-7eb4c79a744d admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:31.368609 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8fbd9a-2444-4251-8e5f-7eb4c79a744d admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:31.368609 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8fbd9a-2444-4251-8e5f-7eb4c79a744d admin admin] PATH_INFO: `/v3/projects/c0409e9268c24f1893e0beea0a58a8b5/users/305eac4189724288ad4e8b43a35b811b/roles/43105000610f402ca2486e7648018cca` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:31.379480 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8fbd9a-2444-4251-8e5f-7eb4c79a744d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0409e9268c24f1893e0beea0a58a8b5, user_id=305eac4189724288ad4e8b43a35b811b, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:31.382864 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8fbd9a-2444-4251-8e5f-7eb4c79a744d admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:31.488438 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1093/2154] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:20:31 2022] PUT /identity/v3/projects/c0409e9268c24f1893e0beea0a58a8b5/users/305eac4189724288ad4e8b43a35b811b/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:31.492893 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82ffca6-eace-4423-b39e-cedb9970f7c8 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:31.504312 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82ffca6-eace-4423-b39e-cedb9970f7c8 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:31.576260 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca25c0-167b-438b-ace9-9bc9e7caaa89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:31.577203 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca25c0-167b-438b-ace9-9bc9e7caaa89 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:31.578061 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca25c0-167b-438b-ace9-9bc9e7caaa89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:31.578061 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca25c0-167b-438b-ace9-9bc9e7caaa89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:31.578724 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca25c0-167b-438b-ace9-9bc9e7caaa89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:31.580510 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca25c0-167b-438b-ace9-9bc9e7caaa89 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:31.608044 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1062/2155] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:20:31 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:20:31.618427 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8fbd9a-2444-4251-8e5f-7eb4c79a744d admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:31.629184 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8fbd9a-2444-4251-8e5f-7eb4c79a744d admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:31.641956 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3b334-ae76-45fe-af5c-b76915ef8383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:31.642870 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3b334-ae76-45fe-af5c-b76915ef8383 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:31.643156 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3b334-ae76-45fe-af5c-b76915ef8383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:31.643442 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3b334-ae76-45fe-af5c-b76915ef8383 admin admin] PATH_INFO: `/v3/projects/c0409e9268c24f1893e0beea0a58a8b5/users/305eac4189724288ad4e8b43a35b811b/roles/43105000610f402ca2486e7648018cca` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:31.645722 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d3b334-ae76-45fe-af5c-b76915ef8383 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0409e9268c24f1893e0beea0a58a8b5, user_id=305eac4189724288ad4e8b43a35b811b, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:31.648619 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d3b334-ae76-45fe-af5c-b76915ef8383 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:31.665805 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1094/2156] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:20:31 2022] PUT /identity/v3/projects/c0409e9268c24f1893e0beea0a58a8b5/users/305eac4189724288ad4e8b43a35b811b/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:31.677094 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eca387-dfd7-4b33-8805-07058b49cd74 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:31.684910 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eca387-dfd7-4b33-8805-07058b49cd74 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:31.684910 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eca387-dfd7-4b33-8805-07058b49cd74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:31.708602 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-f8eca387-dfd7-4b33-8805-07058b49cd74 None None] MFA Rules not processed for user `305eac4189724288ad4e8b43a35b811b`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:31.719060 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-f8eca387-dfd7-4b33-8805-07058b49cd74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:31.781381 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1063/2157] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:20:31 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:31.794845 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3b334-ae76-45fe-af5c-b76915ef8383 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:31.796613 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-32d3b334-ae76-45fe-af5c-b76915ef8383 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:31.877748 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3b334-ae76-45fe-af5c-b76915ef8383 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:31.881733 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7b6c6-09dc-4833-8aa8-415348e7be1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:31.882480 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7b6c6-09dc-4833-8aa8-415348e7be1e service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:31.882876 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7b6c6-09dc-4833-8aa8-415348e7be1e service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:31.884218 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7b6c6-09dc-4833-8aa8-415348e7be1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:31.948441 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c7b6c6-09dc-4833-8aa8-415348e7be1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:31.951350 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c7b6c6-09dc-4833-8aa8-415348e7be1e service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:31.964150 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1095/2158] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:20:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:20:33.386780 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908021a5-5105-4e5f-8449-3cc6f02b6c4e None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:33.387305 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908021a5-5105-4e5f-8449-3cc6f02b6c4e None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:33.387396 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908021a5-5105-4e5f-8449-3cc6f02b6c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:33.417642 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-908021a5-5105-4e5f-8449-3cc6f02b6c4e None None] MFA Rules not processed for user `d0a7ce96f7f545319669312c8f4590e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:33.418941 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-908021a5-5105-4e5f-8449-3cc6f02b6c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:33.524164 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1064/2159] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:20:33 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:33.541215 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7b6c6-09dc-4833-8aa8-415348e7be1e service cinder] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:33.542688 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-b4c7b6c6-09dc-4833-8aa8-415348e7be1e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:33.618862 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7b6c6-09dc-4833-8aa8-415348e7be1e service cinder] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:33.624404 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a98d262-be8b-4a76-8282-8fbb6b4ff5d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b7ccdccba0b4f9e86817946f22dbe28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:33.625060 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98d262-be8b-4a76-8282-8fbb6b4ff5d8 service nova] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:33.625347 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98d262-be8b-4a76-8282-8fbb6b4ff5d8 service nova] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:33.625647 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98d262-be8b-4a76-8282-8fbb6b4ff5d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:33.627425 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-2a98d262-be8b-4a76-8282-8fbb6b4ff5d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:33.684269 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a98d262-be8b-4a76-8282-8fbb6b4ff5d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:33.685930 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a98d262-be8b-4a76-8282-8fbb6b4ff5d8 service nova] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:33.696194 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1096/2160] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:20:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:20:33.807119 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908021a5-5105-4e5f-8449-3cc6f02b6c4e None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:33.819190 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908021a5-5105-4e5f-8449-3cc6f02b6c4e None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:33.827931 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644601aa-3e50-451f-97ab-2b008a52a527 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:33.828816 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644601aa-3e50-451f-97ab-2b008a52a527 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:33.829101 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644601aa-3e50-451f-97ab-2b008a52a527 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:33.830082 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644601aa-3e50-451f-97ab-2b008a52a527 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:33.843758 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644601aa-3e50-451f-97ab-2b008a52a527 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:33.845459 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644601aa-3e50-451f-97ab-2b008a52a527 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:33.856870 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1065/2161] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:20:33 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:20:36.644818 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20ae67-0577-4460-bd96-d5dcb8b1698a None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:36.645363 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20ae67-0577-4460-bd96-d5dcb8b1698a None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:36.645363 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20ae67-0577-4460-bd96-d5dcb8b1698a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:36.667917 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-af20ae67-0577-4460-bd96-d5dcb8b1698a None None] MFA Rules not processed for user `a49b27f57e9049518e157d39f6901bd7`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:36.670646 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-af20ae67-0577-4460-bd96-d5dcb8b1698a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:36.678092 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1097/2162] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:20:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:20:38.468708 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644601aa-3e50-451f-97ab-2b008a52a527 service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:38.531868 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644601aa-3e50-451f-97ab-2b008a52a527 service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:38.537085 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e78ed-d4fc-49cb-b6f1-bb21dae5ebd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:38.538042 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e78ed-d4fc-49cb-b6f1-bb21dae5ebd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:38.538333 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e78ed-d4fc-49cb-b6f1-bb21dae5ebd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:38.539691 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e78ed-d4fc-49cb-b6f1-bb21dae5ebd6 admin admin] PATH_INFO: `/v3/users/c8a842fbb2984f468acba75a56e65c8a` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:38.540288 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149e78ed-d4fc-49cb-b6f1-bb21dae5ebd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8a842fbb2984f468acba75a56e65c8a)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:38.542316 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149e78ed-d4fc-49cb-b6f1-bb21dae5ebd6 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:38.755582 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-149e78ed-d4fc-49cb-b6f1-bb21dae5ebd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8a842fbb2984f468acba75a56e65c8a'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:38.756793 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-149e78ed-d4fc-49cb-b6f1-bb21dae5ebd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8a842fbb2984f468acba75a56e65c8a'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:38.766902 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-149e78ed-d4fc-49cb-b6f1-bb21dae5ebd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8a842fbb2984f468acba75a56e65c8a'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:38.832473 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-149e78ed-d4fc-49cb-b6f1-bb21dae5ebd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8a842fbb2984f468acba75a56e65c8a'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:38.833824 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-149e78ed-d4fc-49cb-b6f1-bb21dae5ebd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8a842fbb2984f468acba75a56e65c8a'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:38.869145 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1066/2163] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:20:38 2022] DELETE /identity/v3/users/c8a842fbb2984f468acba75a56e65c8a => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:38.879399 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698fd17f-7e57-4efd-bdc3-ec7169592893 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:38.879796 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698fd17f-7e57-4efd-bdc3-ec7169592893 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:38.879959 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698fd17f-7e57-4efd-bdc3-ec7169592893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:38.897733 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-698fd17f-7e57-4efd-bdc3-ec7169592893 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:38.898932 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-698fd17f-7e57-4efd-bdc3-ec7169592893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:38.964424 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1098/2164] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:20:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:38.973507 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e78ed-d4fc-49cb-b6f1-bb21dae5ebd6 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:38.974953 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-149e78ed-d4fc-49cb-b6f1-bb21dae5ebd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:39.041092 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e78ed-d4fc-49cb-b6f1-bb21dae5ebd6 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:39.044766 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f307ecc2-1b1c-4e1f-a3e2-fccfe6669603 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:39.045408 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f307ecc2-1b1c-4e1f-a3e2-fccfe6669603 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:39.045690 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f307ecc2-1b1c-4e1f-a3e2-fccfe6669603 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:39.045963 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f307ecc2-1b1c-4e1f-a3e2-fccfe6669603 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:39.057652 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f307ecc2-1b1c-4e1f-a3e2-fccfe6669603 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:39.059231 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f307ecc2-1b1c-4e1f-a3e2-fccfe6669603 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:39.072054 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1067/2165] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:20:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:20:39.505098 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698fd17f-7e57-4efd-bdc3-ec7169592893 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:39.506753 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-698fd17f-7e57-4efd-bdc3-ec7169592893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:39.522003 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698fd17f-7e57-4efd-bdc3-ec7169592893 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:39.526773 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbd59e8-7bf7-4dca-876f-d1f485ceeaab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:39.527638 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd59e8-7bf7-4dca-876f-d1f485ceeaab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:39.527920 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd59e8-7bf7-4dca-876f-d1f485ceeaab admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:39.528230 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd59e8-7bf7-4dca-876f-d1f485ceeaab admin admin] PATH_INFO: `/v3/projects/08e3e3c271b44aa1a0e2e5e01eb76173` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:39.529411 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbd59e8-7bf7-4dca-876f-d1f485ceeaab admin admin] RBAC: Authorizing `identity:delete_project(project_id=08e3e3c271b44aa1a0e2e5e01eb76173)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:39.531310 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbd59e8-7bf7-4dca-876f-d1f485ceeaab admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:39.638763 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-8fbd59e8-7bf7-4dca-876f-d1f485ceeaab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08e3e3c271b44aa1a0e2e5e01eb76173', 'request_id': 'req-8fbd59e8-7bf7-4dca-876f-d1f485ceeaab'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:39.644523 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-8fbd59e8-7bf7-4dca-876f-d1f485ceeaab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08e3e3c271b44aa1a0e2e5e01eb76173', 'request_id': 'req-8fbd59e8-7bf7-4dca-876f-d1f485ceeaab'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:39.651213 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-8fbd59e8-7bf7-4dca-876f-d1f485ceeaab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08e3e3c271b44aa1a0e2e5e01eb76173', 'request_id': 'req-8fbd59e8-7bf7-4dca-876f-d1f485ceeaab'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:39.739531 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-8fbd59e8-7bf7-4dca-876f-d1f485ceeaab admin admin] The token cache is being invalidate because project 08e3e3c271b44aa1a0e2e5e01eb76173 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:20:39.739531 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-8fbd59e8-7bf7-4dca-876f-d1f485ceeaab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:39.739531 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-8fbd59e8-7bf7-4dca-876f-d1f485ceeaab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:39.739531 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1099/2166] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:20:39 2022] DELETE /identity/v3/projects/08e3e3c271b44aa1a0e2e5e01eb76173 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:39.742761 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f307ecc2-1b1c-4e1f-a3e2-fccfe6669603 service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:39.753266 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f307ecc2-1b1c-4e1f-a3e2-fccfe6669603 service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:39.812673 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df411f7a-e470-4d05-b7f1-bd7d217684a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:39.820321 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df411f7a-e470-4d05-b7f1-bd7d217684a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:39.820321 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df411f7a-e470-4d05-b7f1-bd7d217684a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:39.820321 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df411f7a-e470-4d05-b7f1-bd7d217684a8 admin admin] PATH_INFO: `/v3/users/305eac4189724288ad4e8b43a35b811b` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:39.820321 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df411f7a-e470-4d05-b7f1-bd7d217684a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=305eac4189724288ad4e8b43a35b811b)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:39.820321 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df411f7a-e470-4d05-b7f1-bd7d217684a8 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:39.986502 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-df411f7a-e470-4d05-b7f1-bd7d217684a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '305eac4189724288ad4e8b43a35b811b'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:39.987177 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-df411f7a-e470-4d05-b7f1-bd7d217684a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '305eac4189724288ad4e8b43a35b811b'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:39.994348 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-df411f7a-e470-4d05-b7f1-bd7d217684a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '305eac4189724288ad4e8b43a35b811b'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:40.047520 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-df411f7a-e470-4d05-b7f1-bd7d217684a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '305eac4189724288ad4e8b43a35b811b'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:40.048175 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-df411f7a-e470-4d05-b7f1-bd7d217684a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '305eac4189724288ad4e8b43a35b811b'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:40.066366 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1068/2167] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:20:39 2022] DELETE /identity/v3/users/305eac4189724288ad4e8b43a35b811b => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:40.494666 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbd59e8-7bf7-4dca-876f-d1f485ceeaab admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:40.498328 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-8fbd59e8-7bf7-4dca-876f-d1f485ceeaab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:40.515940 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbd59e8-7bf7-4dca-876f-d1f485ceeaab admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:40.576663 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ddfc6d-e852-4483-aada-b5a46f07b0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:40.577663 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ddfc6d-e852-4483-aada-b5a46f07b0de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:40.577999 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ddfc6d-e852-4483-aada-b5a46f07b0de admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:40.578403 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ddfc6d-e852-4483-aada-b5a46f07b0de admin admin] PATH_INFO: `/v3/projects/c0409e9268c24f1893e0beea0a58a8b5` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:40.579716 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ddfc6d-e852-4483-aada-b5a46f07b0de admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0409e9268c24f1893e0beea0a58a8b5)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:40.581933 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ddfc6d-e852-4483-aada-b5a46f07b0de admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:40.692863 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-f2ddfc6d-e852-4483-aada-b5a46f07b0de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0409e9268c24f1893e0beea0a58a8b5', 'request_id': 'req-f2ddfc6d-e852-4483-aada-b5a46f07b0de'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:40.698277 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-f2ddfc6d-e852-4483-aada-b5a46f07b0de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0409e9268c24f1893e0beea0a58a8b5', 'request_id': 'req-f2ddfc6d-e852-4483-aada-b5a46f07b0de'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:40.704278 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-f2ddfc6d-e852-4483-aada-b5a46f07b0de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0409e9268c24f1893e0beea0a58a8b5', 'request_id': 'req-f2ddfc6d-e852-4483-aada-b5a46f07b0de'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:40.790624 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-f2ddfc6d-e852-4483-aada-b5a46f07b0de admin admin] The token cache is being invalidate because project c0409e9268c24f1893e0beea0a58a8b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:20:40.790835 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-f2ddfc6d-e852-4483-aada-b5a46f07b0de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:40.791470 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-f2ddfc6d-e852-4483-aada-b5a46f07b0de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:40.793319 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1100/2168] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:20:40 2022] DELETE /identity/v3/projects/c0409e9268c24f1893e0beea0a58a8b5 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:40.798428 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f290ab0e-fc02-4a93-89b9-b4bbf1a28af0 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:40.798887 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f290ab0e-fc02-4a93-89b9-b4bbf1a28af0 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:40.799001 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f290ab0e-fc02-4a93-89b9-b4bbf1a28af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:40.818195 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-f290ab0e-fc02-4a93-89b9-b4bbf1a28af0 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:40.819553 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-f290ab0e-fc02-4a93-89b9-b4bbf1a28af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:40.880087 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1069/2169] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:20:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:20:40.888148 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ec1b8-0089-4235-ae66-e1d861430a33 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:40.888436 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ec1b8-0089-4235-ae66-e1d861430a33 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:40.888713 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ec1b8-0089-4235-ae66-e1d861430a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:40.906679 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-806ec1b8-0089-4235-ae66-e1d861430a33 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:40.907858 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-806ec1b8-0089-4235-ae66-e1d861430a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:40.919856 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1101/2170] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:20:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:40.921154 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f290ab0e-fc02-4a93-89b9-b4bbf1a28af0 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:40.932183 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f290ab0e-fc02-4a93-89b9-b4bbf1a28af0 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:40.937102 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d4a719-a263-4f3f-92cd-224a24966a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:40.937843 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4a719-a263-4f3f-92cd-224a24966a88 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:40.938190 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4a719-a263-4f3f-92cd-224a24966a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:40.938537 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4a719-a263-4f3f-92cd-224a24966a88 admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:40.939393 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d4a719-a263-4f3f-92cd-224a24966a88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:20:40.939770 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d4a719-a263-4f3f-92cd-224a24966a88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:40.941610 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d4a719-a263-4f3f-92cd-224a24966a88 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:40.966096 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1070/2171] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 10 03:20:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:20:40.970645 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ec1b8-0089-4235-ae66-e1d861430a33 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:40.988145 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ec1b8-0089-4235-ae66-e1d861430a33 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:40.993803 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3babbf-2bca-461c-915f-ae7784dd2438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:40.994616 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3babbf-2bca-461c-915f-ae7784dd2438 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:40.994979 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3babbf-2bca-461c-915f-ae7784dd2438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:40.995302 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3babbf-2bca-461c-915f-ae7784dd2438 admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:40.996031 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3babbf-2bca-461c-915f-ae7784dd2438 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:40.997976 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3babbf-2bca-461c-915f-ae7784dd2438 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:41.098354 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1102/2172] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:20:40 2022] POST /identity/v3/projects => generated 385 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:20:41.103467 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d4a719-a263-4f3f-92cd-224a24966a88 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:41.113361 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d4a719-a263-4f3f-92cd-224a24966a88 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:41.172311 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b14df4a-4fa5-4f64-b2af-0cc8de4f9015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:41.172986 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14df4a-4fa5-4f64-b2af-0cc8de4f9015 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:41.173302 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14df4a-4fa5-4f64-b2af-0cc8de4f9015 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:41.173579 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14df4a-4fa5-4f64-b2af-0cc8de4f9015 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:41.174300 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b14df4a-4fa5-4f64-b2af-0cc8de4f9015 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:41.176230 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b14df4a-4fa5-4f64-b2af-0cc8de4f9015 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:41.291888 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1071/2173] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:20:41 2022] POST /identity/v3/users => generated 293 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:20:41.293297 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3babbf-2bca-461c-915f-ae7784dd2438 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:41.305197 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3babbf-2bca-461c-915f-ae7784dd2438 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:41.310282 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74035548-a485-4326-a5aa-edb1ef473be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:41.311023 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74035548-a485-4326-a5aa-edb1ef473be8 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:41.311308 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74035548-a485-4326-a5aa-edb1ef473be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:41.313253 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74035548-a485-4326-a5aa-edb1ef473be8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:41.313253 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74035548-a485-4326-a5aa-edb1ef473be8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:41.314225 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74035548-a485-4326-a5aa-edb1ef473be8 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:41.329116 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1103/2174] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:20:41.330426 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b14df4a-4fa5-4f64-b2af-0cc8de4f9015 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:41.342112 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b14df4a-4fa5-4f64-b2af-0cc8de4f9015 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:41.346815 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee9397-bf32-4625-9878-a76d88c98298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:41.347481 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee9397-bf32-4625-9878-a76d88c98298 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:41.347780 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee9397-bf32-4625-9878-a76d88c98298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:41.348071 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee9397-bf32-4625-9878-a76d88c98298 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:41.349136 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeee9397-bf32-4625-9878-a76d88c98298 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:41.352598 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeee9397-bf32-4625-9878-a76d88c98298 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:41.364969 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1072/2175] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:20:41.368963 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74035548-a485-4326-a5aa-edb1ef473be8 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:41.379729 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74035548-a485-4326-a5aa-edb1ef473be8 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:41.384564 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9228901b-2836-43ac-9ee9-80095a072aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:41.385454 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228901b-2836-43ac-9ee9-80095a072aad admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:41.385742 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228901b-2836-43ac-9ee9-80095a072aad admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:41.386018 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228901b-2836-43ac-9ee9-80095a072aad admin admin] PATH_INFO: `/v3/projects/8f682bc0a56144e48af5dbdd32ca2653/users/a49d58cd37964783b36a9e45a622f383/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:41.402524 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9228901b-2836-43ac-9ee9-80095a072aad admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f682bc0a56144e48af5dbdd32ca2653, user_id=a49d58cd37964783b36a9e45a622f383, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:41.405476 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9228901b-2836-43ac-9ee9-80095a072aad admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:41.487647 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1104/2176] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:20:41 2022] PUT /identity/v3/projects/8f682bc0a56144e48af5dbdd32ca2653/users/a49d58cd37964783b36a9e45a622f383/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:20:41.505857 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50c637-2e56-4487-8064-b3a426ef83a5 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:41.505857 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50c637-2e56-4487-8064-b3a426ef83a5 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:41.505857 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50c637-2e56-4487-8064-b3a426ef83a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:41.545609 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-cb50c637-2e56-4487-8064-b3a426ef83a5 None None] MFA Rules not processed for user `a49d58cd37964783b36a9e45a622f383`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:41.546812 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-cb50c637-2e56-4487-8064-b3a426ef83a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:41.555497 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9228901b-2836-43ac-9ee9-80095a072aad admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:41.557462 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-9228901b-2836-43ac-9ee9-80095a072aad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:41.645073 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9228901b-2836-43ac-9ee9-80095a072aad admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:41.650396 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad68495-49f7-49cb-a759-bccfd6f2f65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:41.651288 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad68495-49f7-49cb-a759-bccfd6f2f65f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:41.651556 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad68495-49f7-49cb-a759-bccfd6f2f65f admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:41.651904 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad68495-49f7-49cb-a759-bccfd6f2f65f admin admin] PATH_INFO: `/v3/users/5b9551d0e98545df8a99b37a5cb118df` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:41.653079 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad68495-49f7-49cb-a759-bccfd6f2f65f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b9551d0e98545df8a99b37a5cb118df)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:41.655027 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad68495-49f7-49cb-a759-bccfd6f2f65f admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:41.660872 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1073/2177] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:20:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:41.665386 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb50c637-2e56-4487-8064-b3a426ef83a5 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:41.677133 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb50c637-2e56-4487-8064-b3a426ef83a5 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:41.689886 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b34b14-9e01-46a5-ad31-7b802d931568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:41.690576 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b34b14-9e01-46a5-ad31-7b802d931568 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:41.690858 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b34b14-9e01-46a5-ad31-7b802d931568 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:41.691135 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b34b14-9e01-46a5-ad31-7b802d931568 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:41.691832 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b34b14-9e01-46a5-ad31-7b802d931568 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:41.693785 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b34b14-9e01-46a5-ad31-7b802d931568 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:41.817328 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1074/2178] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:20:41 2022] POST /identity/v3/projects => generated 387 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:20:41.819060 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b34b14-9e01-46a5-ad31-7b802d931568 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:41.859118 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-0ad68495-49f7-49cb-a759-bccfd6f2f65f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b9551d0e98545df8a99b37a5cb118df'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:41.865791 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-0ad68495-49f7-49cb-a759-bccfd6f2f65f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b9551d0e98545df8a99b37a5cb118df'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:41.877624 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-0ad68495-49f7-49cb-a759-bccfd6f2f65f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b9551d0e98545df8a99b37a5cb118df'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:41.878368 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-0ad68495-49f7-49cb-a759-bccfd6f2f65f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b9551d0e98545df8a99b37a5cb118df'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:41.879000 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-0ad68495-49f7-49cb-a759-bccfd6f2f65f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b9551d0e98545df8a99b37a5cb118df'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:41.880893 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b34b14-9e01-46a5-ad31-7b802d931568 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:41.885820 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f4687f-25b3-4860-b1e7-29fdbd2a1349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:41.886509 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4687f-25b3-4860-b1e7-29fdbd2a1349 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:41.886891 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4687f-25b3-4860-b1e7-29fdbd2a1349 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:41.887191 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4687f-25b3-4860-b1e7-29fdbd2a1349 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:41.888023 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f4687f-25b3-4860-b1e7-29fdbd2a1349 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:41.890546 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f4687f-25b3-4860-b1e7-29fdbd2a1349 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:41.958816 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1105/2179] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:20:41 2022] DELETE /identity/v3/users/5b9551d0e98545df8a99b37a5cb118df => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:20:41.964224 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f569c3-89a3-49cc-8eb7-27a7e95f9408 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:41.964224 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f569c3-89a3-49cc-8eb7-27a7e95f9408 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:41.964514 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f569c3-89a3-49cc-8eb7-27a7e95f9408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:41.989073 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-39f569c3-89a3-49cc-8eb7-27a7e95f9408 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:41.990282 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-39f569c3-89a3-49cc-8eb7-27a7e95f9408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:41.992786 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1075/2180] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:20:41 2022] POST /identity/v3/users => generated 300 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:20:41.994093 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f4687f-25b3-4860-b1e7-29fdbd2a1349 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:41.996822 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-f8f4687f-25b3-4860-b1e7-29fdbd2a1349 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:42.012885 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f4687f-25b3-4860-b1e7-29fdbd2a1349 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:42.059247 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1106/2181] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:20:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:20:42.068604 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f569c3-89a3-49cc-8eb7-27a7e95f9408 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:42.070029 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-39f569c3-89a3-49cc-8eb7-27a7e95f9408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:42.071067 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4b0082-0685-4962-a8af-56f8e57a1b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:42.071845 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b0082-0685-4962-a8af-56f8e57a1b2c admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:42.072161 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b0082-0685-4962-a8af-56f8e57a1b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:42.072463 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b0082-0685-4962-a8af-56f8e57a1b2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:42.073196 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4b0082-0685-4962-a8af-56f8e57a1b2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:42.074971 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4b0082-0685-4962-a8af-56f8e57a1b2c admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:42.088542 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1076/2182] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:20:42.089695 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4b0082-0685-4962-a8af-56f8e57a1b2c admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:42.100263 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4b0082-0685-4962-a8af-56f8e57a1b2c admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:42.105999 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc6b6f7-d8ce-4608-8a3e-44dfdfbfb8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:42.106925 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6b6f7-d8ce-4608-8a3e-44dfdfbfb8d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:42.107209 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6b6f7-d8ce-4608-8a3e-44dfdfbfb8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:42.107490 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6b6f7-d8ce-4608-8a3e-44dfdfbfb8d5 admin admin] PATH_INFO: `/v3/projects/4fda0c673de140229a53c029ab947286/users/2ca7151bebd44b1185298314a53913f5/roles/43105000610f402ca2486e7648018cca` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:42.122217 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc6b6f7-d8ce-4608-8a3e-44dfdfbfb8d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fda0c673de140229a53c029ab947286, user_id=2ca7151bebd44b1185298314a53913f5, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:42.124992 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc6b6f7-d8ce-4608-8a3e-44dfdfbfb8d5 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:42.127490 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f569c3-89a3-49cc-8eb7-27a7e95f9408 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:42.137038 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a682713-4541-42b8-8bfa-66b3ae7f586c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:42.137623 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a682713-4541-42b8-8bfa-66b3ae7f586c service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:42.137910 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a682713-4541-42b8-8bfa-66b3ae7f586c service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:42.138182 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a682713-4541-42b8-8bfa-66b3ae7f586c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:42.148343 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a682713-4541-42b8-8bfa-66b3ae7f586c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:42.149781 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a682713-4541-42b8-8bfa-66b3ae7f586c service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:42.159165 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1107/2183] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:20:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:20:42.202870 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1077/2184] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:20:42 2022] PUT /identity/v3/projects/4fda0c673de140229a53c029ab947286/users/2ca7151bebd44b1185298314a53913f5/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:20:42.207228 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a682713-4541-42b8-8bfa-66b3ae7f586c service neutron] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:42.218094 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a682713-4541-42b8-8bfa-66b3ae7f586c service neutron] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:42.276618 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a700e88-2c7c-40f0-8262-28873302d71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:42.277322 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a700e88-2c7c-40f0-8262-28873302d71f admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:42.277638 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a700e88-2c7c-40f0-8262-28873302d71f admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:42.277940 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a700e88-2c7c-40f0-8262-28873302d71f admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:42.278700 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a700e88-2c7c-40f0-8262-28873302d71f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:42.280359 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a700e88-2c7c-40f0-8262-28873302d71f admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:42.291147 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1108/2185] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:20:42 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:20:42.295437 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc6b6f7-d8ce-4608-8a3e-44dfdfbfb8d5 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:42.305852 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc6b6f7-d8ce-4608-8a3e-44dfdfbfb8d5 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:42.310572 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba1f35-c176-4952-91d1-02476962277d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:42.311462 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba1f35-c176-4952-91d1-02476962277d admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:42.312522 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba1f35-c176-4952-91d1-02476962277d admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:42.312522 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba1f35-c176-4952-91d1-02476962277d admin admin] PATH_INFO: `/v3/projects/4fda0c673de140229a53c029ab947286/users/2ca7151bebd44b1185298314a53913f5/roles/43105000610f402ca2486e7648018cca` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:42.314108 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fba1f35-c176-4952-91d1-02476962277d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fda0c673de140229a53c029ab947286, user_id=2ca7151bebd44b1185298314a53913f5, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:42.316828 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fba1f35-c176-4952-91d1-02476962277d admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:42.327869 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1078/2186] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:20:42 2022] PUT /identity/v3/projects/4fda0c673de140229a53c029ab947286/users/2ca7151bebd44b1185298314a53913f5/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:20:42.341884 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a28f5-381a-4a77-8bbd-2ef82176a4d1 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:42.341884 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a28f5-381a-4a77-8bbd-2ef82176a4d1 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:42.341884 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a28f5-381a-4a77-8bbd-2ef82176a4d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:42.367043 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-0c5a28f5-381a-4a77-8bbd-2ef82176a4d1 None None] MFA Rules not processed for user `2ca7151bebd44b1185298314a53913f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:42.370231 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-0c5a28f5-381a-4a77-8bbd-2ef82176a4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:42.443106 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1109/2187] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:20:42 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:42.456175 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba1f35-c176-4952-91d1-02476962277d admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:42.462148 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-3fba1f35-c176-4952-91d1-02476962277d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:42.525513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba1f35-c176-4952-91d1-02476962277d admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:42.529395 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4435d538-3bcc-4304-b26f-7ba4c3d021f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:42.530125 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4435d538-3bcc-4304-b26f-7ba4c3d021f9 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:42.530489 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4435d538-3bcc-4304-b26f-7ba4c3d021f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:42.530906 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4435d538-3bcc-4304-b26f-7ba4c3d021f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:42.544375 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4435d538-3bcc-4304-b26f-7ba4c3d021f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:42.545392 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4435d538-3bcc-4304-b26f-7ba4c3d021f9 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:42.558451 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1079/2188] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:20:42 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:20:42.657200 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a28f5-381a-4a77-8bbd-2ef82176a4d1 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:42.677280 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4435d538-3bcc-4304-b26f-7ba4c3d021f9 service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:42.679587 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-4435d538-3bcc-4304-b26f-7ba4c3d021f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:42.743086 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a28f5-381a-4a77-8bbd-2ef82176a4d1 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:42.750424 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79695b5d-28fa-4fab-9977-ff1688a80874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:42.751585 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79695b5d-28fa-4fab-9977-ff1688a80874 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:42.751966 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79695b5d-28fa-4fab-9977-ff1688a80874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:42.752443 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79695b5d-28fa-4fab-9977-ff1688a80874 admin admin] PATH_INFO: `/v3/users/a49d58cd37964783b36a9e45a622f383` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:42.753765 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79695b5d-28fa-4fab-9977-ff1688a80874 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a49d58cd37964783b36a9e45a622f383)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:42.756139 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79695b5d-28fa-4fab-9977-ff1688a80874 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:42.776714 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4435d538-3bcc-4304-b26f-7ba4c3d021f9 service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:42.789263 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73ee0eb-42cf-46d8-9574-f42ffe97da2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:42.790160 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ee0eb-42cf-46d8-9574-f42ffe97da2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:42.790444 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ee0eb-42cf-46d8-9574-f42ffe97da2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:42.790728 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ee0eb-42cf-46d8-9574-f42ffe97da2e admin admin] PATH_INFO: `/v3/projects/b3edbd3c70c34107b8ead1333e2b97a2` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:42.792081 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73ee0eb-42cf-46d8-9574-f42ffe97da2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3edbd3c70c34107b8ead1333e2b97a2)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:42.794035 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73ee0eb-42cf-46d8-9574-f42ffe97da2e admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:43.007666 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-79695b5d-28fa-4fab-9977-ff1688a80874 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a49d58cd37964783b36a9e45a622f383'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:43.008157 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-b73ee0eb-42cf-46d8-9574-f42ffe97da2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3edbd3c70c34107b8ead1333e2b97a2', 'request_id': 'req-b73ee0eb-42cf-46d8-9574-f42ffe97da2e'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:43.013661 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-b73ee0eb-42cf-46d8-9574-f42ffe97da2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3edbd3c70c34107b8ead1333e2b97a2', 'request_id': 'req-b73ee0eb-42cf-46d8-9574-f42ffe97da2e'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:43.014743 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-79695b5d-28fa-4fab-9977-ff1688a80874 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a49d58cd37964783b36a9e45a622f383'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:43.019667 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-b73ee0eb-42cf-46d8-9574-f42ffe97da2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3edbd3c70c34107b8ead1333e2b97a2', 'request_id': 'req-b73ee0eb-42cf-46d8-9574-f42ffe97da2e'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:43.027742 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-79695b5d-28fa-4fab-9977-ff1688a80874 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a49d58cd37964783b36a9e45a622f383'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:43.028659 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-79695b5d-28fa-4fab-9977-ff1688a80874 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a49d58cd37964783b36a9e45a622f383'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:43.029335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-79695b5d-28fa-4fab-9977-ff1688a80874 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a49d58cd37964783b36a9e45a622f383'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:43.119365 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-b73ee0eb-42cf-46d8-9574-f42ffe97da2e admin admin] The token cache is being invalidate because project b3edbd3c70c34107b8ead1333e2b97a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:20:43.119680 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-b73ee0eb-42cf-46d8-9574-f42ffe97da2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:43.120348 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-b73ee0eb-42cf-46d8-9574-f42ffe97da2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:43.123566 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1080/2189] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:20:42 2022] DELETE /identity/v3/projects/b3edbd3c70c34107b8ead1333e2b97a2 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:20:43.244617 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1110/2190] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:20:42 2022] DELETE /identity/v3/users/a49d58cd37964783b36a9e45a622f383 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:43.250005 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e6797-5680-4654-a0ff-241279df8c13 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:43.250577 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e6797-5680-4654-a0ff-241279df8c13 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:43.251059 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e6797-5680-4654-a0ff-241279df8c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:43.274279 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-6f6e6797-5680-4654-a0ff-241279df8c13 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:43.275545 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-6f6e6797-5680-4654-a0ff-241279df8c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:43.356835 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1081/2191] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:20:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:43.366862 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79695b5d-28fa-4fab-9977-ff1688a80874 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:43.368351 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-79695b5d-28fa-4fab-9977-ff1688a80874 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:43.431727 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79695b5d-28fa-4fab-9977-ff1688a80874 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:43.435459 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d66701-1d33-4301-b8b5-8334ea71c59b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:43.436149 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d66701-1d33-4301-b8b5-8334ea71c59b service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:43.436463 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d66701-1d33-4301-b8b5-8334ea71c59b service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:43.436744 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d66701-1d33-4301-b8b5-8334ea71c59b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:43.445663 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d66701-1d33-4301-b8b5-8334ea71c59b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:43.447272 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d66701-1d33-4301-b8b5-8334ea71c59b service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:43.462498 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1111/2192] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:20:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:20:43.908278 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e6797-5680-4654-a0ff-241279df8c13 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:43.909777 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-6f6e6797-5680-4654-a0ff-241279df8c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:43.927954 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e6797-5680-4654-a0ff-241279df8c13 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:43.933469 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c892318-9421-4524-be77-7945dc0a8eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:43.934340 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c892318-9421-4524-be77-7945dc0a8eac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:43.934671 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c892318-9421-4524-be77-7945dc0a8eac admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:43.934955 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c892318-9421-4524-be77-7945dc0a8eac admin admin] PATH_INFO: `/v3/projects/8f682bc0a56144e48af5dbdd32ca2653` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:43.936298 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c892318-9421-4524-be77-7945dc0a8eac admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f682bc0a56144e48af5dbdd32ca2653)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:43.938649 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c892318-9421-4524-be77-7945dc0a8eac admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:44.052962 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-4c892318-9421-4524-be77-7945dc0a8eac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f682bc0a56144e48af5dbdd32ca2653', 'request_id': 'req-4c892318-9421-4524-be77-7945dc0a8eac'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:44.058629 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-4c892318-9421-4524-be77-7945dc0a8eac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f682bc0a56144e48af5dbdd32ca2653', 'request_id': 'req-4c892318-9421-4524-be77-7945dc0a8eac'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:44.065264 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-4c892318-9421-4524-be77-7945dc0a8eac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f682bc0a56144e48af5dbdd32ca2653', 'request_id': 'req-4c892318-9421-4524-be77-7945dc0a8eac'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:44.149910 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-4c892318-9421-4524-be77-7945dc0a8eac admin admin] The token cache is being invalidate because project 8f682bc0a56144e48af5dbdd32ca2653 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:20:44.149910 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-4c892318-9421-4524-be77-7945dc0a8eac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:44.149910 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-4c892318-9421-4524-be77-7945dc0a8eac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:44.149910 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1082/2193] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:20:43 2022] DELETE /identity/v3/projects/8f682bc0a56144e48af5dbdd32ca2653 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:44.152645 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d66701-1d33-4301-b8b5-8334ea71c59b service neutron] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:44.163270 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d66701-1d33-4301-b8b5-8334ea71c59b service neutron] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:44.223343 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5299ef2-ec92-4417-8a1f-da37e070d31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:44.224174 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5299ef2-ec92-4417-8a1f-da37e070d31d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:44.224463 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5299ef2-ec92-4417-8a1f-da37e070d31d admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:44.224744 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5299ef2-ec92-4417-8a1f-da37e070d31d admin admin] PATH_INFO: `/v3/users/2ca7151bebd44b1185298314a53913f5` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:44.225935 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5299ef2-ec92-4417-8a1f-da37e070d31d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ca7151bebd44b1185298314a53913f5)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:44.227860 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5299ef2-ec92-4417-8a1f-da37e070d31d admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:44.434258 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-c5299ef2-ec92-4417-8a1f-da37e070d31d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ca7151bebd44b1185298314a53913f5'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:44.440892 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-c5299ef2-ec92-4417-8a1f-da37e070d31d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ca7151bebd44b1185298314a53913f5'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:44.452962 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-c5299ef2-ec92-4417-8a1f-da37e070d31d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ca7151bebd44b1185298314a53913f5'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:44.453701 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-c5299ef2-ec92-4417-8a1f-da37e070d31d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ca7151bebd44b1185298314a53913f5'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:44.454411 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-c5299ef2-ec92-4417-8a1f-da37e070d31d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ca7151bebd44b1185298314a53913f5'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:44.515692 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1112/2194] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:20:44 2022] DELETE /identity/v3/users/2ca7151bebd44b1185298314a53913f5 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:44.918585 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c892318-9421-4524-be77-7945dc0a8eac admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:44.920090 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-4c892318-9421-4524-be77-7945dc0a8eac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:45.013165 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c892318-9421-4524-be77-7945dc0a8eac admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:45.071693 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068a59c3-37fd-4a60-b4ae-ad7bd048a196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:45.073928 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a59c3-37fd-4a60-b4ae-ad7bd048a196 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:45.074221 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a59c3-37fd-4a60-b4ae-ad7bd048a196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:45.074505 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a59c3-37fd-4a60-b4ae-ad7bd048a196 admin admin] PATH_INFO: `/v3/projects/4fda0c673de140229a53c029ab947286` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:45.075915 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068a59c3-37fd-4a60-b4ae-ad7bd048a196 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fda0c673de140229a53c029ab947286)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:45.077886 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068a59c3-37fd-4a60-b4ae-ad7bd048a196 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:45.202605 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-068a59c3-37fd-4a60-b4ae-ad7bd048a196 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fda0c673de140229a53c029ab947286', 'request_id': 'req-068a59c3-37fd-4a60-b4ae-ad7bd048a196'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:45.208229 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-068a59c3-37fd-4a60-b4ae-ad7bd048a196 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fda0c673de140229a53c029ab947286', 'request_id': 'req-068a59c3-37fd-4a60-b4ae-ad7bd048a196'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:45.215165 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-068a59c3-37fd-4a60-b4ae-ad7bd048a196 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fda0c673de140229a53c029ab947286', 'request_id': 'req-068a59c3-37fd-4a60-b4ae-ad7bd048a196'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:45.293313 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-068a59c3-37fd-4a60-b4ae-ad7bd048a196 admin admin] The token cache is being invalidate because project 4fda0c673de140229a53c029ab947286 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:20:45.293586 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-068a59c3-37fd-4a60-b4ae-ad7bd048a196 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:45.294202 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-068a59c3-37fd-4a60-b4ae-ad7bd048a196 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:45.295749 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1083/2195] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:20:44 2022] DELETE /identity/v3/projects/4fda0c673de140229a53c029ab947286 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:45.300849 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13356a-c677-4e8e-8ba2-c9376cb7beac None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:45.301327 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13356a-c677-4e8e-8ba2-c9376cb7beac None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:45.301418 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13356a-c677-4e8e-8ba2-c9376cb7beac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:45.349684 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-fd13356a-c677-4e8e-8ba2-c9376cb7beac None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:45.351347 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-fd13356a-c677-4e8e-8ba2-c9376cb7beac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:45.409338 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1113/2196] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:20:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:45.417916 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d27cd-368d-45a9-9179-c046fc85966e None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:45.418212 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d27cd-368d-45a9-9179-c046fc85966e None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:45.418562 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d27cd-368d-45a9-9179-c046fc85966e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:45.438065 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-091d27cd-368d-45a9-9179-c046fc85966e None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:45.439294 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-091d27cd-368d-45a9-9179-c046fc85966e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:45.447538 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1084/2197] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:20:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:45.451983 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd13356a-c677-4e8e-8ba2-c9376cb7beac None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:45.462046 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd13356a-c677-4e8e-8ba2-c9376cb7beac None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:45.466879 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a4f8b-879c-4b0f-b28e-83857919547c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:45.467535 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a4f8b-879c-4b0f-b28e-83857919547c admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:45.467817 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a4f8b-879c-4b0f-b28e-83857919547c admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:45.468219 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a4f8b-879c-4b0f-b28e-83857919547c admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:45.468954 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073a4f8b-879c-4b0f-b28e-83857919547c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:20:45.469260 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073a4f8b-879c-4b0f-b28e-83857919547c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:45.470869 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073a4f8b-879c-4b0f-b28e-83857919547c admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:45.483072 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1114/2198] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 10 03:20:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:20:45.487607 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091d27cd-368d-45a9-9179-c046fc85966e None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:45.499299 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091d27cd-368d-45a9-9179-c046fc85966e None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:45.504195 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf46746-75f5-4ca9-a188-cadc05931c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:45.505041 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf46746-75f5-4ca9-a188-cadc05931c70 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:45.505348 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf46746-75f5-4ca9-a188-cadc05931c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:45.505686 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf46746-75f5-4ca9-a188-cadc05931c70 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:45.506511 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf46746-75f5-4ca9-a188-cadc05931c70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:45.508972 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf46746-75f5-4ca9-a188-cadc05931c70 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:45.643188 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1085/2199] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:20:45 2022] POST /identity/v3/projects => generated 385 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:20:45.647769 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a4f8b-879c-4b0f-b28e-83857919547c admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:45.658536 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a4f8b-879c-4b0f-b28e-83857919547c admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:45.716357 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0012444-7de2-4353-b598-ce4dbba4df1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:45.717060 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0012444-7de2-4353-b598-ce4dbba4df1b admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:45.717346 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0012444-7de2-4353-b598-ce4dbba4df1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:45.717698 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0012444-7de2-4353-b598-ce4dbba4df1b admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:45.718335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0012444-7de2-4353-b598-ce4dbba4df1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:45.720284 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0012444-7de2-4353-b598-ce4dbba4df1b admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:45.854920 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1115/2200] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:20:45 2022] POST /identity/v3/users => generated 293 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:20:45.855378 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf46746-75f5-4ca9-a188-cadc05931c70 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:45.874319 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf46746-75f5-4ca9-a188-cadc05931c70 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:45.879249 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab636d9-11a6-4197-9a01-68c6a9934766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:45.885064 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab636d9-11a6-4197-9a01-68c6a9934766 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:45.885064 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab636d9-11a6-4197-9a01-68c6a9934766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:45.885064 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab636d9-11a6-4197-9a01-68c6a9934766 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:45.885064 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab636d9-11a6-4197-9a01-68c6a9934766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:45.885064 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab636d9-11a6-4197-9a01-68c6a9934766 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:45.900096 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1086/2201] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:20:45 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:20:45.901287 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0012444-7de2-4353-b598-ce4dbba4df1b admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:45.912785 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0012444-7de2-4353-b598-ce4dbba4df1b admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:45.918783 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55893d46-f1a2-4001-ad80-65a04b61100e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:45.919714 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55893d46-f1a2-4001-ad80-65a04b61100e admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:45.919915 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55893d46-f1a2-4001-ad80-65a04b61100e admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:45.920224 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55893d46-f1a2-4001-ad80-65a04b61100e admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:45.920956 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55893d46-f1a2-4001-ad80-65a04b61100e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:45.925696 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55893d46-f1a2-4001-ad80-65a04b61100e admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:45.937029 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1116/2202] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:20:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:20:45.941336 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab636d9-11a6-4197-9a01-68c6a9934766 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:45.951928 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab636d9-11a6-4197-9a01-68c6a9934766 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:45.958135 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e9b3f-d96b-494e-8ae2-b896917284a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:45.959033 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e9b3f-d96b-494e-8ae2-b896917284a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:45.959313 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e9b3f-d96b-494e-8ae2-b896917284a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:45.959585 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e9b3f-d96b-494e-8ae2-b896917284a9 admin admin] PATH_INFO: `/v3/projects/6e914eb6485f43e7897b361a21b69dba/users/44e913f2d40d46738554eed837296ba0/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:45.975569 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728e9b3f-d96b-494e-8ae2-b896917284a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e914eb6485f43e7897b361a21b69dba, user_id=44e913f2d40d46738554eed837296ba0, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:45.978283 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728e9b3f-d96b-494e-8ae2-b896917284a9 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:46.077042 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1087/2203] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:20:45 2022] PUT /identity/v3/projects/6e914eb6485f43e7897b361a21b69dba/users/44e913f2d40d46738554eed837296ba0/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:20:46.089497 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c41c1-ca44-42e7-8418-7804a6d9b518 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:46.089843 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c41c1-ca44-42e7-8418-7804a6d9b518 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:46.090127 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c41c1-ca44-42e7-8418-7804a6d9b518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:46.116609 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-437c41c1-ca44-42e7-8418-7804a6d9b518 None None] MFA Rules not processed for user `44e913f2d40d46738554eed837296ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:46.117746 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-437c41c1-ca44-42e7-8418-7804a6d9b518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:46.184535 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1117/2204] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:20:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:20:46.190970 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e9b3f-d96b-494e-8ae2-b896917284a9 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:46.267629 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e9b3f-d96b-494e-8ae2-b896917284a9 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:46.273353 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8546e3e1-bf20-44f6-a599-dc1c9d1da6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:46.274061 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546e3e1-bf20-44f6-a599-dc1c9d1da6be admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:46.274343 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546e3e1-bf20-44f6-a599-dc1c9d1da6be admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:46.274616 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546e3e1-bf20-44f6-a599-dc1c9d1da6be admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:46.275471 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8546e3e1-bf20-44f6-a599-dc1c9d1da6be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:46.277351 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8546e3e1-bf20-44f6-a599-dc1c9d1da6be admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:46.375197 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1088/2205] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:20:46 2022] POST /identity/v3/projects => generated 387 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:20:46.379052 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437c41c1-ca44-42e7-8418-7804a6d9b518 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:46.390650 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437c41c1-ca44-42e7-8418-7804a6d9b518 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:46.450174 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb6a549-fb75-4419-ba2f-02c8206f8041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:46.450853 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb6a549-fb75-4419-ba2f-02c8206f8041 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:46.451136 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb6a549-fb75-4419-ba2f-02c8206f8041 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:46.451413 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb6a549-fb75-4419-ba2f-02c8206f8041 admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:46.452145 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb6a549-fb75-4419-ba2f-02c8206f8041 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:46.454323 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb6a549-fb75-4419-ba2f-02c8206f8041 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:46.539517 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1118/2206] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:20:46 2022] POST /identity/v3/users => generated 294 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:20:46.540848 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8546e3e1-bf20-44f6-a599-dc1c9d1da6be admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:46.551306 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8546e3e1-bf20-44f6-a599-dc1c9d1da6be admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:46.556517 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93035c43-6d47-4575-a7b7-9dc086f01475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:46.557177 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93035c43-6d47-4575-a7b7-9dc086f01475 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:46.557458 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93035c43-6d47-4575-a7b7-9dc086f01475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:46.557731 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93035c43-6d47-4575-a7b7-9dc086f01475 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:46.558453 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93035c43-6d47-4575-a7b7-9dc086f01475 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:46.560060 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93035c43-6d47-4575-a7b7-9dc086f01475 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:46.571293 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1089/2207] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:20:46.575311 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb6a549-fb75-4419-ba2f-02c8206f8041 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:46.589080 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb6a549-fb75-4419-ba2f-02c8206f8041 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:46.594405 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265898bd-eb01-4f76-9f87-1f7619283c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:46.595425 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265898bd-eb01-4f76-9f87-1f7619283c38 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:46.595855 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265898bd-eb01-4f76-9f87-1f7619283c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:46.596382 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265898bd-eb01-4f76-9f87-1f7619283c38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:46.597112 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265898bd-eb01-4f76-9f87-1f7619283c38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:46.598858 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265898bd-eb01-4f76-9f87-1f7619283c38 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:46.614679 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1119/2208] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:20:46.614780 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93035c43-6d47-4575-a7b7-9dc086f01475 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:46.624405 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93035c43-6d47-4575-a7b7-9dc086f01475 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:46.629257 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a9686-1204-46b2-a768-03b24d5563f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:46.630193 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a9686-1204-46b2-a768-03b24d5563f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:46.630747 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a9686-1204-46b2-a768-03b24d5563f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:46.631099 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a9686-1204-46b2-a768-03b24d5563f0 admin admin] PATH_INFO: `/v3/projects/132d8812d09f4acf9da8186584447b8a/users/953e12a5d4d14441a3e42640b05794b7/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:46.647003 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98a9686-1204-46b2-a768-03b24d5563f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=132d8812d09f4acf9da8186584447b8a, user_id=953e12a5d4d14441a3e42640b05794b7, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:46.650264 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98a9686-1204-46b2-a768-03b24d5563f0 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:46.716854 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1090/2209] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:20:46 2022] PUT /identity/v3/projects/132d8812d09f4acf9da8186584447b8a/users/953e12a5d4d14441a3e42640b05794b7/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:46.775792 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af6cce-793b-4afd-a983-00fcaeaaef0d None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:46.776123 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af6cce-793b-4afd-a983-00fcaeaaef0d None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:46.776408 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af6cce-793b-4afd-a983-00fcaeaaef0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:46.807333 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-68af6cce-793b-4afd-a983-00fcaeaaef0d None None] MFA Rules not processed for user `953e12a5d4d14441a3e42640b05794b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:46.808578 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-68af6cce-793b-4afd-a983-00fcaeaaef0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:46.872646 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1120/2210] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:20:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:46.877088 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a9686-1204-46b2-a768-03b24d5563f0 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:46.943944 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a9686-1204-46b2-a768-03b24d5563f0 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:46.951420 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5882a59-a0e5-4696-afa1-482803567575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:46.952289 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5882a59-a0e5-4696-afa1-482803567575 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:46.952571 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5882a59-a0e5-4696-afa1-482803567575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:46.952846 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5882a59-a0e5-4696-afa1-482803567575 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:46.953552 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5882a59-a0e5-4696-afa1-482803567575 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:46.955454 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5882a59-a0e5-4696-afa1-482803567575 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:47.046779 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1091/2211] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:20:46 2022] POST /identity/v3/projects => generated 387 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:20:47.050780 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af6cce-793b-4afd-a983-00fcaeaaef0d None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:47.062518 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af6cce-793b-4afd-a983-00fcaeaaef0d None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:47.120134 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb77f7-b828-45ce-b18e-7eabf5086f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:47.120810 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb77f7-b828-45ce-b18e-7eabf5086f13 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:47.121081 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb77f7-b828-45ce-b18e-7eabf5086f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:47.121355 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb77f7-b828-45ce-b18e-7eabf5086f13 admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:47.122036 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cb77f7-b828-45ce-b18e-7eabf5086f13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:47.123917 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cb77f7-b828-45ce-b18e-7eabf5086f13 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:47.250760 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1121/2212] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:20:47 2022] POST /identity/v3/users => generated 300 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:20:47.254623 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5882a59-a0e5-4696-afa1-482803567575 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:47.264912 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5882a59-a0e5-4696-afa1-482803567575 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:47.270403 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bad8c8-3f77-4a28-8403-6669754bc74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:47.271336 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bad8c8-3f77-4a28-8403-6669754bc74b admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:47.271617 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bad8c8-3f77-4a28-8403-6669754bc74b admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:47.275774 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bad8c8-3f77-4a28-8403-6669754bc74b admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:47.275774 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bad8c8-3f77-4a28-8403-6669754bc74b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:47.276931 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bad8c8-3f77-4a28-8403-6669754bc74b admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:47.292644 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1092/2213] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:20:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:20:47.293730 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb77f7-b828-45ce-b18e-7eabf5086f13 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:47.303750 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb77f7-b828-45ce-b18e-7eabf5086f13 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:47.308550 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fec9cc-0287-4efd-8393-a64da08d685f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:47.309428 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fec9cc-0287-4efd-8393-a64da08d685f admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:47.312343 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fec9cc-0287-4efd-8393-a64da08d685f admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:47.312343 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fec9cc-0287-4efd-8393-a64da08d685f admin admin] PATH_INFO: `/v3/projects/3d6e45622bee4d6aa33d1abe490f0f9e/users/d0afe99ef1a94bb0935b5e92f8927bf1/roles/43105000610f402ca2486e7648018cca` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:47.323999 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fec9cc-0287-4efd-8393-a64da08d685f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d6e45622bee4d6aa33d1abe490f0f9e, user_id=d0afe99ef1a94bb0935b5e92f8927bf1, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:47.326656 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fec9cc-0287-4efd-8393-a64da08d685f admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:47.421940 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1122/2214] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:20:47 2022] PUT /identity/v3/projects/3d6e45622bee4d6aa33d1abe490f0f9e/users/d0afe99ef1a94bb0935b5e92f8927bf1/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:47.425854 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bad8c8-3f77-4a28-8403-6669754bc74b admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:47.435682 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bad8c8-3f77-4a28-8403-6669754bc74b admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:47.491136 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dcb46c-8a18-4822-aa60-2cc7c7f7096c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:47.491728 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dcb46c-8a18-4822-aa60-2cc7c7f7096c admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:47.492032 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dcb46c-8a18-4822-aa60-2cc7c7f7096c admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:47.492319 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dcb46c-8a18-4822-aa60-2cc7c7f7096c admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:47.493042 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dcb46c-8a18-4822-aa60-2cc7c7f7096c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:47.494633 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dcb46c-8a18-4822-aa60-2cc7c7f7096c admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:47.503969 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1093/2215] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:20:47 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:20:47.508714 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fec9cc-0287-4efd-8393-a64da08d685f admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:47.518990 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fec9cc-0287-4efd-8393-a64da08d685f admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:47.524615 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f6b38-8e04-412a-9108-4fe4420e6934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:47.525486 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f6b38-8e04-412a-9108-4fe4420e6934 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:47.525776 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f6b38-8e04-412a-9108-4fe4420e6934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:47.526044 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f6b38-8e04-412a-9108-4fe4420e6934 admin admin] PATH_INFO: `/v3/projects/3d6e45622bee4d6aa33d1abe490f0f9e/users/d0afe99ef1a94bb0935b5e92f8927bf1/roles/43105000610f402ca2486e7648018cca` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:47.528127 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982f6b38-8e04-412a-9108-4fe4420e6934 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d6e45622bee4d6aa33d1abe490f0f9e, user_id=d0afe99ef1a94bb0935b5e92f8927bf1, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:47.530746 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982f6b38-8e04-412a-9108-4fe4420e6934 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:47.544404 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1123/2216] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:20:47 2022] PUT /identity/v3/projects/3d6e45622bee4d6aa33d1abe490f0f9e/users/d0afe99ef1a94bb0935b5e92f8927bf1/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:47.554812 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc5e69e-cac3-4eb1-9bd2-046ff4376169 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:47.555105 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc5e69e-cac3-4eb1-9bd2-046ff4376169 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:47.555402 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc5e69e-cac3-4eb1-9bd2-046ff4376169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:47.582371 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-3fc5e69e-cac3-4eb1-9bd2-046ff4376169 None None] MFA Rules not processed for user `d0afe99ef1a94bb0935b5e92f8927bf1`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:47.583570 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-3fc5e69e-cac3-4eb1-9bd2-046ff4376169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:47.658503 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1094/2217] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:20:47 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:47.670162 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f6b38-8e04-412a-9108-4fe4420e6934 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:47.672074 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-982f6b38-8e04-412a-9108-4fe4420e6934 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:47.747915 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f6b38-8e04-412a-9108-4fe4420e6934 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:47.751692 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282fea46-e40d-4004-81a7-2607423de919 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:47.752645 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282fea46-e40d-4004-81a7-2607423de919 service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:47.752927 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282fea46-e40d-4004-81a7-2607423de919 service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:47.753199 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282fea46-e40d-4004-81a7-2607423de919 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:47.764293 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282fea46-e40d-4004-81a7-2607423de919 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:47.765741 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282fea46-e40d-4004-81a7-2607423de919 service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:47.776799 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1124/2218] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:20:47 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:20:48.886709 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc5e69e-cac3-4eb1-9bd2-046ff4376169 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:48.888179 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-3fc5e69e-cac3-4eb1-9bd2-046ff4376169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:48.900611 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc5e69e-cac3-4eb1-9bd2-046ff4376169 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:48.904140 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad58ae3-4d13-4590-9aea-3c8329c89f7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:48.904801 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad58ae3-4d13-4590-9aea-3c8329c89f7c service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:48.905062 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad58ae3-4d13-4590-9aea-3c8329c89f7c service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:48.905334 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad58ae3-4d13-4590-9aea-3c8329c89f7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:48.966035 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad58ae3-4d13-4590-9aea-3c8329c89f7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:48.967481 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad58ae3-4d13-4590-9aea-3c8329c89f7c service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:48.976440 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1095/2219] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:20:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:20:54.112783 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282fea46-e40d-4004-81a7-2607423de919 service cinder] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:54.121638 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282fea46-e40d-4004-81a7-2607423de919 service cinder] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:54.126393 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522902d6-49cb-47f4-b329-440c23824b66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:54.127113 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522902d6-49cb-47f4-b329-440c23824b66 service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:54.127579 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522902d6-49cb-47f4-b329-440c23824b66 service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:54.127998 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522902d6-49cb-47f4-b329-440c23824b66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:54.204304 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522902d6-49cb-47f4-b329-440c23824b66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:54.205852 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522902d6-49cb-47f4-b329-440c23824b66 service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:54.217393 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1125/2220] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:20:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:20:55.166315 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1da00-ed78-454f-8964-15d24d06cd90 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:55.166842 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1da00-ed78-454f-8964-15d24d06cd90 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:55.166842 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1da00-ed78-454f-8964-15d24d06cd90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:55.184877 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-a0f1da00-ed78-454f-8964-15d24d06cd90 None None] MFA Rules not processed for user `9407e88fdbd74ba196ffd9fd221e15f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:55.186078 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-a0f1da00-ed78-454f-8964-15d24d06cd90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:55.256447 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1096/2221] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:20:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:58.809375 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522902d6-49cb-47f4-b329-440c23824b66 service cinder] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:58.914566 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522902d6-49cb-47f4-b329-440c23824b66 service cinder] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:58.922992 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd80b87-5722-499c-8960-fc717c21311c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:58.924397 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd80b87-5722-499c-8960-fc717c21311c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:58.924693 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd80b87-5722-499c-8960-fc717c21311c admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:58.925125 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd80b87-5722-499c-8960-fc717c21311c admin admin] PATH_INFO: `/v3/users/44e913f2d40d46738554eed837296ba0` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:58.927399 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd80b87-5722-499c-8960-fc717c21311c admin admin] RBAC: Authorizing `identity:delete_user(user_id=44e913f2d40d46738554eed837296ba0)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:58.930967 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd80b87-5722-499c-8960-fc717c21311c admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:59.160533 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-1fd80b87-5722-499c-8960-fc717c21311c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44e913f2d40d46738554eed837296ba0'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:59.168146 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-1fd80b87-5722-499c-8960-fc717c21311c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44e913f2d40d46738554eed837296ba0'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:59.188088 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-1fd80b87-5722-499c-8960-fc717c21311c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44e913f2d40d46738554eed837296ba0'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:59.188822 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-1fd80b87-5722-499c-8960-fc717c21311c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44e913f2d40d46738554eed837296ba0'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:59.189436 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-1fd80b87-5722-499c-8960-fc717c21311c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44e913f2d40d46738554eed837296ba0'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:20:59.315630 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1126/2222] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:20:58 2022] DELETE /identity/v3/users/44e913f2d40d46738554eed837296ba0 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:20:59.317747 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6efd68-1c7f-46e3-83f3-f12e0de88fda None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:59.318252 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6efd68-1c7f-46e3-83f3-f12e0de88fda None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:59.318355 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6efd68-1c7f-46e3-83f3-f12e0de88fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:59.340887 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-3c6efd68-1c7f-46e3-83f3-f12e0de88fda None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:20:59.342680 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-3c6efd68-1c7f-46e3-83f3-f12e0de88fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:59.427362 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1097/2223] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:20:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:20:59.436150 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd80b87-5722-499c-8960-fc717c21311c admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:20:59.437669 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-1fd80b87-5722-499c-8960-fc717c21311c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:20:59.564330 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd80b87-5722-499c-8960-fc717c21311c admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:20:59.571893 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48630889-3fee-49b8-9d3b-cb1be20cfa16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:20:59.571893 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48630889-3fee-49b8-9d3b-cb1be20cfa16 service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:20:59.571893 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48630889-3fee-49b8-9d3b-cb1be20cfa16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:20:59.572480 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48630889-3fee-49b8-9d3b-cb1be20cfa16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:20:59.584265 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48630889-3fee-49b8-9d3b-cb1be20cfa16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:20:59.586605 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48630889-3fee-49b8-9d3b-cb1be20cfa16 service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:20:59.598550 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1127/2224] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:20:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:21:00.675593 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6efd68-1c7f-46e3-83f3-f12e0de88fda None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:00.677571 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-3c6efd68-1c7f-46e3-83f3-f12e0de88fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:00.696461 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6efd68-1c7f-46e3-83f3-f12e0de88fda None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:00.702118 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f013b785-d8d2-4668-95ca-a09dfbaa5971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:00.703270 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013b785-d8d2-4668-95ca-a09dfbaa5971 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:00.703763 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013b785-d8d2-4668-95ca-a09dfbaa5971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:00.704264 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013b785-d8d2-4668-95ca-a09dfbaa5971 admin admin] PATH_INFO: `/v3/projects/6e914eb6485f43e7897b361a21b69dba` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:00.705898 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f013b785-d8d2-4668-95ca-a09dfbaa5971 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e914eb6485f43e7897b361a21b69dba)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:00.710702 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f013b785-d8d2-4668-95ca-a09dfbaa5971 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:00.827458 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f013b785-d8d2-4668-95ca-a09dfbaa5971 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e914eb6485f43e7897b361a21b69dba', 'request_id': 'req-f013b785-d8d2-4668-95ca-a09dfbaa5971'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:00.832943 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f013b785-d8d2-4668-95ca-a09dfbaa5971 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e914eb6485f43e7897b361a21b69dba', 'request_id': 'req-f013b785-d8d2-4668-95ca-a09dfbaa5971'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:00.840067 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f013b785-d8d2-4668-95ca-a09dfbaa5971 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e914eb6485f43e7897b361a21b69dba', 'request_id': 'req-f013b785-d8d2-4668-95ca-a09dfbaa5971'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:00.918663 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f013b785-d8d2-4668-95ca-a09dfbaa5971 admin admin] The token cache is being invalidate because project 6e914eb6485f43e7897b361a21b69dba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:21:00.919120 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f013b785-d8d2-4668-95ca-a09dfbaa5971 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:00.919769 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f013b785-d8d2-4668-95ca-a09dfbaa5971 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:00.921379 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1098/2225] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:21:00 2022] DELETE /identity/v3/projects/6e914eb6485f43e7897b361a21b69dba => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:21:00.925225 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48630889-3fee-49b8-9d3b-cb1be20cfa16 service neutron] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:00.935697 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48630889-3fee-49b8-9d3b-cb1be20cfa16 service neutron] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:00.993786 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa46c0d-f01e-464e-b3b1-aef64b2565d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:00.994688 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa46c0d-f01e-464e-b3b1-aef64b2565d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:00.994970 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa46c0d-f01e-464e-b3b1-aef64b2565d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:00.995248 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa46c0d-f01e-464e-b3b1-aef64b2565d8 admin admin] PATH_INFO: `/v3/users/953e12a5d4d14441a3e42640b05794b7` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:00.996857 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa46c0d-f01e-464e-b3b1-aef64b2565d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=953e12a5d4d14441a3e42640b05794b7)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:00.998746 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa46c0d-f01e-464e-b3b1-aef64b2565d8 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:01.201685 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-3aa46c0d-f01e-464e-b3b1-aef64b2565d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '953e12a5d4d14441a3e42640b05794b7'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:01.209994 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-3aa46c0d-f01e-464e-b3b1-aef64b2565d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '953e12a5d4d14441a3e42640b05794b7'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:01.224055 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-3aa46c0d-f01e-464e-b3b1-aef64b2565d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '953e12a5d4d14441a3e42640b05794b7'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:01.231777 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-3aa46c0d-f01e-464e-b3b1-aef64b2565d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '953e12a5d4d14441a3e42640b05794b7'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:01.231777 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-3aa46c0d-f01e-464e-b3b1-aef64b2565d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '953e12a5d4d14441a3e42640b05794b7'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:01.307812 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1128/2226] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:21:00 2022] DELETE /identity/v3/users/953e12a5d4d14441a3e42640b05794b7 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:21:01.337617 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f013b785-d8d2-4668-95ca-a09dfbaa5971 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:01.339665 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-f013b785-d8d2-4668-95ca-a09dfbaa5971 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:01.356037 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f013b785-d8d2-4668-95ca-a09dfbaa5971 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:01.424986 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7539afc0-504d-42ce-ad8e-a76168e9cd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:01.425886 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7539afc0-504d-42ce-ad8e-a76168e9cd31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:01.426165 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7539afc0-504d-42ce-ad8e-a76168e9cd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:01.426443 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7539afc0-504d-42ce-ad8e-a76168e9cd31 admin admin] PATH_INFO: `/v3/users/ee562970cfe64dc58e0e8ba0cf4d643c` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:01.427686 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7539afc0-504d-42ce-ad8e-a76168e9cd31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee562970cfe64dc58e0e8ba0cf4d643c)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:01.432333 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7539afc0-504d-42ce-ad8e-a76168e9cd31 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:01.657681 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-7539afc0-504d-42ce-ad8e-a76168e9cd31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee562970cfe64dc58e0e8ba0cf4d643c'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:01.658337 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-7539afc0-504d-42ce-ad8e-a76168e9cd31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee562970cfe64dc58e0e8ba0cf4d643c'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:01.666121 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-7539afc0-504d-42ce-ad8e-a76168e9cd31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee562970cfe64dc58e0e8ba0cf4d643c'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:01.707645 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa46c0d-f01e-464e-b3b1-aef64b2565d8 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:01.709977 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-3aa46c0d-f01e-464e-b3b1-aef64b2565d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:01.723160 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa46c0d-f01e-464e-b3b1-aef64b2565d8 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:01.727338 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-7539afc0-504d-42ce-ad8e-a76168e9cd31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee562970cfe64dc58e0e8ba0cf4d643c'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:01.728051 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-7539afc0-504d-42ce-ad8e-a76168e9cd31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee562970cfe64dc58e0e8ba0cf4d643c'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:01.728331 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea67ecd3-adff-49d0-b505-5f9dbb0ec415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:01.729201 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67ecd3-adff-49d0-b505-5f9dbb0ec415 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:01.729488 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67ecd3-adff-49d0-b505-5f9dbb0ec415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:01.729768 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67ecd3-adff-49d0-b505-5f9dbb0ec415 admin admin] PATH_INFO: `/v3/projects/132d8812d09f4acf9da8186584447b8a` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:01.730967 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea67ecd3-adff-49d0-b505-5f9dbb0ec415 admin admin] RBAC: Authorizing `identity:delete_project(project_id=132d8812d09f4acf9da8186584447b8a)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:01.733054 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea67ecd3-adff-49d0-b505-5f9dbb0ec415 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:01.747381 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1099/2227] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:21:01 2022] DELETE /identity/v3/users/ee562970cfe64dc58e0e8ba0cf4d643c => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:21:01.752107 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f542b-80a7-4a94-a3b5-85faef9dd766 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:01.752734 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f542b-80a7-4a94-a3b5-85faef9dd766 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:01.753130 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f542b-80a7-4a94-a3b5-85faef9dd766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:01.780281 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-123f542b-80a7-4a94-a3b5-85faef9dd766 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:01.780281 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-123f542b-80a7-4a94-a3b5-85faef9dd766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:01.849080 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-ea67ecd3-adff-49d0-b505-5f9dbb0ec415 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '132d8812d09f4acf9da8186584447b8a', 'request_id': 'req-ea67ecd3-adff-49d0-b505-5f9dbb0ec415'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:01.851114 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1100/2228] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:21:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:21:01.854998 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-ea67ecd3-adff-49d0-b505-5f9dbb0ec415 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '132d8812d09f4acf9da8186584447b8a', 'request_id': 'req-ea67ecd3-adff-49d0-b505-5f9dbb0ec415'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:01.858422 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f542b-80a7-4a94-a3b5-85faef9dd766 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:01.862034 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-ea67ecd3-adff-49d0-b505-5f9dbb0ec415 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '132d8812d09f4acf9da8186584447b8a', 'request_id': 'req-ea67ecd3-adff-49d0-b505-5f9dbb0ec415'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:01.864215 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-123f542b-80a7-4a94-a3b5-85faef9dd766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:01.925292 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f542b-80a7-4a94-a3b5-85faef9dd766 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:01.941380 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-ea67ecd3-adff-49d0-b505-5f9dbb0ec415 admin admin] The token cache is being invalidate because project 132d8812d09f4acf9da8186584447b8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:21:01.941887 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-ea67ecd3-adff-49d0-b505-5f9dbb0ec415 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:01.942461 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-ea67ecd3-adff-49d0-b505-5f9dbb0ec415 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:01.944790 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1129/2229] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:21:01 2022] DELETE /identity/v3/projects/132d8812d09f4acf9da8186584447b8a => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:21:01.948428 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea67ecd3-adff-49d0-b505-5f9dbb0ec415 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:01.949745 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-ea67ecd3-adff-49d0-b505-5f9dbb0ec415 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:01.981515 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d86073-b507-44e7-b806-879fe5c33236 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:01.982172 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d86073-b507-44e7-b806-879fe5c33236 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:01.982456 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d86073-b507-44e7-b806-879fe5c33236 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:01.982739 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d86073-b507-44e7-b806-879fe5c33236 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:01.984731 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-58d86073-b507-44e7-b806-879fe5c33236 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:02.013971 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea67ecd3-adff-49d0-b505-5f9dbb0ec415 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:02.018706 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70763fd-32ec-45db-9c7e-925539458ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:02.019568 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70763fd-32ec-45db-9c7e-925539458ea9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:02.019853 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70763fd-32ec-45db-9c7e-925539458ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:02.020169 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70763fd-32ec-45db-9c7e-925539458ea9 admin admin] PATH_INFO: `/v3/users/d0afe99ef1a94bb0935b5e92f8927bf1` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:02.021377 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70763fd-32ec-45db-9c7e-925539458ea9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0afe99ef1a94bb0935b5e92f8927bf1)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:02.023951 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70763fd-32ec-45db-9c7e-925539458ea9 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:02.046875 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d86073-b507-44e7-b806-879fe5c33236 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:02.048354 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d86073-b507-44e7-b806-879fe5c33236 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:02.058559 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1101/2230] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:21:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:21:02.256931 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-e70763fd-32ec-45db-9c7e-925539458ea9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0afe99ef1a94bb0935b5e92f8927bf1'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:02.264382 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-e70763fd-32ec-45db-9c7e-925539458ea9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0afe99ef1a94bb0935b5e92f8927bf1'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:02.278444 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-e70763fd-32ec-45db-9c7e-925539458ea9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0afe99ef1a94bb0935b5e92f8927bf1'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:02.279183 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-e70763fd-32ec-45db-9c7e-925539458ea9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0afe99ef1a94bb0935b5e92f8927bf1'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:02.281179 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-e70763fd-32ec-45db-9c7e-925539458ea9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0afe99ef1a94bb0935b5e92f8927bf1'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:02.384786 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1130/2231] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:21:01 2022] DELETE /identity/v3/users/d0afe99ef1a94bb0935b5e92f8927bf1 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:21:02.496317 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d86073-b507-44e7-b806-879fe5c33236 service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:02.497878 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-58d86073-b507-44e7-b806-879fe5c33236 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:02.512923 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d86073-b507-44e7-b806-879fe5c33236 service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:02.578681 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a1cc1-1dfc-414c-9d32-6908e5308927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:02.579565 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a1cc1-1dfc-414c-9d32-6908e5308927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:02.579853 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a1cc1-1dfc-414c-9d32-6908e5308927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:02.580168 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a1cc1-1dfc-414c-9d32-6908e5308927 admin admin] PATH_INFO: `/v3/projects/872ea19a444444c4a3b0523189b6f377` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:02.581384 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20a1cc1-1dfc-414c-9d32-6908e5308927 admin admin] RBAC: Authorizing `identity:delete_project(project_id=872ea19a444444c4a3b0523189b6f377)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:02.584086 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20a1cc1-1dfc-414c-9d32-6908e5308927 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:02.724510 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d20a1cc1-1dfc-414c-9d32-6908e5308927 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '872ea19a444444c4a3b0523189b6f377', 'request_id': 'req-d20a1cc1-1dfc-414c-9d32-6908e5308927'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:02.729958 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d20a1cc1-1dfc-414c-9d32-6908e5308927 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '872ea19a444444c4a3b0523189b6f377', 'request_id': 'req-d20a1cc1-1dfc-414c-9d32-6908e5308927'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:02.736416 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d20a1cc1-1dfc-414c-9d32-6908e5308927 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '872ea19a444444c4a3b0523189b6f377', 'request_id': 'req-d20a1cc1-1dfc-414c-9d32-6908e5308927'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:02.802809 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d20a1cc1-1dfc-414c-9d32-6908e5308927 admin admin] The token cache is being invalidate because project 872ea19a444444c4a3b0523189b6f377 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:21:02.803653 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d20a1cc1-1dfc-414c-9d32-6908e5308927 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:02.804318 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d20a1cc1-1dfc-414c-9d32-6908e5308927 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:02.806194 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1102/2232] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:21:02 2022] DELETE /identity/v3/projects/872ea19a444444c4a3b0523189b6f377 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:21:02.941378 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70763fd-32ec-45db-9c7e-925539458ea9 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:02.943046 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-e70763fd-32ec-45db-9c7e-925539458ea9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:02.959375 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70763fd-32ec-45db-9c7e-925539458ea9 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:03.059217 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d0962-b5cd-449c-882f-58203da0666e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:03.060403 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d0962-b5cd-449c-882f-58203da0666e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:03.060920 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d0962-b5cd-449c-882f-58203da0666e admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:03.061358 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d0962-b5cd-449c-882f-58203da0666e admin admin] PATH_INFO: `/v3/projects/3d6e45622bee4d6aa33d1abe490f0f9e` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:03.062592 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86d0962-b5cd-449c-882f-58203da0666e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d6e45622bee4d6aa33d1abe490f0f9e)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:03.064554 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86d0962-b5cd-449c-882f-58203da0666e admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:03.189161 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-f86d0962-b5cd-449c-882f-58203da0666e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d6e45622bee4d6aa33d1abe490f0f9e', 'request_id': 'req-f86d0962-b5cd-449c-882f-58203da0666e'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:03.194649 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-f86d0962-b5cd-449c-882f-58203da0666e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d6e45622bee4d6aa33d1abe490f0f9e', 'request_id': 'req-f86d0962-b5cd-449c-882f-58203da0666e'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:03.201841 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-f86d0962-b5cd-449c-882f-58203da0666e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d6e45622bee4d6aa33d1abe490f0f9e', 'request_id': 'req-f86d0962-b5cd-449c-882f-58203da0666e'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:03.288497 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-f86d0962-b5cd-449c-882f-58203da0666e admin admin] The token cache is being invalidate because project 3d6e45622bee4d6aa33d1abe490f0f9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:21:03.288789 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-f86d0962-b5cd-449c-882f-58203da0666e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:03.289933 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-f86d0962-b5cd-449c-882f-58203da0666e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:21:03.291510 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1131/2233] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:21:02 2022] DELETE /identity/v3/projects/3d6e45622bee4d6aa33d1abe490f0f9e => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:21:03.302012 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ada7e7-fa7f-4ab3-8bb3-bd421f538c40 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:03.302308 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ada7e7-fa7f-4ab3-8bb3-bd421f538c40 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:03.302618 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ada7e7-fa7f-4ab3-8bb3-bd421f538c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:03.333184 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-91ada7e7-fa7f-4ab3-8bb3-bd421f538c40 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:03.334802 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-91ada7e7-fa7f-4ab3-8bb3-bd421f538c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:03.394158 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1103/2234] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:21:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:21:03.403815 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b13fa-af7e-46eb-93ce-eaad554c7bb4 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:03.404136 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b13fa-af7e-46eb-93ce-eaad554c7bb4 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:03.404412 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b13fa-af7e-46eb-93ce-eaad554c7bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:03.424732 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-013b13fa-af7e-46eb-93ce-eaad554c7bb4 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:03.425990 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-013b13fa-af7e-46eb-93ce-eaad554c7bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:03.435720 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1132/2235] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:21:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:21:03.439670 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ada7e7-fa7f-4ab3-8bb3-bd421f538c40 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:03.450503 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ada7e7-fa7f-4ab3-8bb3-bd421f538c40 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:03.456470 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de833f5-a78c-4db8-b91c-96f35e9dfaf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:03.457549 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de833f5-a78c-4db8-b91c-96f35e9dfaf6 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:03.457676 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de833f5-a78c-4db8-b91c-96f35e9dfaf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:03.457906 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de833f5-a78c-4db8-b91c-96f35e9dfaf6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:03.458656 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de833f5-a78c-4db8-b91c-96f35e9dfaf6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:21:03.458966 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de833f5-a78c-4db8-b91c-96f35e9dfaf6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:03.460736 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de833f5-a78c-4db8-b91c-96f35e9dfaf6 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:03.474061 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1104/2236] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 10 03:21:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:21:03.479608 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b13fa-af7e-46eb-93ce-eaad554c7bb4 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:03.489577 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b13fa-af7e-46eb-93ce-eaad554c7bb4 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:03.495291 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80da7023-0969-4e4e-8fcb-a6d87e90dc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:03.496114 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da7023-0969-4e4e-8fcb-a6d87e90dc84 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:03.496469 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da7023-0969-4e4e-8fcb-a6d87e90dc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:03.496889 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da7023-0969-4e4e-8fcb-a6d87e90dc84 admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:03.497645 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80da7023-0969-4e4e-8fcb-a6d87e90dc84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:03.499571 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80da7023-0969-4e4e-8fcb-a6d87e90dc84 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:03.606817 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1133/2237] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:21:03 2022] POST /identity/v3/projects => generated 383 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:21:03.609314 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de833f5-a78c-4db8-b91c-96f35e9dfaf6 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:03.620295 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de833f5-a78c-4db8-b91c-96f35e9dfaf6 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:03.721846 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b0c120-dfc7-4cef-8b5d-67cc98a861d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:03.723431 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0c120-dfc7-4cef-8b5d-67cc98a861d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:03.723720 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0c120-dfc7-4cef-8b5d-67cc98a861d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:03.724017 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0c120-dfc7-4cef-8b5d-67cc98a861d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:03.725866 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b0c120-dfc7-4cef-8b5d-67cc98a861d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:03.727736 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b0c120-dfc7-4cef-8b5d-67cc98a861d7 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:03.841311 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1105/2238] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:21:03 2022] POST /identity/v3/users => generated 292 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:21:03.845773 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80da7023-0969-4e4e-8fcb-a6d87e90dc84 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:03.859688 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80da7023-0969-4e4e-8fcb-a6d87e90dc84 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:03.872321 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11370b24-88cf-4852-98bf-a9805e6f2eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:03.873503 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11370b24-88cf-4852-98bf-a9805e6f2eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:03.873885 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11370b24-88cf-4852-98bf-a9805e6f2eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:03.874941 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11370b24-88cf-4852-98bf-a9805e6f2eb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:03.880743 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11370b24-88cf-4852-98bf-a9805e6f2eb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:03.884049 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11370b24-88cf-4852-98bf-a9805e6f2eb1 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:03.898501 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1134/2239] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:21:03.902151 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b0c120-dfc7-4cef-8b5d-67cc98a861d7 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:03.914994 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b0c120-dfc7-4cef-8b5d-67cc98a861d7 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:03.921393 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b85df-0665-48fd-8990-a43d6123ef0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:03.922146 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b85df-0665-48fd-8990-a43d6123ef0e admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:03.922572 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b85df-0665-48fd-8990-a43d6123ef0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:03.925001 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b85df-0665-48fd-8990-a43d6123ef0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:03.925920 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540b85df-0665-48fd-8990-a43d6123ef0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:03.927694 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540b85df-0665-48fd-8990-a43d6123ef0e admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:03.941886 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1106/2240] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:21:03.945768 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11370b24-88cf-4852-98bf-a9805e6f2eb1 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:03.956141 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11370b24-88cf-4852-98bf-a9805e6f2eb1 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:03.963738 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de40870d-d447-4962-a2d4-9699e8f097ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:03.964756 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40870d-d447-4962-a2d4-9699e8f097ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:03.965263 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40870d-d447-4962-a2d4-9699e8f097ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:03.965696 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40870d-d447-4962-a2d4-9699e8f097ac admin admin] PATH_INFO: `/v3/projects/c5f50448e3cc4533a5c70bb766559548/users/b978be2083814d1f825af17697b6613c/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:03.983598 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de40870d-d447-4962-a2d4-9699e8f097ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5f50448e3cc4533a5c70bb766559548, user_id=b978be2083814d1f825af17697b6613c, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:03.986319 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de40870d-d447-4962-a2d4-9699e8f097ac admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:04.076942 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1135/2241] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:21:03 2022] PUT /identity/v3/projects/c5f50448e3cc4533a5c70bb766559548/users/b978be2083814d1f825af17697b6613c/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:21:04.086131 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291ae35-71eb-44f0-877b-b6d7b3522d2e None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:04.086508 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291ae35-71eb-44f0-877b-b6d7b3522d2e None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:04.086856 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291ae35-71eb-44f0-877b-b6d7b3522d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:04.117426 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-1291ae35-71eb-44f0-877b-b6d7b3522d2e None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:04.118715 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-1291ae35-71eb-44f0-877b-b6d7b3522d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:04.223562 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1107/2242] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:21:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:21:04.246362 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de40870d-d447-4962-a2d4-9699e8f097ac admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:04.248320 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-de40870d-d447-4962-a2d4-9699e8f097ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:04.371532 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de40870d-d447-4962-a2d4-9699e8f097ac admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:04.376163 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f78e374-65ea-4236-9122-362f09ac3404 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:04.379045 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78e374-65ea-4236-9122-362f09ac3404 service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:04.379548 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78e374-65ea-4236-9122-362f09ac3404 service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:04.380252 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78e374-65ea-4236-9122-362f09ac3404 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:04.391156 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f78e374-65ea-4236-9122-362f09ac3404 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:04.392840 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f78e374-65ea-4236-9122-362f09ac3404 service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:04.407402 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1136/2243] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:21:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:21:11.806774 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef55c2-a9ad-43a9-a44c-37141761e7bd None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:11.807256 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef55c2-a9ad-43a9-a44c-37141761e7bd None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:11.807363 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef55c2-a9ad-43a9-a44c-37141761e7bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:11.853924 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-b5ef55c2-a9ad-43a9-a44c-37141761e7bd None None] MFA Rules not processed for user `b978be2083814d1f825af17697b6613c`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:11.855479 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-b5ef55c2-a9ad-43a9-a44c-37141761e7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:11.930744 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1108/2244] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:21:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:21:11.936244 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f78e374-65ea-4236-9122-362f09ac3404 service neutron] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:11.947651 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f78e374-65ea-4236-9122-362f09ac3404 service neutron] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:11.952487 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38fb5dc-4b4d-4b03-84b3-659a14cb7891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:11.953509 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38fb5dc-4b4d-4b03-84b3-659a14cb7891 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:11.953935 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38fb5dc-4b4d-4b03-84b3-659a14cb7891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:11.954341 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38fb5dc-4b4d-4b03-84b3-659a14cb7891 admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:11.955368 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38fb5dc-4b4d-4b03-84b3-659a14cb7891 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:11.957436 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38fb5dc-4b4d-4b03-84b3-659a14cb7891 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:12.040058 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1137/2245] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:21:11 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:21:12.043978 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef55c2-a9ad-43a9-a44c-37141761e7bd None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:12.061006 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef55c2-a9ad-43a9-a44c-37141761e7bd None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:12.131077 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece7f8b-ca2b-4a9e-aff3-11636e869f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:12.131868 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece7f8b-ca2b-4a9e-aff3-11636e869f95 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:12.132242 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece7f8b-ca2b-4a9e-aff3-11636e869f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:12.132607 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece7f8b-ca2b-4a9e-aff3-11636e869f95 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:12.133426 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ece7f8b-ca2b-4a9e-aff3-11636e869f95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:12.135425 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ece7f8b-ca2b-4a9e-aff3-11636e869f95 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:12.217727 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1109/2246] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:21:12 2022] POST /identity/v3/users => generated 299 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:21:12.224540 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38fb5dc-4b4d-4b03-84b3-659a14cb7891 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:12.235846 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38fb5dc-4b4d-4b03-84b3-659a14cb7891 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:12.242896 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c81d77-b537-4678-be8c-40fb54722b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:12.247241 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c81d77-b537-4678-be8c-40fb54722b1c admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:12.247241 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c81d77-b537-4678-be8c-40fb54722b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:12.247241 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c81d77-b537-4678-be8c-40fb54722b1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:12.247241 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c81d77-b537-4678-be8c-40fb54722b1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:12.248113 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c81d77-b537-4678-be8c-40fb54722b1c admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:12.262572 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1138/2247] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:21:12 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:21:12.266977 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece7f8b-ca2b-4a9e-aff3-11636e869f95 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:12.277703 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece7f8b-ca2b-4a9e-aff3-11636e869f95 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:12.283429 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd6873f-b55c-48c1-be4a-9615a29998c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:12.284360 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd6873f-b55c-48c1-be4a-9615a29998c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:12.284639 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd6873f-b55c-48c1-be4a-9615a29998c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:12.284907 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd6873f-b55c-48c1-be4a-9615a29998c4 admin admin] PATH_INFO: `/v3/projects/ced4058cd83546b98ab43c9d382c16d6/users/49739ce757a140aca5148abe2b6e7efa/roles/43105000610f402ca2486e7648018cca` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:12.300599 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd6873f-b55c-48c1-be4a-9615a29998c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ced4058cd83546b98ab43c9d382c16d6, user_id=49739ce757a140aca5148abe2b6e7efa, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:12.303888 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd6873f-b55c-48c1-be4a-9615a29998c4 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:12.371440 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1110/2248] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:21:12 2022] PUT /identity/v3/projects/ced4058cd83546b98ab43c9d382c16d6/users/49739ce757a140aca5148abe2b6e7efa/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:21:12.375146 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c81d77-b537-4678-be8c-40fb54722b1c admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:12.391916 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c81d77-b537-4678-be8c-40fb54722b1c admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:12.453818 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a413f97-a8f3-4039-97b5-de1586193124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:12.454440 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a413f97-a8f3-4039-97b5-de1586193124 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:12.455360 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a413f97-a8f3-4039-97b5-de1586193124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:12.455360 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a413f97-a8f3-4039-97b5-de1586193124 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:12.455753 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a413f97-a8f3-4039-97b5-de1586193124 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:12.457359 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a413f97-a8f3-4039-97b5-de1586193124 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:12.468073 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1139/2249] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:21:12 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:21:12.472259 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd6873f-b55c-48c1-be4a-9615a29998c4 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:12.483450 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd6873f-b55c-48c1-be4a-9615a29998c4 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:12.488477 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64858c2b-3126-47e8-bbcf-ba4a87314701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:12.489392 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64858c2b-3126-47e8-bbcf-ba4a87314701 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:12.489671 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64858c2b-3126-47e8-bbcf-ba4a87314701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:12.489942 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64858c2b-3126-47e8-bbcf-ba4a87314701 admin admin] PATH_INFO: `/v3/projects/ced4058cd83546b98ab43c9d382c16d6/users/49739ce757a140aca5148abe2b6e7efa/roles/43105000610f402ca2486e7648018cca` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:12.493541 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64858c2b-3126-47e8-bbcf-ba4a87314701 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ced4058cd83546b98ab43c9d382c16d6, user_id=49739ce757a140aca5148abe2b6e7efa, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:12.496634 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64858c2b-3126-47e8-bbcf-ba4a87314701 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:12.511305 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1111/2250] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:21:12 2022] PUT /identity/v3/projects/ced4058cd83546b98ab43c9d382c16d6/users/49739ce757a140aca5148abe2b6e7efa/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:21:15.359015 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474efa8-fbea-4002-af62-b629d83baf8f None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:15.359604 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474efa8-fbea-4002-af62-b629d83baf8f None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:15.359604 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474efa8-fbea-4002-af62-b629d83baf8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:15.420298 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-7474efa8-fbea-4002-af62-b629d83baf8f None None] MFA Rules not processed for user `6ebfab3ff0b24f4aaabb8c6bb0ad10c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:15.426322 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-7474efa8-fbea-4002-af62-b629d83baf8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:15.558825 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1140/2251] 10.222.0.65 () {58 vars in 1009 bytes} [Tue May 10 03:21:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:21:15.725286 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64858c2b-3126-47e8-bbcf-ba4a87314701 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:15.727673 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-64858c2b-3126-47e8-bbcf-ba4a87314701 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:15.884902 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64858c2b-3126-47e8-bbcf-ba4a87314701 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:15.897146 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959de461-833c-405a-9889-e5f065c401ba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1cb8ad43a234233ad602f451f0f8ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:15.897979 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959de461-833c-405a-9889-e5f065c401ba service swift] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:15.898271 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959de461-833c-405a-9889-e5f065c401ba service swift] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:15.898557 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959de461-833c-405a-9889-e5f065c401ba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:15.910905 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959de461-833c-405a-9889-e5f065c401ba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:15.913190 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959de461-833c-405a-9889-e5f065c401ba service swift] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:15.945822 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1112/2252] 10.222.0.65 () {60 vars in 1384 bytes} [Tue May 10 03:21:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 03:21:21.036762 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7474efa8-fbea-4002-af62-b629d83baf8f None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:21.041840 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-7474efa8-fbea-4002-af62-b629d83baf8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:21.150852 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7474efa8-fbea-4002-af62-b629d83baf8f None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:21.156141 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49397d8c-a795-40dc-b9e6-5c90737fc8d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:21.156818 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49397d8c-a795-40dc-b9e6-5c90737fc8d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:21.157101 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49397d8c-a795-40dc-b9e6-5c90737fc8d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:21.157391 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49397d8c-a795-40dc-b9e6-5c90737fc8d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:21.161262 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-49397d8c-a795-40dc-b9e6-5c90737fc8d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:21.290337 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49397d8c-a795-40dc-b9e6-5c90737fc8d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:21.291903 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49397d8c-a795-40dc-b9e6-5c90737fc8d5 service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:21.309886 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1141/2253] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:21:21 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:21:22.080771 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdf751-9b3d-466b-9a87-22d5706e1cdf None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:22.081802 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdf751-9b3d-466b-9a87-22d5706e1cdf None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:22.082077 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdf751-9b3d-466b-9a87-22d5706e1cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:22.117914 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-b3cdf751-9b3d-466b-9a87-22d5706e1cdf None None] MFA Rules not processed for user `49739ce757a140aca5148abe2b6e7efa`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:22.119125 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-b3cdf751-9b3d-466b-9a87-22d5706e1cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:22.200429 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1113/2254] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:21:22 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:21:22.213193 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49397d8c-a795-40dc-b9e6-5c90737fc8d5 service neutron] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:22.215070 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-49397d8c-a795-40dc-b9e6-5c90737fc8d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:22.381642 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49397d8c-a795-40dc-b9e6-5c90737fc8d5 service neutron] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:22.392479 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ab6af0-65ff-4575-be69-a170d3a313d8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c79f0a3a3223444c82589da07305469f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:22.393162 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab6af0-65ff-4575-be69-a170d3a313d8 service glance] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:22.393444 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab6af0-65ff-4575-be69-a170d3a313d8 service glance] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:22.393723 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab6af0-65ff-4575-be69-a170d3a313d8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:22.510012 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ab6af0-65ff-4575-be69-a170d3a313d8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:22.511995 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ab6af0-65ff-4575-be69-a170d3a313d8 service glance] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:22.529141 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1142/2255] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:21:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:21:22.850133 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc3154-4bde-47ba-8e90-7b03b4058c85 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:22.850430 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc3154-4bde-47ba-8e90-7b03b4058c85 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:22.850706 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc3154-4bde-47ba-8e90-7b03b4058c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:22.883044 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-debc3154-4bde-47ba-8e90-7b03b4058c85 None None] MFA Rules not processed for user `6ebfab3ff0b24f4aaabb8c6bb0ad10c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:22.884332 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-debc3154-4bde-47ba-8e90-7b03b4058c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:22.905785 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1114/2256] 10.222.0.65 () {58 vars in 1009 bytes} [Tue May 10 03:21:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:21:22.926758 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ab6af0-65ff-4575-be69-a170d3a313d8 service glance] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:22.947805 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ab6af0-65ff-4575-be69-a170d3a313d8 service glance] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:22.957345 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb35406-db7a-439b-94f1-dd399d83a2d6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1cb8ad43a234233ad602f451f0f8ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:22.958084 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb35406-db7a-439b-94f1-dd399d83a2d6 service swift] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:22.958374 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb35406-db7a-439b-94f1-dd399d83a2d6 service swift] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:22.958653 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb35406-db7a-439b-94f1-dd399d83a2d6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:22.978512 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb35406-db7a-439b-94f1-dd399d83a2d6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:22.982824 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb35406-db7a-439b-94f1-dd399d83a2d6 service swift] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:23.010348 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1143/2257] 10.222.0.65 () {60 vars in 1384 bytes} [Tue May 10 03:21:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 03:21:24.596383 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c5eab3-04b7-4b55-bad7-150b1d39333e None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:24.596858 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c5eab3-04b7-4b55-bad7-150b1d39333e None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:24.597116 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c5eab3-04b7-4b55-bad7-150b1d39333e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:24.624332 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-d7c5eab3-04b7-4b55-bad7-150b1d39333e None None] MFA Rules not processed for user `e309fb66a98b407d8b7533207e6a6dfc`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:24.626369 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-d7c5eab3-04b7-4b55-bad7-150b1d39333e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:24.720715 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1115/2258] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:21:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:21:36.847038 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14adbe29-7577-45d0-a6a5-5d912617e0f9 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:36.847691 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14adbe29-7577-45d0-a6a5-5d912617e0f9 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:36.847691 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14adbe29-7577-45d0-a6a5-5d912617e0f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:36.865823 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-14adbe29-7577-45d0-a6a5-5d912617e0f9 None None] MFA Rules not processed for user `b978be2083814d1f825af17697b6613c`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:36.867028 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-14adbe29-7577-45d0-a6a5-5d912617e0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:36.873924 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1144/2259] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:21:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:21:39.646406 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db1443-1641-4835-a067-8178a75ba739 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:39.647003 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db1443-1641-4835-a067-8178a75ba739 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:39.647110 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db1443-1641-4835-a067-8178a75ba739 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:39.648641 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1116/2260] 10.222.0.65 () {54 vars in 921 bytes} [Tue May 10 03:21:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:21:39.658184 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7658568e-3aeb-48e3-ac13-3301dc0ec2b5 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:39.658653 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7658568e-3aeb-48e3-ac13-3301dc0ec2b5 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:39.658761 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7658568e-3aeb-48e3-ac13-3301dc0ec2b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:39.737466 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-7658568e-3aeb-48e3-ac13-3301dc0ec2b5 None None] MFA Rules not processed for user `9b7ccdccba0b4f9e86817946f22dbe28`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:39.738874 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-7658568e-3aeb-48e3-ac13-3301dc0ec2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:39.841560 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1145/2261] 10.222.0.65 () {58 vars in 1018 bytes} [Tue May 10 03:21:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:21:39.854407 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db1443-1641-4835-a067-8178a75ba739 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:39.856272 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-43db1443-1641-4835-a067-8178a75ba739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:39.902201 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db1443-1641-4835-a067-8178a75ba739 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:39.907985 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34320224-eb50-454c-aed7-61f332b98e7d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c79f0a3a3223444c82589da07305469f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:39.908886 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34320224-eb50-454c-aed7-61f332b98e7d service glance] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:39.909230 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34320224-eb50-454c-aed7-61f332b98e7d service glance] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:39.909700 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34320224-eb50-454c-aed7-61f332b98e7d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:39.922877 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34320224-eb50-454c-aed7-61f332b98e7d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:39.924508 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34320224-eb50-454c-aed7-61f332b98e7d service glance] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:39.949189 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1117/2262] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:21:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:21:40.189568 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3a2a3-f07a-48e0-8c2f-7056b6a5fcbc None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:40.193655 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3a2a3-f07a-48e0-8c2f-7056b6a5fcbc None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:40.193655 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3a2a3-f07a-48e0-8c2f-7056b6a5fcbc None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:40.193655 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1146/2263] 10.222.0.65 () {54 vars in 921 bytes} [Tue May 10 03:21:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:21:40.198112 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43283985-0763-4539-8458-4ce9ec056779 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:40.198657 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43283985-0763-4539-8458-4ce9ec056779 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:40.199053 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43283985-0763-4539-8458-4ce9ec056779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:40.218319 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-43283985-0763-4539-8458-4ce9ec056779 None None] MFA Rules not processed for user `ccfba74826234915bc989fede9bde3e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:40.219646 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-43283985-0763-4539-8458-4ce9ec056779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:40.227419 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1118/2264] 10.222.0.65 () {58 vars in 1018 bytes} [Tue May 10 03:21:40 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:21:40.242000 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c3a2a3-f07a-48e0-8c2f-7056b6a5fcbc None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:40.254816 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c3a2a3-f07a-48e0-8c2f-7056b6a5fcbc None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:40.264228 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d468c5de-1b93-4497-a561-c05739267619 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:40.265125 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468c5de-1b93-4497-a561-c05739267619 service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:40.266150 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468c5de-1b93-4497-a561-c05739267619 service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:40.266444 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468c5de-1b93-4497-a561-c05739267619 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:40.277571 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d468c5de-1b93-4497-a561-c05739267619 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:40.279064 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d468c5de-1b93-4497-a561-c05739267619 service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:40.287544 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1147/2265] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:21:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:21:40.374569 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4a30e-1c15-442d-bdbb-797610d7beca None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:40.375019 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4a30e-1c15-442d-bdbb-797610d7beca None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:40.375436 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4a30e-1c15-442d-bdbb-797610d7beca None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:40.377101 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1119/2266] 10.222.0.65 () {54 vars in 921 bytes} [Tue May 10 03:21:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:21:40.384622 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595a2e9-2e07-466e-917e-e6666f73e7d1 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:40.384811 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595a2e9-2e07-466e-917e-e6666f73e7d1 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:40.385192 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595a2e9-2e07-466e-917e-e6666f73e7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:40.404774 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-2595a2e9-2e07-466e-917e-e6666f73e7d1 None None] MFA Rules not processed for user `9b7ccdccba0b4f9e86817946f22dbe28`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:40.406068 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-2595a2e9-2e07-466e-917e-e6666f73e7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:40.417413 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1148/2267] 10.222.0.65 () {58 vars in 1018 bytes} [Tue May 10 03:21:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:21:40.429458 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c4a30e-1c15-442d-bdbb-797610d7beca None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:40.440725 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c4a30e-1c15-442d-bdbb-797610d7beca None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:40.445113 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759fa6c4-0410-418d-a1a0-7185ac4617e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:40.445820 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759fa6c4-0410-418d-a1a0-7185ac4617e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:40.446103 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759fa6c4-0410-418d-a1a0-7185ac4617e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:40.446407 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759fa6c4-0410-418d-a1a0-7185ac4617e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:40.462438 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759fa6c4-0410-418d-a1a0-7185ac4617e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:40.463948 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759fa6c4-0410-418d-a1a0-7185ac4617e8 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:40.481678 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1120/2268] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:21:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:21:40.526546 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a4a334-cf05-482b-8681-e568d3529d20 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:40.526913 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a4a334-cf05-482b-8681-e568d3529d20 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:40.527282 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a4a334-cf05-482b-8681-e568d3529d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:40.587590 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-69a4a334-cf05-482b-8681-e568d3529d20 None None] MFA Rules not processed for user `6ebfab3ff0b24f4aaabb8c6bb0ad10c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:40.589243 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-69a4a334-cf05-482b-8681-e568d3529d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:40.611335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1149/2269] 10.222.0.65 () {58 vars in 1009 bytes} [Tue May 10 03:21:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:21:40.625693 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759fa6c4-0410-418d-a1a0-7185ac4617e8 service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:40.649692 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759fa6c4-0410-418d-a1a0-7185ac4617e8 service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:40.655802 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb07733-930e-4ace-9f3a-29ec0b16b806 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1cb8ad43a234233ad602f451f0f8ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:40.656559 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb07733-930e-4ace-9f3a-29ec0b16b806 service swift] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:40.656910 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb07733-930e-4ace-9f3a-29ec0b16b806 service swift] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:40.657371 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb07733-930e-4ace-9f3a-29ec0b16b806 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:40.667926 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb07733-930e-4ace-9f3a-29ec0b16b806 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:40.670123 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb07733-930e-4ace-9f3a-29ec0b16b806 service swift] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:40.680745 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1121/2270] 10.222.0.65 () {60 vars in 1384 bytes} [Tue May 10 03:21:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 10 03:21:55.523900 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aaaeee-962f-4985-9297-238859766382 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:55.524460 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aaaeee-962f-4985-9297-238859766382 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:55.524561 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aaaeee-962f-4985-9297-238859766382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:55.541871 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-18aaaeee-962f-4985-9297-238859766382 None None] MFA Rules not processed for user `6ebfab3ff0b24f4aaabb8c6bb0ad10c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:21:55.543060 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-18aaaeee-962f-4985-9297-238859766382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:21:55.550420 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1150/2271] 10.222.0.65 () {58 vars in 1009 bytes} [Tue May 10 03:21:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:21:55.563112 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb07733-930e-4ace-9f3a-29ec0b16b806 service swift] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:21:55.574283 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb07733-930e-4ace-9f3a-29ec0b16b806 service swift] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:21:55.580342 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebe65a5-0dfe-4850-aac2-a57524a5c846 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1cb8ad43a234233ad602f451f0f8ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:21:55.581647 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe65a5-0dfe-4850-aac2-a57524a5c846 service swift] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:21:55.581846 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe65a5-0dfe-4850-aac2-a57524a5c846 service swift] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:21:55.582227 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe65a5-0dfe-4850-aac2-a57524a5c846 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:21:55.596465 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebe65a5-0dfe-4850-aac2-a57524a5c846 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:21:55.596465 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebe65a5-0dfe-4850-aac2-a57524a5c846 service swift] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:21:55.601223 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1122/2272] 10.222.0.65 () {60 vars in 1384 bytes} [Tue May 10 03:21:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 10 03:22:12.099764 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aaaeee-962f-4985-9297-238859766382 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:22:12.104810 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-18aaaeee-962f-4985-9297-238859766382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:22:12.302430 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aaaeee-962f-4985-9297-238859766382 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:22:12.312920 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a40ec0d-a181-49dd-a501-6fdc159cc20a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f646147bdad8476ba0ab9da5d9c50b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:22:12.313797 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40ec0d-a181-49dd-a501-6fdc159cc20a service placement] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:12.314185 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40ec0d-a181-49dd-a501-6fdc159cc20a service placement] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:12.314846 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40ec0d-a181-49dd-a501-6fdc159cc20a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:12.317682 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-5a40ec0d-a181-49dd-a501-6fdc159cc20a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:22:12.337636 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a40ec0d-a181-49dd-a501-6fdc159cc20a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:22:12.341146 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a40ec0d-a181-49dd-a501-6fdc159cc20a service placement] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:22:12.369900 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1151/2273] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:22:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:22:16.812410 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ba6d7-73ec-4e79-b01e-4b4aa8deaf5a None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:16.812897 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ba6d7-73ec-4e79-b01e-4b4aa8deaf5a None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:16.812989 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ba6d7-73ec-4e79-b01e-4b4aa8deaf5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:16.831159 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-a76ba6d7-73ec-4e79-b01e-4b4aa8deaf5a None None] MFA Rules not processed for user `6ebfab3ff0b24f4aaabb8c6bb0ad10c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:22:16.832409 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-a76ba6d7-73ec-4e79-b01e-4b4aa8deaf5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:22:16.840248 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1123/2274] 10.222.0.65 () {58 vars in 967 bytes} [Tue May 10 03:22:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:22:16.863935 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a40ec0d-a181-49dd-a501-6fdc159cc20a service placement] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:22:16.875875 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a40ec0d-a181-49dd-a501-6fdc159cc20a service placement] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:22:16.880963 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767dd923-4993-4c25-96f2-669c822fec9e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1cb8ad43a234233ad602f451f0f8ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:22:16.882105 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767dd923-4993-4c25-96f2-669c822fec9e service swift] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:16.882404 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767dd923-4993-4c25-96f2-669c822fec9e service swift] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:16.882688 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767dd923-4993-4c25-96f2-669c822fec9e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:16.891060 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767dd923-4993-4c25-96f2-669c822fec9e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:22:16.892719 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767dd923-4993-4c25-96f2-669c822fec9e service swift] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:22:16.901701 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1152/2275] 10.222.0.65 () {60 vars in 1384 bytes} [Tue May 10 03:22:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 03:22:21.979871 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ba6d7-73ec-4e79-b01e-4b4aa8deaf5a None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:22:21.989475 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ba6d7-73ec-4e79-b01e-4b4aa8deaf5a None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:22:21.994705 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e3593-631a-4159-9b57-386556d07418 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:22:21.995371 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e3593-631a-4159-9b57-386556d07418 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:21.995840 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e3593-631a-4159-9b57-386556d07418 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:21.996358 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e3593-631a-4159-9b57-386556d07418 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:22.005962 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9e3593-631a-4159-9b57-386556d07418 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:22:22.007443 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9e3593-631a-4159-9b57-386556d07418 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:22:22.017120 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1124/2276] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:22:21 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:22:26.720257 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344afb3-e87d-431e-8d04-6b35c9f38097 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:22:26.722433 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344afb3-e87d-431e-8d04-6b35c9f38097 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:22:26.722433 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344afb3-e87d-431e-8d04-6b35c9f38097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:22:26.739065 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-4344afb3-e87d-431e-8d04-6b35c9f38097 None None] MFA Rules not processed for user `9407e88fdbd74ba196ffd9fd221e15f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:22:26.740362 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-4344afb3-e87d-431e-8d04-6b35c9f38097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:22:26.796133 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1153/2277] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:22:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:23:10.610805 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8e4d9-de32-4d35-b1ce-75691b541a01 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:23:10.611363 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8e4d9-de32-4d35-b1ce-75691b541a01 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:23:10.611478 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8e4d9-de32-4d35-b1ce-75691b541a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:23:10.628906 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-23c8e4d9-de32-4d35-b1ce-75691b541a01 None None] MFA Rules not processed for user `9dff947a164641e7b32c639bebbffe36`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:23:10.630112 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-23c8e4d9-de32-4d35-b1ce-75691b541a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:23:10.684054 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1125/2278] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:23:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:23:23.703502 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e39a7-042a-4fc5-a296-3145adeda655 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:23:23.704048 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e39a7-042a-4fc5-a296-3145adeda655 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:23:23.704158 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e39a7-042a-4fc5-a296-3145adeda655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:23:23.722250 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-605e39a7-042a-4fc5-a296-3145adeda655 None None] MFA Rules not processed for user `e309fb66a98b407d8b7533207e6a6dfc`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:23:23.723490 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-605e39a7-042a-4fc5-a296-3145adeda655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:23:23.730389 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1154/2279] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:23:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:23:29.155188 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb92816-1e0f-4d92-a273-33be3dbc8b10 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:23:29.155725 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb92816-1e0f-4d92-a273-33be3dbc8b10 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:23:29.156166 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb92816-1e0f-4d92-a273-33be3dbc8b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:23:29.183102 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-4eb92816-1e0f-4d92-a273-33be3dbc8b10 None None] MFA Rules not processed for user `a14e317d371c4f9f994a568798c00e90`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:23:29.184457 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-4eb92816-1e0f-4d92-a273-33be3dbc8b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:23:29.250264 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1126/2280] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:23:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:23:39.503225 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856e321-d15f-4a15-aa7c-8575ff2f5fe3 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:23:39.503734 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856e321-d15f-4a15-aa7c-8575ff2f5fe3 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:23:39.503839 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856e321-d15f-4a15-aa7c-8575ff2f5fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:23:39.525763 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-1856e321-d15f-4a15-aa7c-8575ff2f5fe3 None None] MFA Rules not processed for user `9407e88fdbd74ba196ffd9fd221e15f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:23:39.526966 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-1856e321-d15f-4a15-aa7c-8575ff2f5fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:23:39.534119 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1155/2281] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:23:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:23:48.716132 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2680e651-d1b6-4837-bf97-84c4d5f867be None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:23:48.716605 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2680e651-d1b6-4837-bf97-84c4d5f867be None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:23:48.716703 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2680e651-d1b6-4837-bf97-84c4d5f867be None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:23:48.717999 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1127/2282] 10.222.0.65 () {54 vars in 921 bytes} [Tue May 10 03:23:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:23:48.723816 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b72faa-c301-4a25-8f04-ca29e53c84dc None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:23:48.724351 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b72faa-c301-4a25-8f04-ca29e53c84dc None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:23:48.724456 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b72faa-c301-4a25-8f04-ca29e53c84dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:23:48.744093 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-51b72faa-c301-4a25-8f04-ca29e53c84dc None None] MFA Rules not processed for user `ccfba74826234915bc989fede9bde3e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:23:48.745401 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-51b72faa-c301-4a25-8f04-ca29e53c84dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:23:48.752805 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1156/2283] 10.222.0.65 () {58 vars in 1018 bytes} [Tue May 10 03:23:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:23:48.764917 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2680e651-d1b6-4837-bf97-84c4d5f867be None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:23:48.776119 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2680e651-d1b6-4837-bf97-84c4d5f867be None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:23:48.780237 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b5a187-b2ec-4b91-ae8c-25f6553121d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:23:48.780906 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5a187-b2ec-4b91-ae8c-25f6553121d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:23:48.781192 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5a187-b2ec-4b91-ae8c-25f6553121d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:23:48.781471 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5a187-b2ec-4b91-ae8c-25f6553121d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:23:48.788735 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b5a187-b2ec-4b91-ae8c-25f6553121d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:23:48.790171 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b5a187-b2ec-4b91-ae8c-25f6553121d2 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:23:48.798976 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1128/2284] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:23:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:23:48.884859 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d18637-0593-4d72-8781-01ef26c65a7c None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:23:48.885144 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d18637-0593-4d72-8781-01ef26c65a7c None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:23:48.885421 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d18637-0593-4d72-8781-01ef26c65a7c None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:23:48.886812 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1157/2285] 10.222.0.65 () {54 vars in 921 bytes} [Tue May 10 03:23:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 03:23:48.894414 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13600011-1897-4f0b-9959-2c4eee9ad9a6 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:23:48.894414 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13600011-1897-4f0b-9959-2c4eee9ad9a6 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:23:48.894414 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13600011-1897-4f0b-9959-2c4eee9ad9a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:23:48.918702 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-13600011-1897-4f0b-9959-2c4eee9ad9a6 None None] MFA Rules not processed for user `9b7ccdccba0b4f9e86817946f22dbe28`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:23:48.921374 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-13600011-1897-4f0b-9959-2c4eee9ad9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:23:48.934670 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1129/2286] 10.222.0.65 () {58 vars in 1018 bytes} [Tue May 10 03:23:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:23:48.945465 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d18637-0593-4d72-8781-01ef26c65a7c None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:23:48.957167 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d18637-0593-4d72-8781-01ef26c65a7c None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:23:48.960754 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a3087-7d19-4304-b37a-5fe992ba84d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:23:48.961389 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a3087-7d19-4304-b37a-5fe992ba84d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:23:48.961672 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a3087-7d19-4304-b37a-5fe992ba84d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:23:48.961950 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a3087-7d19-4304-b37a-5fe992ba84d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:23:48.973177 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1a3087-7d19-4304-b37a-5fe992ba84d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:23:48.974631 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1a3087-7d19-4304-b37a-5fe992ba84d6 service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:23:48.986125 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1158/2287] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:23:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:23:57.212867 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13600011-1897-4f0b-9959-2c4eee9ad9a6 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:23:57.222235 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13600011-1897-4f0b-9959-2c4eee9ad9a6 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:23:57.226055 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac50d9-b3b0-4c65-949d-6abf7a490e7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:23:57.226709 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac50d9-b3b0-4c65-949d-6abf7a490e7a service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:23:57.226994 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac50d9-b3b0-4c65-949d-6abf7a490e7a service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:23:57.227471 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac50d9-b3b0-4c65-949d-6abf7a490e7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:23:57.229269 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-efac50d9-b3b0-4c65-949d-6abf7a490e7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:23:57.243535 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efac50d9-b3b0-4c65-949d-6abf7a490e7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:23:57.245458 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efac50d9-b3b0-4c65-949d-6abf7a490e7a service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:23:57.257591 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1130/2288] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:23:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:23:58.431847 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a3087-7d19-4304-b37a-5fe992ba84d6 service neutron] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:23:58.440767 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a3087-7d19-4304-b37a-5fe992ba84d6 service neutron] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:23:58.444404 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7423e0-301b-4855-bb04-d17ea1e3064c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:23:58.445038 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7423e0-301b-4855-bb04-d17ea1e3064c service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:23:58.445320 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7423e0-301b-4855-bb04-d17ea1e3064c service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:23:58.445598 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7423e0-301b-4855-bb04-d17ea1e3064c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:23:58.447369 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-3c7423e0-301b-4855-bb04-d17ea1e3064c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:23:58.462194 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7423e0-301b-4855-bb04-d17ea1e3064c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:23:58.465598 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7423e0-301b-4855-bb04-d17ea1e3064c service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:23:58.475578 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1159/2289] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:23:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:24:14.366337 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac50d9-b3b0-4c65-949d-6abf7a490e7a service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:14.367772 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-efac50d9-b3b0-4c65-949d-6abf7a490e7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:24:14.443625 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac50d9-b3b0-4c65-949d-6abf7a490e7a service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:14.447431 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ef679-cc75-422a-82b0-93ca8bea5c85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:14.448169 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ef679-cc75-422a-82b0-93ca8bea5c85 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:14.448572 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ef679-cc75-422a-82b0-93ca8bea5c85 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:14.448862 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ef679-cc75-422a-82b0-93ca8bea5c85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:14.450648 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-1a3ef679-cc75-422a-82b0-93ca8bea5c85 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:24:14.462540 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3ef679-cc75-422a-82b0-93ca8bea5c85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:14.463865 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3ef679-cc75-422a-82b0-93ca8bea5c85 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:14.473472 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1131/2290] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:24:14 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:24:18.789321 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a99eb78-83e5-485b-84e5-244bd2b16eac None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:18.789853 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a99eb78-83e5-485b-84e5-244bd2b16eac None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:18.789853 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a99eb78-83e5-485b-84e5-244bd2b16eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:18.809578 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-2a99eb78-83e5-485b-84e5-244bd2b16eac None None] MFA Rules not processed for user `6ebfab3ff0b24f4aaabb8c6bb0ad10c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:24:18.810799 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-2a99eb78-83e5-485b-84e5-244bd2b16eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:24:18.820695 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1160/2291] 10.222.0.65 () {58 vars in 967 bytes} [Tue May 10 03:24:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:24:18.980377 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ef679-cc75-422a-82b0-93ca8bea5c85 service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:18.996574 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ef679-cc75-422a-82b0-93ca8bea5c85 service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:19.003397 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540fb96f-1312-4705-8c69-2cefc333f5ac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1cb8ad43a234233ad602f451f0f8ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:19.004085 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540fb96f-1312-4705-8c69-2cefc333f5ac service swift] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:19.004376 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540fb96f-1312-4705-8c69-2cefc333f5ac service swift] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:19.004659 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540fb96f-1312-4705-8c69-2cefc333f5ac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:19.013082 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540fb96f-1312-4705-8c69-2cefc333f5ac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:19.017111 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540fb96f-1312-4705-8c69-2cefc333f5ac service swift] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:19.023362 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1132/2292] 10.222.0.65 () {60 vars in 1384 bytes} [Tue May 10 03:24:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 03:24:20.099114 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a99eb78-83e5-485b-84e5-244bd2b16eac None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:20.109059 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a99eb78-83e5-485b-84e5-244bd2b16eac None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:20.116685 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f09f4f-b784-4b4c-9f54-5427374c87da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:20.117404 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f09f4f-b784-4b4c-9f54-5427374c87da service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:20.117725 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f09f4f-b784-4b4c-9f54-5427374c87da service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:20.118004 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f09f4f-b784-4b4c-9f54-5427374c87da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:20.119929 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-c5f09f4f-b784-4b4c-9f54-5427374c87da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:24:20.131529 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f09f4f-b784-4b4c-9f54-5427374c87da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:20.133000 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f09f4f-b784-4b4c-9f54-5427374c87da service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:20.142146 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1161/2293] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:24:20 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:24:28.264193 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540fb96f-1312-4705-8c69-2cefc333f5ac service swift] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:28.327539 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540fb96f-1312-4705-8c69-2cefc333f5ac service swift] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:28.332754 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88614700-51e1-429f-9c04-862c278036da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:28.333654 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88614700-51e1-429f-9c04-862c278036da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:28.333960 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88614700-51e1-429f-9c04-862c278036da admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:28.334236 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88614700-51e1-429f-9c04-862c278036da admin admin] PATH_INFO: `/v3/users/b978be2083814d1f825af17697b6613c` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:28.335429 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88614700-51e1-429f-9c04-862c278036da admin admin] RBAC: Authorizing `identity:delete_user(user_id=b978be2083814d1f825af17697b6613c)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:28.337386 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88614700-51e1-429f-9c04-862c278036da admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:28.536030 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-88614700-51e1-429f-9c04-862c278036da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b978be2083814d1f825af17697b6613c'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:28.539039 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-88614700-51e1-429f-9c04-862c278036da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b978be2083814d1f825af17697b6613c'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:28.543535 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-88614700-51e1-429f-9c04-862c278036da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b978be2083814d1f825af17697b6613c'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:28.609196 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-88614700-51e1-429f-9c04-862c278036da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b978be2083814d1f825af17697b6613c'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:28.609751 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-88614700-51e1-429f-9c04-862c278036da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b978be2083814d1f825af17697b6613c'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:28.626452 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1133/2294] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:24:28 2022] DELETE /identity/v3/users/b978be2083814d1f825af17697b6613c => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:24:28.839392 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f09f4f-b784-4b4c-9f54-5427374c87da service neutron] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:28.850919 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f09f4f-b784-4b4c-9f54-5427374c87da service neutron] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:28.905250 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996693d3-f287-4222-b742-7df69ad80b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:28.906110 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996693d3-f287-4222-b742-7df69ad80b42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:28.906397 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996693d3-f287-4222-b742-7df69ad80b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:28.906675 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996693d3-f287-4222-b742-7df69ad80b42 admin admin] PATH_INFO: `/v3/projects/c5f50448e3cc4533a5c70bb766559548` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:28.907850 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996693d3-f287-4222-b742-7df69ad80b42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5f50448e3cc4533a5c70bb766559548)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:28.909799 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996693d3-f287-4222-b742-7df69ad80b42 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:28.999205 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-996693d3-f287-4222-b742-7df69ad80b42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5f50448e3cc4533a5c70bb766559548', 'request_id': 'req-996693d3-f287-4222-b742-7df69ad80b42'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:29.005390 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-996693d3-f287-4222-b742-7df69ad80b42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5f50448e3cc4533a5c70bb766559548', 'request_id': 'req-996693d3-f287-4222-b742-7df69ad80b42'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:29.011426 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-996693d3-f287-4222-b742-7df69ad80b42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5f50448e3cc4533a5c70bb766559548', 'request_id': 'req-996693d3-f287-4222-b742-7df69ad80b42'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:29.071863 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-996693d3-f287-4222-b742-7df69ad80b42 admin admin] The token cache is being invalidate because project c5f50448e3cc4533a5c70bb766559548 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:24:29.072179 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-996693d3-f287-4222-b742-7df69ad80b42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:29.072815 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-996693d3-f287-4222-b742-7df69ad80b42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:29.074353 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1162/2295] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:24:28 2022] DELETE /identity/v3/projects/c5f50448e3cc4533a5c70bb766559548 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:24:29.078435 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88614700-51e1-429f-9c04-862c278036da admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:29.079835 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-88614700-51e1-429f-9c04-862c278036da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:24:29.092850 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88614700-51e1-429f-9c04-862c278036da admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:29.147563 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6951ca58-6e5c-485e-bb8c-a14dfa66bd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:29.148458 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951ca58-6e5c-485e-bb8c-a14dfa66bd1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:29.148738 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951ca58-6e5c-485e-bb8c-a14dfa66bd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:29.149006 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951ca58-6e5c-485e-bb8c-a14dfa66bd1a admin admin] PATH_INFO: `/v3/users/49739ce757a140aca5148abe2b6e7efa` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:29.150171 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6951ca58-6e5c-485e-bb8c-a14dfa66bd1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=49739ce757a140aca5148abe2b6e7efa)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:29.152108 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6951ca58-6e5c-485e-bb8c-a14dfa66bd1a admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:29.279140 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-6951ca58-6e5c-485e-bb8c-a14dfa66bd1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49739ce757a140aca5148abe2b6e7efa'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:29.286339 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-6951ca58-6e5c-485e-bb8c-a14dfa66bd1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49739ce757a140aca5148abe2b6e7efa'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:29.287200 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-6951ca58-6e5c-485e-bb8c-a14dfa66bd1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49739ce757a140aca5148abe2b6e7efa'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:29.329624 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-6951ca58-6e5c-485e-bb8c-a14dfa66bd1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49739ce757a140aca5148abe2b6e7efa'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:29.330250 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-6951ca58-6e5c-485e-bb8c-a14dfa66bd1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49739ce757a140aca5148abe2b6e7efa'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:29.349631 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1134/2296] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:24:29 2022] DELETE /identity/v3/users/49739ce757a140aca5148abe2b6e7efa => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:24:29.595386 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996693d3-f287-4222-b742-7df69ad80b42 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:29.597704 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-996693d3-f287-4222-b742-7df69ad80b42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:24:29.619937 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996693d3-f287-4222-b742-7df69ad80b42 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:29.689805 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c3902-1dbb-4e85-9fb9-392cf6564270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:29.690862 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c3902-1dbb-4e85-9fb9-392cf6564270 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:29.691245 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c3902-1dbb-4e85-9fb9-392cf6564270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:29.691622 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c3902-1dbb-4e85-9fb9-392cf6564270 admin admin] PATH_INFO: `/v3/projects/ced4058cd83546b98ab43c9d382c16d6` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:29.693006 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852c3902-1dbb-4e85-9fb9-392cf6564270 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ced4058cd83546b98ab43c9d382c16d6)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:29.695018 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852c3902-1dbb-4e85-9fb9-392cf6564270 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:29.793301 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-852c3902-1dbb-4e85-9fb9-392cf6564270 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ced4058cd83546b98ab43c9d382c16d6', 'request_id': 'req-852c3902-1dbb-4e85-9fb9-392cf6564270'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:29.799312 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-852c3902-1dbb-4e85-9fb9-392cf6564270 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ced4058cd83546b98ab43c9d382c16d6', 'request_id': 'req-852c3902-1dbb-4e85-9fb9-392cf6564270'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:29.805640 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-852c3902-1dbb-4e85-9fb9-392cf6564270 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ced4058cd83546b98ab43c9d382c16d6', 'request_id': 'req-852c3902-1dbb-4e85-9fb9-392cf6564270'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:29.877332 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-852c3902-1dbb-4e85-9fb9-392cf6564270 admin admin] The token cache is being invalidate because project ced4058cd83546b98ab43c9d382c16d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:24:29.877959 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-852c3902-1dbb-4e85-9fb9-392cf6564270 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:29.878503 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-852c3902-1dbb-4e85-9fb9-392cf6564270 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:29.880398 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1163/2297] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:24:29 2022] DELETE /identity/v3/projects/ced4058cd83546b98ab43c9d382c16d6 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:24:34.197729 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6951ca58-6e5c-485e-bb8c-a14dfa66bd1a admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:34.199141 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-6951ca58-6e5c-485e-bb8c-a14dfa66bd1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:24:34.253593 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6951ca58-6e5c-485e-bb8c-a14dfa66bd1a admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:34.300142 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6809da10-33c5-4a16-8a09-47dd98527443 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:34.300793 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6809da10-33c5-4a16-8a09-47dd98527443 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:34.301079 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6809da10-33c5-4a16-8a09-47dd98527443 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:34.301360 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6809da10-33c5-4a16-8a09-47dd98527443 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:34.303148 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-6809da10-33c5-4a16-8a09-47dd98527443 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:24:34.364168 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6809da10-33c5-4a16-8a09-47dd98527443 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:34.365601 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6809da10-33c5-4a16-8a09-47dd98527443 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:34.375210 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1135/2298] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:24:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:24:34.862501 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c3902-1dbb-4e85-9fb9-392cf6564270 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:34.868459 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-852c3902-1dbb-4e85-9fb9-392cf6564270 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:24:34.943739 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c3902-1dbb-4e85-9fb9-392cf6564270 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:34.952197 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb99c0b-fefd-4327-ba28-be774f752e71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b7ccdccba0b4f9e86817946f22dbe28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:34.952867 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb99c0b-fefd-4327-ba28-be774f752e71 service nova] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:34.953339 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb99c0b-fefd-4327-ba28-be774f752e71 service nova] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:34.954013 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb99c0b-fefd-4327-ba28-be774f752e71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:34.955508 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-5fb99c0b-fefd-4327-ba28-be774f752e71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:24:35.019360 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb99c0b-fefd-4327-ba28-be774f752e71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:35.021401 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb99c0b-fefd-4327-ba28-be774f752e71 service nova] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:35.031418 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1164/2299] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:24:34 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:24:35.519904 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3bb75-6365-4045-9f87-804b1350fa45 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:35.520406 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3bb75-6365-4045-9f87-804b1350fa45 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:35.521466 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3bb75-6365-4045-9f87-804b1350fa45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:35.539224 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-2fb3bb75-6365-4045-9f87-804b1350fa45 None None] MFA Rules not processed for user `6ebfab3ff0b24f4aaabb8c6bb0ad10c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:24:35.540484 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-2fb3bb75-6365-4045-9f87-804b1350fa45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:24:35.599753 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1136/2300] 10.222.0.65 () {58 vars in 1009 bytes} [Tue May 10 03:24:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:24:35.611705 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb99c0b-fefd-4327-ba28-be774f752e71 service nova] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:35.613225 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-5fb99c0b-fefd-4327-ba28-be774f752e71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:24:35.740288 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb99c0b-fefd-4327-ba28-be774f752e71 service nova] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:35.746968 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a98b07-fb5a-49cf-9587-c18408e0e4d8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1cb8ad43a234233ad602f451f0f8ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:35.747640 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a98b07-fb5a-49cf-9587-c18408e0e4d8 service swift] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:35.747930 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a98b07-fb5a-49cf-9587-c18408e0e4d8 service swift] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:35.748243 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a98b07-fb5a-49cf-9587-c18408e0e4d8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:35.757993 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a98b07-fb5a-49cf-9587-c18408e0e4d8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:35.759676 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a98b07-fb5a-49cf-9587-c18408e0e4d8 service swift] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:35.773171 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1165/2301] 10.222.0.65 () {60 vars in 1384 bytes} [Tue May 10 03:24:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 03:24:36.940685 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb3bb75-6365-4045-9f87-804b1350fa45 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:36.965350 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb3bb75-6365-4045-9f87-804b1350fa45 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:36.995562 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d68c9-97e9-426a-8e6a-45fe6c360503 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b7ccdccba0b4f9e86817946f22dbe28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:36.996585 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d68c9-97e9-426a-8e6a-45fe6c360503 service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:37.000523 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d68c9-97e9-426a-8e6a-45fe6c360503 service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:37.002947 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d68c9-97e9-426a-8e6a-45fe6c360503 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:37.008755 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-bc2d68c9-97e9-426a-8e6a-45fe6c360503 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:24:37.068898 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2d68c9-97e9-426a-8e6a-45fe6c360503 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:37.070787 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2d68c9-97e9-426a-8e6a-45fe6c360503 service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:37.087908 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1137/2302] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:24:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:24:39.399550 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a98b07-fb5a-49cf-9587-c18408e0e4d8 service swift] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:39.401303 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-c7a98b07-fb5a-49cf-9587-c18408e0e4d8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:24:39.416924 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a98b07-fb5a-49cf-9587-c18408e0e4d8 service swift] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:39.421960 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8f655-9550-49f5-bfc2-7724a0e4f597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:39.422890 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8f655-9550-49f5-bfc2-7724a0e4f597 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:39.423171 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8f655-9550-49f5-bfc2-7724a0e4f597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:39.423449 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8f655-9550-49f5-bfc2-7724a0e4f597 admin admin] PATH_INFO: `/v3/users/e309fb66a98b407d8b7533207e6a6dfc` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:39.426417 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d8f655-9550-49f5-bfc2-7724a0e4f597 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e309fb66a98b407d8b7533207e6a6dfc)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:39.427361 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d8f655-9550-49f5-bfc2-7724a0e4f597 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:39.672859 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-20d8f655-9550-49f5-bfc2-7724a0e4f597 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e309fb66a98b407d8b7533207e6a6dfc'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:39.684254 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-20d8f655-9550-49f5-bfc2-7724a0e4f597 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e309fb66a98b407d8b7533207e6a6dfc'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:39.703971 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-20d8f655-9550-49f5-bfc2-7724a0e4f597 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e309fb66a98b407d8b7533207e6a6dfc'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:39.704833 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-20d8f655-9550-49f5-bfc2-7724a0e4f597 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e309fb66a98b407d8b7533207e6a6dfc'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:39.705570 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-20d8f655-9550-49f5-bfc2-7724a0e4f597 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e309fb66a98b407d8b7533207e6a6dfc'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:39.800409 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1166/2303] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:24:39 2022] DELETE /identity/v3/users/e309fb66a98b407d8b7533207e6a6dfc => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:24:40.085994 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d68c9-97e9-426a-8e6a-45fe6c360503 service nova] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:40.127536 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d68c9-97e9-426a-8e6a-45fe6c360503 service nova] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:40.205341 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7b14b3-54d9-42ee-94e8-c129dab55eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:40.206306 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b14b3-54d9-42ee-94e8-c129dab55eeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:40.210755 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b14b3-54d9-42ee-94e8-c129dab55eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:40.211606 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b14b3-54d9-42ee-94e8-c129dab55eeb admin admin] PATH_INFO: `/v3/projects/d8e319a149db44fb8bb71f3066c82956` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:40.213154 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7b14b3-54d9-42ee-94e8-c129dab55eeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8e319a149db44fb8bb71f3066c82956)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:40.215106 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7b14b3-54d9-42ee-94e8-c129dab55eeb admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:40.406062 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-6e7b14b3-54d9-42ee-94e8-c129dab55eeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8e319a149db44fb8bb71f3066c82956', 'request_id': 'req-6e7b14b3-54d9-42ee-94e8-c129dab55eeb'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:40.412119 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-6e7b14b3-54d9-42ee-94e8-c129dab55eeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8e319a149db44fb8bb71f3066c82956', 'request_id': 'req-6e7b14b3-54d9-42ee-94e8-c129dab55eeb'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:40.426068 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-6e7b14b3-54d9-42ee-94e8-c129dab55eeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8e319a149db44fb8bb71f3066c82956', 'request_id': 'req-6e7b14b3-54d9-42ee-94e8-c129dab55eeb'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:40.506567 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-6e7b14b3-54d9-42ee-94e8-c129dab55eeb admin admin] The token cache is being invalidate because project d8e319a149db44fb8bb71f3066c82956 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:24:40.506953 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-6e7b14b3-54d9-42ee-94e8-c129dab55eeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:40.510113 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-6e7b14b3-54d9-42ee-94e8-c129dab55eeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:40.514888 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1138/2304] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:24:40 2022] DELETE /identity/v3/projects/d8e319a149db44fb8bb71f3066c82956 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:24:40.516829 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb5ae0-41c7-4765-8b1e-640a4296f4cc None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:40.517337 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb5ae0-41c7-4765-8b1e-640a4296f4cc None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:40.517439 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb5ae0-41c7-4765-8b1e-640a4296f4cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:40.541487 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-29fb5ae0-41c7-4765-8b1e-640a4296f4cc None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:24:40.543194 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-29fb5ae0-41c7-4765-8b1e-640a4296f4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:24:40.604727 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1167/2305] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:24:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:24:40.612710 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f2d9a7-d13d-4bf8-98d2-5d4024a4bbe8 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:40.613524 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f2d9a7-d13d-4bf8-98d2-5d4024a4bbe8 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:40.614005 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f2d9a7-d13d-4bf8-98d2-5d4024a4bbe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:40.635383 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-45f2d9a7-d13d-4bf8-98d2-5d4024a4bbe8 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:24:40.637303 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-45f2d9a7-d13d-4bf8-98d2-5d4024a4bbe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:24:40.647096 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1139/2306] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:24:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:24:40.651362 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb5ae0-41c7-4765-8b1e-640a4296f4cc None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:40.663403 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb5ae0-41c7-4765-8b1e-640a4296f4cc None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:40.668435 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3fad6-485d-491d-8fa0-e5f28d3379b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:40.669309 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3fad6-485d-491d-8fa0-e5f28d3379b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:40.669664 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3fad6-485d-491d-8fa0-e5f28d3379b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:40.669955 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3fad6-485d-491d-8fa0-e5f28d3379b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:40.670681 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d3fad6-485d-491d-8fa0-e5f28d3379b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:24:40.670986 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d3fad6-485d-491d-8fa0-e5f28d3379b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:40.672880 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d3fad6-485d-491d-8fa0-e5f28d3379b7 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:40.686186 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1168/2307] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 10 03:24:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:24:40.690101 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f2d9a7-d13d-4bf8-98d2-5d4024a4bbe8 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:40.699865 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f2d9a7-d13d-4bf8-98d2-5d4024a4bbe8 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:40.706418 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cebfa1-df39-4089-bf09-cea69deb9922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:40.707280 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cebfa1-df39-4089-bf09-cea69deb9922 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:40.707564 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cebfa1-df39-4089-bf09-cea69deb9922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:40.707838 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cebfa1-df39-4089-bf09-cea69deb9922 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:40.708573 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cebfa1-df39-4089-bf09-cea69deb9922 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:40.710468 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cebfa1-df39-4089-bf09-cea69deb9922 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:40.842541 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1140/2308] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:24:40 2022] POST /identity/v3/projects => generated 405 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:24:40.843629 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3fad6-485d-491d-8fa0-e5f28d3379b7 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:40.867841 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3fad6-485d-491d-8fa0-e5f28d3379b7 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:40.978893 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9505b13d-9607-4cb1-87cc-f58f009f561e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:40.980553 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9505b13d-9607-4cb1-87cc-f58f009f561e admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:40.986631 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9505b13d-9607-4cb1-87cc-f58f009f561e admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:40.986631 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9505b13d-9607-4cb1-87cc-f58f009f561e admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:40.986631 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9505b13d-9607-4cb1-87cc-f58f009f561e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:40.986631 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9505b13d-9607-4cb1-87cc-f58f009f561e admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:41.082356 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1169/2309] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:24:40 2022] POST /identity/v3/users => generated 303 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:24:41.083546 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cebfa1-df39-4089-bf09-cea69deb9922 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:41.098071 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cebfa1-df39-4089-bf09-cea69deb9922 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:41.105155 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706ecc8-28ef-469a-91be-81e4cab6262f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:41.105831 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706ecc8-28ef-469a-91be-81e4cab6262f admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:41.106118 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706ecc8-28ef-469a-91be-81e4cab6262f admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:41.106392 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706ecc8-28ef-469a-91be-81e4cab6262f admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:41.107140 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a706ecc8-28ef-469a-91be-81e4cab6262f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:41.108752 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a706ecc8-28ef-469a-91be-81e4cab6262f admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:41.119678 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1141/2310] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:24:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:24:41.123791 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9505b13d-9607-4cb1-87cc-f58f009f561e admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:41.135224 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9505b13d-9607-4cb1-87cc-f58f009f561e admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:41.140337 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c848b1-6821-4f7c-8011-9c1254143ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:41.141223 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c848b1-6821-4f7c-8011-9c1254143ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:41.141505 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c848b1-6821-4f7c-8011-9c1254143ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:41.141776 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c848b1-6821-4f7c-8011-9c1254143ec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:41.142542 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c848b1-6821-4f7c-8011-9c1254143ec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:41.144806 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c848b1-6821-4f7c-8011-9c1254143ec4 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:41.164060 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1170/2311] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:24:41 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:24:41.165726 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706ecc8-28ef-469a-91be-81e4cab6262f admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:41.177338 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706ecc8-28ef-469a-91be-81e4cab6262f admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:41.181977 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6550721-4e03-40fb-abff-a9682b2b9b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:41.182863 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6550721-4e03-40fb-abff-a9682b2b9b79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:41.183151 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6550721-4e03-40fb-abff-a9682b2b9b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:41.183430 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6550721-4e03-40fb-abff-a9682b2b9b79 admin admin] PATH_INFO: `/v3/projects/53a85fb72f3643cd97c1088389d78c92/users/4d9c0fc7131040e5959af28058fcf684/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:41.200389 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6550721-4e03-40fb-abff-a9682b2b9b79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53a85fb72f3643cd97c1088389d78c92, user_id=4d9c0fc7131040e5959af28058fcf684, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:41.203081 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6550721-4e03-40fb-abff-a9682b2b9b79 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:41.313537 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1142/2312] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:24:41 2022] PUT /identity/v3/projects/53a85fb72f3643cd97c1088389d78c92/users/4d9c0fc7131040e5959af28058fcf684/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:24:41.319381 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462c82e-0669-48ce-a045-738122dd94a3 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:41.319677 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462c82e-0669-48ce-a045-738122dd94a3 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:41.319951 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462c82e-0669-48ce-a045-738122dd94a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:41.339443 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-d462c82e-0669-48ce-a045-738122dd94a3 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:24:41.341490 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-d462c82e-0669-48ce-a045-738122dd94a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:24:41.444543 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1171/2313] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:24:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:24:41.460263 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6550721-4e03-40fb-abff-a9682b2b9b79 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:41.462152 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-e6550721-4e03-40fb-abff-a9682b2b9b79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:24:41.534632 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6550721-4e03-40fb-abff-a9682b2b9b79 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:41.538798 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a871e63d-009e-4ef8-b7ac-197b289653f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:41.542273 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a871e63d-009e-4ef8-b7ac-197b289653f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:41.542273 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a871e63d-009e-4ef8-b7ac-197b289653f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:41.542273 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a871e63d-009e-4ef8-b7ac-197b289653f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:41.551370 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a871e63d-009e-4ef8-b7ac-197b289653f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:41.553248 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a871e63d-009e-4ef8-b7ac-197b289653f4 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:41.565601 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1143/2314] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:24:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:24:43.204542 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753c73a-c901-47eb-b948-6a7b21cfb13b None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:43.205088 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753c73a-c901-47eb-b948-6a7b21cfb13b None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:43.205088 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753c73a-c901-47eb-b948-6a7b21cfb13b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:43.243967 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-d753c73a-c901-47eb-b948-6a7b21cfb13b None None] MFA Rules not processed for user `4d9c0fc7131040e5959af28058fcf684`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:24:43.245254 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-d753c73a-c901-47eb-b948-6a7b21cfb13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:24:43.334692 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1172/2315] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:24:43 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:24:43.335368 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a871e63d-009e-4ef8-b7ac-197b289653f4 service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:43.345504 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a871e63d-009e-4ef8-b7ac-197b289653f4 service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:43.350575 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6ee3b9-db2d-460a-accc-c60f959b31d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:43.351173 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ee3b9-db2d-460a-accc-c60f959b31d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:43.351453 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ee3b9-db2d-460a-accc-c60f959b31d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:43.351724 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ee3b9-db2d-460a-accc-c60f959b31d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:43.352883 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6ee3b9-db2d-460a-accc-c60f959b31d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:43.355128 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6ee3b9-db2d-460a-accc-c60f959b31d2 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:43.466882 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1144/2316] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:24:43 2022] POST /identity/v3/projects => generated 403 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:24:43.470574 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d753c73a-c901-47eb-b948-6a7b21cfb13b None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:43.485247 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d753c73a-c901-47eb-b948-6a7b21cfb13b None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:43.572796 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52dbcee-038c-49ee-a028-382780cc9a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:43.573927 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52dbcee-038c-49ee-a028-382780cc9a0e admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:43.574445 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52dbcee-038c-49ee-a028-382780cc9a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:43.574868 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52dbcee-038c-49ee-a028-382780cc9a0e admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:43.575716 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52dbcee-038c-49ee-a028-382780cc9a0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:43.577729 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52dbcee-038c-49ee-a028-382780cc9a0e admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:43.617375 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6ee3b9-db2d-460a-accc-c60f959b31d2 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:43.620363 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-9e6ee3b9-db2d-460a-accc-c60f959b31d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:24:43.640272 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1173/2317] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:24:43 2022] POST /identity/v3/users => generated 308 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:24:43.648850 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52dbcee-038c-49ee-a028-382780cc9a0e admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:43.672328 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52dbcee-038c-49ee-a028-382780cc9a0e admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:43.677785 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af18ad7-20c1-4a71-9457-78ea1cdc2728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:43.678462 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af18ad7-20c1-4a71-9457-78ea1cdc2728 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:43.678748 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af18ad7-20c1-4a71-9457-78ea1cdc2728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:43.679020 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af18ad7-20c1-4a71-9457-78ea1cdc2728 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:43.680479 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af18ad7-20c1-4a71-9457-78ea1cdc2728 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:43.682798 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af18ad7-20c1-4a71-9457-78ea1cdc2728 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:43.703102 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1174/2318] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:24:43.709970 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af18ad7-20c1-4a71-9457-78ea1cdc2728 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:43.728740 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af18ad7-20c1-4a71-9457-78ea1cdc2728 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:43.734420 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6ee3b9-db2d-460a-accc-c60f959b31d2 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:43.735160 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983ca5bd-f5c2-4cec-9256-061197b75530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:43.736180 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983ca5bd-f5c2-4cec-9256-061197b75530 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:43.736666 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983ca5bd-f5c2-4cec-9256-061197b75530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:43.737045 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983ca5bd-f5c2-4cec-9256-061197b75530 admin admin] PATH_INFO: `/v3/projects/74185a5de3d04560807c176405f424ff/users/44d45990e76249b484e3624fefe723cc/roles/43105000610f402ca2486e7648018cca` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:43.742630 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d66c2-6357-4767-a526-9bea991a79f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b7ccdccba0b4f9e86817946f22dbe28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:43.743521 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d66c2-6357-4767-a526-9bea991a79f0 service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:43.744077 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d66c2-6357-4767-a526-9bea991a79f0 service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:43.744548 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d66c2-6357-4767-a526-9bea991a79f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:43.746811 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-058d66c2-6357-4767-a526-9bea991a79f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:24:43.757098 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983ca5bd-f5c2-4cec-9256-061197b75530 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74185a5de3d04560807c176405f424ff, user_id=44d45990e76249b484e3624fefe723cc, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:43.760864 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983ca5bd-f5c2-4cec-9256-061197b75530 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:43.832080 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058d66c2-6357-4767-a526-9bea991a79f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:43.834136 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058d66c2-6357-4767-a526-9bea991a79f0 service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:43.855243 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1145/2319] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:24:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:24:43.857781 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1175/2320] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:24:43 2022] PUT /identity/v3/projects/74185a5de3d04560807c176405f424ff/users/44d45990e76249b484e3624fefe723cc/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:24:43.860840 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d66c2-6357-4767-a526-9bea991a79f0 service nova] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:43.876046 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d66c2-6357-4767-a526-9bea991a79f0 service nova] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:43.989688 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a310cd-4306-471f-a360-3c53f3f8953f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:43.989688 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a310cd-4306-471f-a360-3c53f3f8953f admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:43.989688 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a310cd-4306-471f-a360-3c53f3f8953f admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:43.990321 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a310cd-4306-471f-a360-3c53f3f8953f admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:43.991224 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a310cd-4306-471f-a360-3c53f3f8953f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:43.993909 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a310cd-4306-471f-a360-3c53f3f8953f admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:44.020261 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1146/2321] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:24:44.022771 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983ca5bd-f5c2-4cec-9256-061197b75530 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:44.035454 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983ca5bd-f5c2-4cec-9256-061197b75530 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:44.040683 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3deb20-f323-45ef-8a41-2989a7c60810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:44.041578 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3deb20-f323-45ef-8a41-2989a7c60810 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:44.047185 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3deb20-f323-45ef-8a41-2989a7c60810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:44.047185 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3deb20-f323-45ef-8a41-2989a7c60810 admin admin] PATH_INFO: `/v3/projects/74185a5de3d04560807c176405f424ff/users/44d45990e76249b484e3624fefe723cc/roles/43105000610f402ca2486e7648018cca` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:44.047185 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3deb20-f323-45ef-8a41-2989a7c60810 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74185a5de3d04560807c176405f424ff, user_id=44d45990e76249b484e3624fefe723cc, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:44.050652 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3deb20-f323-45ef-8a41-2989a7c60810 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:44.062295 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1176/2322] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:24:44 2022] PUT /identity/v3/projects/74185a5de3d04560807c176405f424ff/users/44d45990e76249b484e3624fefe723cc/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:24:45.503095 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96323275-305a-4c40-8f96-91fcfcf69906 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:45.503662 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96323275-305a-4c40-8f96-91fcfcf69906 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:45.504093 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96323275-305a-4c40-8f96-91fcfcf69906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:45.561220 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-96323275-305a-4c40-8f96-91fcfcf69906 None None] MFA Rules not processed for user `44d45990e76249b484e3624fefe723cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:24:45.562479 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-96323275-305a-4c40-8f96-91fcfcf69906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:24:45.703079 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1147/2323] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:24:45 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:24:47.708460 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3deb20-f323-45ef-8a41-2989a7c60810 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:47.804571 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3deb20-f323-45ef-8a41-2989a7c60810 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:47.809558 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9969772b-d226-4cd6-bc35-5f3e0a2afcb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:47.810455 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969772b-d226-4cd6-bc35-5f3e0a2afcb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:47.810739 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969772b-d226-4cd6-bc35-5f3e0a2afcb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:47.811066 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969772b-d226-4cd6-bc35-5f3e0a2afcb5 admin admin] PATH_INFO: `/v3/users/4d9c0fc7131040e5959af28058fcf684` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:47.812409 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9969772b-d226-4cd6-bc35-5f3e0a2afcb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d9c0fc7131040e5959af28058fcf684)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:47.814540 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9969772b-d226-4cd6-bc35-5f3e0a2afcb5 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:47.984328 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-9969772b-d226-4cd6-bc35-5f3e0a2afcb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d9c0fc7131040e5959af28058fcf684'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:47.991338 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-9969772b-d226-4cd6-bc35-5f3e0a2afcb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d9c0fc7131040e5959af28058fcf684'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:48.002964 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-9969772b-d226-4cd6-bc35-5f3e0a2afcb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d9c0fc7131040e5959af28058fcf684'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:48.003679 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-9969772b-d226-4cd6-bc35-5f3e0a2afcb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d9c0fc7131040e5959af28058fcf684'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:48.004432 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-9969772b-d226-4cd6-bc35-5f3e0a2afcb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d9c0fc7131040e5959af28058fcf684'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:48.054621 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1177/2324] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:24:47 2022] DELETE /identity/v3/users/4d9c0fc7131040e5959af28058fcf684 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:24:48.279469 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96323275-305a-4c40-8f96-91fcfcf69906 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:48.294055 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96323275-305a-4c40-8f96-91fcfcf69906 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:48.355469 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7b974-fd77-4add-86a4-04ab065fa84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:48.356368 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7b974-fd77-4add-86a4-04ab065fa84c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:48.356654 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7b974-fd77-4add-86a4-04ab065fa84c admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:48.356932 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7b974-fd77-4add-86a4-04ab065fa84c admin admin] PATH_INFO: `/v3/projects/53a85fb72f3643cd97c1088389d78c92` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:48.358117 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf7b974-fd77-4add-86a4-04ab065fa84c admin admin] RBAC: Authorizing `identity:delete_project(project_id=53a85fb72f3643cd97c1088389d78c92)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:48.360051 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf7b974-fd77-4add-86a4-04ab065fa84c admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:48.484132 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-ecf7b974-fd77-4add-86a4-04ab065fa84c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53a85fb72f3643cd97c1088389d78c92', 'request_id': 'req-ecf7b974-fd77-4add-86a4-04ab065fa84c'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:48.491460 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-ecf7b974-fd77-4add-86a4-04ab065fa84c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53a85fb72f3643cd97c1088389d78c92', 'request_id': 'req-ecf7b974-fd77-4add-86a4-04ab065fa84c'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:48.502886 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-ecf7b974-fd77-4add-86a4-04ab065fa84c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53a85fb72f3643cd97c1088389d78c92', 'request_id': 'req-ecf7b974-fd77-4add-86a4-04ab065fa84c'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:48.602715 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-ecf7b974-fd77-4add-86a4-04ab065fa84c admin admin] The token cache is being invalidate because project 53a85fb72f3643cd97c1088389d78c92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:24:48.603005 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-ecf7b974-fd77-4add-86a4-04ab065fa84c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:48.603620 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-ecf7b974-fd77-4add-86a4-04ab065fa84c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:48.605204 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1148/2325] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:24:48 2022] DELETE /identity/v3/projects/53a85fb72f3643cd97c1088389d78c92 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:24:48.609084 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9969772b-d226-4cd6-bc35-5f3e0a2afcb5 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:48.610491 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-9969772b-d226-4cd6-bc35-5f3e0a2afcb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:24:48.623563 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9969772b-d226-4cd6-bc35-5f3e0a2afcb5 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:48.677985 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8385de23-8fdd-419d-adda-0d7e0a93b88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:48.678847 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8385de23-8fdd-419d-adda-0d7e0a93b88a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:48.679128 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8385de23-8fdd-419d-adda-0d7e0a93b88a admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:48.679403 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8385de23-8fdd-419d-adda-0d7e0a93b88a admin admin] PATH_INFO: `/v3/users/44d45990e76249b484e3624fefe723cc` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:48.680599 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8385de23-8fdd-419d-adda-0d7e0a93b88a admin admin] RBAC: Authorizing `identity:delete_user(user_id=44d45990e76249b484e3624fefe723cc)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:48.682500 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8385de23-8fdd-419d-adda-0d7e0a93b88a admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:48.866778 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7b974-fd77-4add-86a4-04ab065fa84c admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:48.866778 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-ecf7b974-fd77-4add-86a4-04ab065fa84c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:24:48.898634 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-8385de23-8fdd-419d-adda-0d7e0a93b88a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44d45990e76249b484e3624fefe723cc'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:48.905836 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-8385de23-8fdd-419d-adda-0d7e0a93b88a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44d45990e76249b484e3624fefe723cc'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:48.917341 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-8385de23-8fdd-419d-adda-0d7e0a93b88a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44d45990e76249b484e3624fefe723cc'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:48.918023 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-8385de23-8fdd-419d-adda-0d7e0a93b88a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44d45990e76249b484e3624fefe723cc'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:48.918637 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-8385de23-8fdd-419d-adda-0d7e0a93b88a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44d45990e76249b484e3624fefe723cc'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:48.922818 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7b974-fd77-4add-86a4-04ab065fa84c admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:48.926944 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d316d99e-bea1-4270-a571-f69f72a7e151 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:48.927591 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d316d99e-bea1-4270-a571-f69f72a7e151 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:48.927875 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d316d99e-bea1-4270-a571-f69f72a7e151 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:48.928213 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d316d99e-bea1-4270-a571-f69f72a7e151 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:48.929951 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-d316d99e-bea1-4270-a571-f69f72a7e151 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:24:48.939495 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d316d99e-bea1-4270-a571-f69f72a7e151 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:48.945576 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d316d99e-bea1-4270-a571-f69f72a7e151 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:48.949482 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1149/2326] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:24:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:24:48.986690 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1178/2327] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:24:48 2022] DELETE /identity/v3/users/44d45990e76249b484e3624fefe723cc => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:24:49.633127 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d316d99e-bea1-4270-a571-f69f72a7e151 service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:49.634603 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-d316d99e-bea1-4270-a571-f69f72a7e151 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:24:49.650364 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d316d99e-bea1-4270-a571-f69f72a7e151 service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:49.717269 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f7e69f-3c25-48ee-8a0d-f5c720f137c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:49.718140 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f7e69f-3c25-48ee-8a0d-f5c720f137c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:49.718426 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f7e69f-3c25-48ee-8a0d-f5c720f137c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:49.718705 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f7e69f-3c25-48ee-8a0d-f5c720f137c5 admin admin] PATH_INFO: `/v3/projects/74185a5de3d04560807c176405f424ff` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:49.719890 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f7e69f-3c25-48ee-8a0d-f5c720f137c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74185a5de3d04560807c176405f424ff)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:49.722560 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f7e69f-3c25-48ee-8a0d-f5c720f137c5 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:49.849082 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-78f7e69f-3c25-48ee-8a0d-f5c720f137c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74185a5de3d04560807c176405f424ff', 'request_id': 'req-78f7e69f-3c25-48ee-8a0d-f5c720f137c5'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:49.854674 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-78f7e69f-3c25-48ee-8a0d-f5c720f137c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74185a5de3d04560807c176405f424ff', 'request_id': 'req-78f7e69f-3c25-48ee-8a0d-f5c720f137c5'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:49.861113 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-78f7e69f-3c25-48ee-8a0d-f5c720f137c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74185a5de3d04560807c176405f424ff', 'request_id': 'req-78f7e69f-3c25-48ee-8a0d-f5c720f137c5'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:49.934441 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-78f7e69f-3c25-48ee-8a0d-f5c720f137c5 admin admin] The token cache is being invalidate because project 74185a5de3d04560807c176405f424ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:24:49.934659 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-78f7e69f-3c25-48ee-8a0d-f5c720f137c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:49.935265 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-78f7e69f-3c25-48ee-8a0d-f5c720f137c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:49.936858 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1150/2328] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:24:49 2022] DELETE /identity/v3/projects/74185a5de3d04560807c176405f424ff => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:24:49.942182 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff071183-6020-4b0f-9904-841f60fa4862 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:49.942646 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff071183-6020-4b0f-9904-841f60fa4862 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:49.942856 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff071183-6020-4b0f-9904-841f60fa4862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:49.961060 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-ff071183-6020-4b0f-9904-841f60fa4862 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:24:49.962265 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-ff071183-6020-4b0f-9904-841f60fa4862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:24:50.019482 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1179/2329] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:24:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:24:50.027156 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc79fcd-73dc-49e5-b931-c61a6f2ce1b9 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:50.027441 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc79fcd-73dc-49e5-b931-c61a6f2ce1b9 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:50.027723 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc79fcd-73dc-49e5-b931-c61a6f2ce1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:50.045548 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-9bc79fcd-73dc-49e5-b931-c61a6f2ce1b9 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:24:50.047019 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-9bc79fcd-73dc-49e5-b931-c61a6f2ce1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:24:50.054907 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1151/2330] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:24:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:24:50.058953 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff071183-6020-4b0f-9904-841f60fa4862 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:50.068838 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff071183-6020-4b0f-9904-841f60fa4862 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:50.073583 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e6321c-1b19-4abb-bc2e-089e333c3644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:50.074287 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6321c-1b19-4abb-bc2e-089e333c3644 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:50.074576 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6321c-1b19-4abb-bc2e-089e333c3644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:50.074856 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6321c-1b19-4abb-bc2e-089e333c3644 admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:50.075639 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e6321c-1b19-4abb-bc2e-089e333c3644 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:24:50.075949 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e6321c-1b19-4abb-bc2e-089e333c3644 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:50.077601 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e6321c-1b19-4abb-bc2e-089e333c3644 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:50.090211 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1180/2331] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 10 03:24:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:24:50.094636 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc79fcd-73dc-49e5-b931-c61a6f2ce1b9 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:50.104554 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc79fcd-73dc-49e5-b931-c61a6f2ce1b9 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:50.109165 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de56045-b125-4162-91da-34842222288d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:50.109803 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de56045-b125-4162-91da-34842222288d admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:50.110083 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de56045-b125-4162-91da-34842222288d admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:50.110355 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de56045-b125-4162-91da-34842222288d admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:50.111029 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de56045-b125-4162-91da-34842222288d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:50.113591 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de56045-b125-4162-91da-34842222288d admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:50.194938 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1152/2332] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:24:50 2022] POST /identity/v3/projects => generated 387 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:24:50.198916 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e6321c-1b19-4abb-bc2e-089e333c3644 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:50.209599 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e6321c-1b19-4abb-bc2e-089e333c3644 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:50.313937 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cfd7e3-8db3-417e-8cc6-a1f67f19078f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:50.314787 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cfd7e3-8db3-417e-8cc6-a1f67f19078f admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:50.315563 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cfd7e3-8db3-417e-8cc6-a1f67f19078f admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:50.315946 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cfd7e3-8db3-417e-8cc6-a1f67f19078f admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:50.316779 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cfd7e3-8db3-417e-8cc6-a1f67f19078f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:50.319155 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cfd7e3-8db3-417e-8cc6-a1f67f19078f admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:50.403437 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1181/2333] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:24:50 2022] POST /identity/v3/users => generated 294 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:24:50.413883 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de56045-b125-4162-91da-34842222288d admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:50.425759 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de56045-b125-4162-91da-34842222288d admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:50.431082 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d50afa5-862b-4320-b563-bc9c45260b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:50.431759 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50afa5-862b-4320-b563-bc9c45260b5c admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:50.432122 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50afa5-862b-4320-b563-bc9c45260b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:50.432400 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50afa5-862b-4320-b563-bc9c45260b5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:50.433134 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d50afa5-862b-4320-b563-bc9c45260b5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:50.434729 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d50afa5-862b-4320-b563-bc9c45260b5c admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:50.448763 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1153/2334] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:24:50.452920 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cfd7e3-8db3-417e-8cc6-a1f67f19078f admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:50.464328 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cfd7e3-8db3-417e-8cc6-a1f67f19078f admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:50.470299 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1245b796-f385-4a70-bfbc-3153ae7789a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:50.470991 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245b796-f385-4a70-bfbc-3153ae7789a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:50.476197 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245b796-f385-4a70-bfbc-3153ae7789a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:50.476633 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245b796-f385-4a70-bfbc-3153ae7789a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:50.477783 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1245b796-f385-4a70-bfbc-3153ae7789a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:50.479608 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1245b796-f385-4a70-bfbc-3153ae7789a9 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:50.491509 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1182/2335] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:24:50.495339 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d50afa5-862b-4320-b563-bc9c45260b5c admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:50.509010 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d50afa5-862b-4320-b563-bc9c45260b5c admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:50.514043 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cafc76a-efdd-4b0b-869e-bc6029cbe227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:50.514932 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cafc76a-efdd-4b0b-869e-bc6029cbe227 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:50.516050 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cafc76a-efdd-4b0b-869e-bc6029cbe227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:50.516050 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cafc76a-efdd-4b0b-869e-bc6029cbe227 admin admin] PATH_INFO: `/v3/projects/4bd9eb91c01e472e975fc765627bcedd/users/6d90138ab7b142dbb30eb26aed08b525/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:50.532374 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cafc76a-efdd-4b0b-869e-bc6029cbe227 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bd9eb91c01e472e975fc765627bcedd, user_id=6d90138ab7b142dbb30eb26aed08b525, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:50.535597 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cafc76a-efdd-4b0b-869e-bc6029cbe227 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:50.582112 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1154/2336] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:24:50 2022] PUT /identity/v3/projects/4bd9eb91c01e472e975fc765627bcedd/users/6d90138ab7b142dbb30eb26aed08b525/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:24:50.592603 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a07498-605d-45e7-965c-784cfea086f2 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:50.592899 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a07498-605d-45e7-965c-784cfea086f2 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:50.593185 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a07498-605d-45e7-965c-784cfea086f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:50.620618 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-65a07498-605d-45e7-965c-784cfea086f2 None None] MFA Rules not processed for user `6d90138ab7b142dbb30eb26aed08b525`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:24:50.623266 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-65a07498-605d-45e7-965c-784cfea086f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:24:50.689134 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1183/2337] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:24:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:24:50.690761 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cafc76a-efdd-4b0b-869e-bc6029cbe227 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:50.751983 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cafc76a-efdd-4b0b-869e-bc6029cbe227 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:50.757476 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14edf3ae-5c4a-46b5-b0a6-5656407b5f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:50.758142 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14edf3ae-5c4a-46b5-b0a6-5656407b5f76 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:50.758429 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14edf3ae-5c4a-46b5-b0a6-5656407b5f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:50.758707 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14edf3ae-5c4a-46b5-b0a6-5656407b5f76 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:50.759417 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14edf3ae-5c4a-46b5-b0a6-5656407b5f76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:50.761678 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14edf3ae-5c4a-46b5-b0a6-5656407b5f76 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:50.840110 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1155/2338] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:24:50 2022] POST /identity/v3/projects => generated 387 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:24:50.843928 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a07498-605d-45e7-965c-784cfea086f2 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:50.854810 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a07498-605d-45e7-965c-784cfea086f2 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:50.909650 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7506c7fd-aac3-48e7-9718-c5d8443c1d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:50.910321 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506c7fd-aac3-48e7-9718-c5d8443c1d53 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:50.910639 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506c7fd-aac3-48e7-9718-c5d8443c1d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:50.910918 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506c7fd-aac3-48e7-9718-c5d8443c1d53 admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:50.911617 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7506c7fd-aac3-48e7-9718-c5d8443c1d53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:50.913602 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7506c7fd-aac3-48e7-9718-c5d8443c1d53 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:51.017959 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1184/2339] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:24:50 2022] POST /identity/v3/users => generated 300 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:24:51.020317 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14edf3ae-5c4a-46b5-b0a6-5656407b5f76 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:51.030575 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14edf3ae-5c4a-46b5-b0a6-5656407b5f76 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:51.035350 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb71e82-5b2f-4349-84e1-05df514454d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:51.036038 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb71e82-5b2f-4349-84e1-05df514454d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:51.036333 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb71e82-5b2f-4349-84e1-05df514454d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:51.036677 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb71e82-5b2f-4349-84e1-05df514454d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:51.037994 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb71e82-5b2f-4349-84e1-05df514454d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:51.039593 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb71e82-5b2f-4349-84e1-05df514454d3 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:51.050916 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1156/2340] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:24:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:24:51.055181 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7506c7fd-aac3-48e7-9718-c5d8443c1d53 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:51.065023 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7506c7fd-aac3-48e7-9718-c5d8443c1d53 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:51.069607 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb2a38d-8153-4307-b628-1f4f38ee8e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:51.070473 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2a38d-8153-4307-b628-1f4f38ee8e19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:51.070751 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2a38d-8153-4307-b628-1f4f38ee8e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:51.071020 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2a38d-8153-4307-b628-1f4f38ee8e19 admin admin] PATH_INFO: `/v3/projects/a7183f3cdac746f8840cf4323a40a0cb/users/732c9b61b9a04c1aa977072702cdeb74/roles/43105000610f402ca2486e7648018cca` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:51.087631 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb2a38d-8153-4307-b628-1f4f38ee8e19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7183f3cdac746f8840cf4323a40a0cb, user_id=732c9b61b9a04c1aa977072702cdeb74, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:51.090341 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb2a38d-8153-4307-b628-1f4f38ee8e19 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:51.164721 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1185/2341] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:24:51 2022] PUT /identity/v3/projects/a7183f3cdac746f8840cf4323a40a0cb/users/732c9b61b9a04c1aa977072702cdeb74/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:24:51.168799 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb71e82-5b2f-4349-84e1-05df514454d3 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:51.179402 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb71e82-5b2f-4349-84e1-05df514454d3 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:51.234526 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d606ed-00da-4558-b817-b3c24ec7053b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:51.235206 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d606ed-00da-4558-b817-b3c24ec7053b admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:51.235493 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d606ed-00da-4558-b817-b3c24ec7053b admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:51.235771 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d606ed-00da-4558-b817-b3c24ec7053b admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:51.236587 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d606ed-00da-4558-b817-b3c24ec7053b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:51.238246 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d606ed-00da-4558-b817-b3c24ec7053b admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:51.248505 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1157/2342] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:24:51 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:24:51.252519 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb2a38d-8153-4307-b628-1f4f38ee8e19 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:51.262820 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb2a38d-8153-4307-b628-1f4f38ee8e19 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:51.267632 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885b6ee6-79d0-4d92-9327-cbdad5c427e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:51.269119 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b6ee6-79d0-4d92-9327-cbdad5c427e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:51.269350 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b6ee6-79d0-4d92-9327-cbdad5c427e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:51.269626 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b6ee6-79d0-4d92-9327-cbdad5c427e1 admin admin] PATH_INFO: `/v3/projects/a7183f3cdac746f8840cf4323a40a0cb/users/732c9b61b9a04c1aa977072702cdeb74/roles/43105000610f402ca2486e7648018cca` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:51.271615 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885b6ee6-79d0-4d92-9327-cbdad5c427e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7183f3cdac746f8840cf4323a40a0cb, user_id=732c9b61b9a04c1aa977072702cdeb74, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:51.274284 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885b6ee6-79d0-4d92-9327-cbdad5c427e1 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:51.285021 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1186/2343] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:24:51 2022] PUT /identity/v3/projects/a7183f3cdac746f8840cf4323a40a0cb/users/732c9b61b9a04c1aa977072702cdeb74/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:24:51.295920 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce662709-88df-4363-90d8-d821bdbb4b77 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:51.296261 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce662709-88df-4363-90d8-d821bdbb4b77 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:51.296808 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce662709-88df-4363-90d8-d821bdbb4b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:51.322869 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-ce662709-88df-4363-90d8-d821bdbb4b77 None None] MFA Rules not processed for user `732c9b61b9a04c1aa977072702cdeb74`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:24:51.324118 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-ce662709-88df-4363-90d8-d821bdbb4b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:24:51.391058 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1158/2344] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:24:51 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:24:51.402826 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885b6ee6-79d0-4d92-9327-cbdad5c427e1 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:51.406789 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-885b6ee6-79d0-4d92-9327-cbdad5c427e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:24:51.469478 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885b6ee6-79d0-4d92-9327-cbdad5c427e1 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:51.473291 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0eff98-1903-4806-ad83-73e77f06ee23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:51.474008 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0eff98-1903-4806-ad83-73e77f06ee23 service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:51.474291 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0eff98-1903-4806-ad83-73e77f06ee23 service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:51.474570 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0eff98-1903-4806-ad83-73e77f06ee23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:51.483985 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0eff98-1903-4806-ad83-73e77f06ee23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:51.485434 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0eff98-1903-4806-ad83-73e77f06ee23 service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:51.495257 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1187/2345] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:24:51 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:24:51.523598 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce662709-88df-4363-90d8-d821bdbb4b77 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:51.582427 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce662709-88df-4363-90d8-d821bdbb4b77 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:51.586982 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca9344c-df3a-46ab-bceb-949cc736295b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:51.587842 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca9344c-df3a-46ab-bceb-949cc736295b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:51.588165 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca9344c-df3a-46ab-bceb-949cc736295b admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:51.588445 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca9344c-df3a-46ab-bceb-949cc736295b admin admin] PATH_INFO: `/v3/users/6d90138ab7b142dbb30eb26aed08b525` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:51.589624 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca9344c-df3a-46ab-bceb-949cc736295b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d90138ab7b142dbb30eb26aed08b525)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:51.591567 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca9344c-df3a-46ab-bceb-949cc736295b admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:51.724565 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2ca9344c-df3a-46ab-bceb-949cc736295b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d90138ab7b142dbb30eb26aed08b525'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:51.725251 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2ca9344c-df3a-46ab-bceb-949cc736295b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d90138ab7b142dbb30eb26aed08b525'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:51.731882 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2ca9344c-df3a-46ab-bceb-949cc736295b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d90138ab7b142dbb30eb26aed08b525'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:51.809371 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2ca9344c-df3a-46ab-bceb-949cc736295b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d90138ab7b142dbb30eb26aed08b525'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:51.810022 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2ca9344c-df3a-46ab-bceb-949cc736295b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d90138ab7b142dbb30eb26aed08b525'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:51.827990 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1159/2346] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:24:51 2022] DELETE /identity/v3/users/6d90138ab7b142dbb30eb26aed08b525 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:24:51.837020 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a4ce9-5280-4693-be47-a9653291260a None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:51.837341 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a4ce9-5280-4693-be47-a9653291260a None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:51.837614 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a4ce9-5280-4693-be47-a9653291260a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:51.854811 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-ad6a4ce9-5280-4693-be47-a9653291260a None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:24:51.855990 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-ad6a4ce9-5280-4693-be47-a9653291260a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:24:51.917188 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1188/2347] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:24:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:24:51.927225 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca9344c-df3a-46ab-bceb-949cc736295b admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:51.928662 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-2ca9344c-df3a-46ab-bceb-949cc736295b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:24:51.984498 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca9344c-df3a-46ab-bceb-949cc736295b admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:51.988135 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c921c765-b43a-4d02-9ca9-c6853e943cc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:51.988778 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921c765-b43a-4d02-9ca9-c6853e943cc3 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:51.989058 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921c765-b43a-4d02-9ca9-c6853e943cc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:51.989332 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921c765-b43a-4d02-9ca9-c6853e943cc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:51.998156 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c921c765-b43a-4d02-9ca9-c6853e943cc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:51.999572 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c921c765-b43a-4d02-9ca9-c6853e943cc3 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:52.008815 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1160/2348] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:24:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:24:52.399994 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a4ce9-5280-4693-be47-a9653291260a None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:52.401502 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-ad6a4ce9-5280-4693-be47-a9653291260a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:24:52.414122 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a4ce9-5280-4693-be47-a9653291260a None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:52.418724 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc74e38-aae1-435c-a618-60d0c4c81e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:52.419583 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc74e38-aae1-435c-a618-60d0c4c81e9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:52.419865 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc74e38-aae1-435c-a618-60d0c4c81e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:52.420183 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc74e38-aae1-435c-a618-60d0c4c81e9f admin admin] PATH_INFO: `/v3/projects/4bd9eb91c01e472e975fc765627bcedd` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:52.422645 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc74e38-aae1-435c-a618-60d0c4c81e9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bd9eb91c01e472e975fc765627bcedd)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:52.424574 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc74e38-aae1-435c-a618-60d0c4c81e9f admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:52.513393 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-bcc74e38-aae1-435c-a618-60d0c4c81e9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bd9eb91c01e472e975fc765627bcedd', 'request_id': 'req-bcc74e38-aae1-435c-a618-60d0c4c81e9f'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:52.518917 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-bcc74e38-aae1-435c-a618-60d0c4c81e9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bd9eb91c01e472e975fc765627bcedd', 'request_id': 'req-bcc74e38-aae1-435c-a618-60d0c4c81e9f'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:52.525208 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-bcc74e38-aae1-435c-a618-60d0c4c81e9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bd9eb91c01e472e975fc765627bcedd', 'request_id': 'req-bcc74e38-aae1-435c-a618-60d0c4c81e9f'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:52.588659 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-bcc74e38-aae1-435c-a618-60d0c4c81e9f admin admin] The token cache is being invalidate because project 4bd9eb91c01e472e975fc765627bcedd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:24:52.589035 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-bcc74e38-aae1-435c-a618-60d0c4c81e9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:52.589735 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-bcc74e38-aae1-435c-a618-60d0c4c81e9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:52.591624 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1189/2349] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:24:52 2022] DELETE /identity/v3/projects/4bd9eb91c01e472e975fc765627bcedd => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:24:52.595551 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c921c765-b43a-4d02-9ca9-c6853e943cc3 service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:52.608674 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c921c765-b43a-4d02-9ca9-c6853e943cc3 service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:52.670277 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235fa721-d0cd-48bd-96d1-a5ce997018fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:52.671260 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235fa721-d0cd-48bd-96d1-a5ce997018fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:52.671783 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235fa721-d0cd-48bd-96d1-a5ce997018fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:52.672116 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235fa721-d0cd-48bd-96d1-a5ce997018fc admin admin] PATH_INFO: `/v3/users/732c9b61b9a04c1aa977072702cdeb74` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:52.673342 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235fa721-d0cd-48bd-96d1-a5ce997018fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=732c9b61b9a04c1aa977072702cdeb74)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:52.675287 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235fa721-d0cd-48bd-96d1-a5ce997018fc admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:52.882584 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-235fa721-d0cd-48bd-96d1-a5ce997018fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '732c9b61b9a04c1aa977072702cdeb74'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:52.883232 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-235fa721-d0cd-48bd-96d1-a5ce997018fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '732c9b61b9a04c1aa977072702cdeb74'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:52.890259 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-235fa721-d0cd-48bd-96d1-a5ce997018fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '732c9b61b9a04c1aa977072702cdeb74'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:52.958592 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-235fa721-d0cd-48bd-96d1-a5ce997018fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '732c9b61b9a04c1aa977072702cdeb74'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:52.959211 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-235fa721-d0cd-48bd-96d1-a5ce997018fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '732c9b61b9a04c1aa977072702cdeb74'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:52.976618 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1161/2350] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:24:52 2022] DELETE /identity/v3/users/732c9b61b9a04c1aa977072702cdeb74 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:24:53.474157 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc74e38-aae1-435c-a618-60d0c4c81e9f admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:53.476422 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-bcc74e38-aae1-435c-a618-60d0c4c81e9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:24:53.542403 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc74e38-aae1-435c-a618-60d0c4c81e9f admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:53.608254 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9a01e8-2b5f-4871-bc65-c35b26bf2687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:53.609415 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a01e8-2b5f-4871-bc65-c35b26bf2687 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:53.609868 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a01e8-2b5f-4871-bc65-c35b26bf2687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:53.610301 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a01e8-2b5f-4871-bc65-c35b26bf2687 admin admin] PATH_INFO: `/v3/projects/a7183f3cdac746f8840cf4323a40a0cb` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:53.611748 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9a01e8-2b5f-4871-bc65-c35b26bf2687 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7183f3cdac746f8840cf4323a40a0cb)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:53.614534 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9a01e8-2b5f-4871-bc65-c35b26bf2687 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:53.754147 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-4c9a01e8-2b5f-4871-bc65-c35b26bf2687 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7183f3cdac746f8840cf4323a40a0cb', 'request_id': 'req-4c9a01e8-2b5f-4871-bc65-c35b26bf2687'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:53.760704 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-4c9a01e8-2b5f-4871-bc65-c35b26bf2687 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7183f3cdac746f8840cf4323a40a0cb', 'request_id': 'req-4c9a01e8-2b5f-4871-bc65-c35b26bf2687'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:53.767552 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-4c9a01e8-2b5f-4871-bc65-c35b26bf2687 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7183f3cdac746f8840cf4323a40a0cb', 'request_id': 'req-4c9a01e8-2b5f-4871-bc65-c35b26bf2687'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:53.867564 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-4c9a01e8-2b5f-4871-bc65-c35b26bf2687 admin admin] The token cache is being invalidate because project a7183f3cdac746f8840cf4323a40a0cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:24:53.867860 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-4c9a01e8-2b5f-4871-bc65-c35b26bf2687 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:53.868560 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-4c9a01e8-2b5f-4871-bc65-c35b26bf2687 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:53.870414 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1190/2351] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:24:53 2022] DELETE /identity/v3/projects/a7183f3cdac746f8840cf4323a40a0cb => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:24:53.874972 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48d4d9-3628-4128-9d08-b715afed68ac None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:53.875267 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48d4d9-3628-4128-9d08-b715afed68ac None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:53.875614 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48d4d9-3628-4128-9d08-b715afed68ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:53.894448 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-0b48d4d9-3628-4128-9d08-b715afed68ac None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:24:53.896226 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-0b48d4d9-3628-4128-9d08-b715afed68ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:24:53.977605 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1162/2352] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:24:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:24:53.985819 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2e703-be02-4318-83cf-76d7bfc08de8 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:53.986322 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2e703-be02-4318-83cf-76d7bfc08de8 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:53.986777 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2e703-be02-4318-83cf-76d7bfc08de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:54.010413 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-3cf2e703-be02-4318-83cf-76d7bfc08de8 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:24:54.012301 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-3cf2e703-be02-4318-83cf-76d7bfc08de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:24:54.029633 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1191/2353] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:24:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:24:54.038768 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b48d4d9-3628-4128-9d08-b715afed68ac None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:54.049381 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b48d4d9-3628-4128-9d08-b715afed68ac None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:54.054747 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9122933f-9091-40fa-bc09-fc51130a1b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:54.055538 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122933f-9091-40fa-bc09-fc51130a1b04 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:54.055901 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122933f-9091-40fa-bc09-fc51130a1b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:54.056286 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122933f-9091-40fa-bc09-fc51130a1b04 admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:54.057107 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9122933f-9091-40fa-bc09-fc51130a1b04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:24:54.058118 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9122933f-9091-40fa-bc09-fc51130a1b04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:54.059887 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9122933f-9091-40fa-bc09-fc51130a1b04 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:54.077559 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf2e703-be02-4318-83cf-76d7bfc08de8 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:54.084847 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1163/2354] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 10 03:24:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:24:54.089100 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf2e703-be02-4318-83cf-76d7bfc08de8 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:54.094692 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad92d879-2261-460e-883e-f56f47ff05e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:54.095373 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92d879-2261-460e-883e-f56f47ff05e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:54.095651 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92d879-2261-460e-883e-f56f47ff05e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:54.095928 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92d879-2261-460e-883e-f56f47ff05e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:54.097115 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad92d879-2261-460e-883e-f56f47ff05e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:54.099591 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad92d879-2261-460e-883e-f56f47ff05e3 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:54.198187 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1192/2355] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:24:54 2022] POST /identity/v3/projects => generated 381 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:24:54.199728 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9122933f-9091-40fa-bc09-fc51130a1b04 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:54.214144 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9122933f-9091-40fa-bc09-fc51130a1b04 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:54.309611 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38503295-b5a7-442b-88cd-7d286c5a659c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:54.310625 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38503295-b5a7-442b-88cd-7d286c5a659c admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:54.311105 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38503295-b5a7-442b-88cd-7d286c5a659c admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:54.311672 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38503295-b5a7-442b-88cd-7d286c5a659c admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:54.312622 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38503295-b5a7-442b-88cd-7d286c5a659c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:54.314801 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38503295-b5a7-442b-88cd-7d286c5a659c admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:54.445083 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad92d879-2261-460e-883e-f56f47ff05e3 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:54.445502 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1164/2356] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:24:54 2022] POST /identity/v3/users => generated 291 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:24:54.446369 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38503295-b5a7-442b-88cd-7d286c5a659c admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:54.447224 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-ad92d879-2261-460e-883e-f56f47ff05e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:24:54.465750 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38503295-b5a7-442b-88cd-7d286c5a659c admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:54.473692 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f551f3df-7d10-4677-963f-90ba5cef3424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:54.473692 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551f3df-7d10-4677-963f-90ba5cef3424 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:54.473692 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551f3df-7d10-4677-963f-90ba5cef3424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:54.473692 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551f3df-7d10-4677-963f-90ba5cef3424 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:54.474457 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f551f3df-7d10-4677-963f-90ba5cef3424 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:54.474843 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f551f3df-7d10-4677-963f-90ba5cef3424 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:54.486702 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1165/2357] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:24:54 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:24:54.490719 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f551f3df-7d10-4677-963f-90ba5cef3424 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:54.502640 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f551f3df-7d10-4677-963f-90ba5cef3424 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:54.508139 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15722ed8-174d-4c21-8a25-b3a523ae44f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:54.508801 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15722ed8-174d-4c21-8a25-b3a523ae44f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:54.509082 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15722ed8-174d-4c21-8a25-b3a523ae44f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:54.509359 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15722ed8-174d-4c21-8a25-b3a523ae44f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:54.510089 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15722ed8-174d-4c21-8a25-b3a523ae44f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:54.511680 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15722ed8-174d-4c21-8a25-b3a523ae44f7 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:54.525414 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1166/2358] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:24:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:24:54.526676 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15722ed8-174d-4c21-8a25-b3a523ae44f7 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:54.531979 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad92d879-2261-460e-883e-f56f47ff05e3 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:54.538113 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfcf61a-b7c1-4f12-a61e-a057bee6220c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b7ccdccba0b4f9e86817946f22dbe28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:54.538767 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfcf61a-b7c1-4f12-a61e-a057bee6220c service nova] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:54.539048 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfcf61a-b7c1-4f12-a61e-a057bee6220c service nova] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:54.539409 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfcf61a-b7c1-4f12-a61e-a057bee6220c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:54.539688 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15722ed8-174d-4c21-8a25-b3a523ae44f7 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:54.541379 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-2cfcf61a-b7c1-4f12-a61e-a057bee6220c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:24:54.544679 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e434d1-a965-43bb-81fe-81f4ec4220e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:54.545694 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e434d1-a965-43bb-81fe-81f4ec4220e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:54.546042 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e434d1-a965-43bb-81fe-81f4ec4220e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:54.546386 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e434d1-a965-43bb-81fe-81f4ec4220e9 admin admin] PATH_INFO: `/v3/projects/9ce3961b8e394694a5e2989f1dea9497/users/30b750169a0c4d3c82ef690deca7ad40/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:54.556481 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfcf61a-b7c1-4f12-a61e-a057bee6220c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:54.558082 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfcf61a-b7c1-4f12-a61e-a057bee6220c service nova] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:54.564186 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e434d1-a965-43bb-81fe-81f4ec4220e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ce3961b8e394694a5e2989f1dea9497, user_id=30b750169a0c4d3c82ef690deca7ad40, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:54.567385 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e434d1-a965-43bb-81fe-81f4ec4220e9 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:54.569663 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1193/2359] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:24:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:24:54.650650 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1167/2360] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:24:54 2022] PUT /identity/v3/projects/9ce3961b8e394694a5e2989f1dea9497/users/30b750169a0c4d3c82ef690deca7ad40/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:24:54.662075 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0afae36-a003-459e-b3d0-ee23aafc9ce8 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:54.662368 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0afae36-a003-459e-b3d0-ee23aafc9ce8 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:54.662651 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0afae36-a003-459e-b3d0-ee23aafc9ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:54.692863 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-a0afae36-a003-459e-b3d0-ee23aafc9ce8 None None] MFA Rules not processed for user `30b750169a0c4d3c82ef690deca7ad40`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:24:54.694331 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-a0afae36-a003-459e-b3d0-ee23aafc9ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:24:54.784135 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1194/2361] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:24:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:24:54.787697 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e434d1-a965-43bb-81fe-81f4ec4220e9 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:54.861865 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e434d1-a965-43bb-81fe-81f4ec4220e9 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:54.867274 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9522d6-6c0d-41a5-a3e4-6aec059ec5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:54.867946 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9522d6-6c0d-41a5-a3e4-6aec059ec5ea admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:54.868261 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9522d6-6c0d-41a5-a3e4-6aec059ec5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:54.868542 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9522d6-6c0d-41a5-a3e4-6aec059ec5ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:54.869238 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9522d6-6c0d-41a5-a3e4-6aec059ec5ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:54.871149 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9522d6-6c0d-41a5-a3e4-6aec059ec5ea admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:54.941073 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1168/2362] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:24:54 2022] POST /identity/v3/projects => generated 381 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:24:54.943522 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0afae36-a003-459e-b3d0-ee23aafc9ce8 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:54.956216 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0afae36-a003-459e-b3d0-ee23aafc9ce8 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:55.013886 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd7244f-ecd5-4c69-b8b9-2a66f0bc54fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:55.014625 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7244f-ecd5-4c69-b8b9-2a66f0bc54fc admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:55.014907 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7244f-ecd5-4c69-b8b9-2a66f0bc54fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:55.015183 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7244f-ecd5-4c69-b8b9-2a66f0bc54fc admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:55.015898 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd7244f-ecd5-4c69-b8b9-2a66f0bc54fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:55.017882 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd7244f-ecd5-4c69-b8b9-2a66f0bc54fc admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:55.099784 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1195/2363] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:24:54 2022] POST /identity/v3/users => generated 297 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:24:55.100994 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9522d6-6c0d-41a5-a3e4-6aec059ec5ea admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:55.115810 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9522d6-6c0d-41a5-a3e4-6aec059ec5ea admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:55.124353 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f35af2-5855-4907-80cf-94fe78641c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:55.125143 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f35af2-5855-4907-80cf-94fe78641c06 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:55.125468 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f35af2-5855-4907-80cf-94fe78641c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:55.125759 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f35af2-5855-4907-80cf-94fe78641c06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:55.126612 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f35af2-5855-4907-80cf-94fe78641c06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:55.128304 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f35af2-5855-4907-80cf-94fe78641c06 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:55.142948 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1169/2364] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:24:55 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:24:55.150691 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd7244f-ecd5-4c69-b8b9-2a66f0bc54fc admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:55.162738 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd7244f-ecd5-4c69-b8b9-2a66f0bc54fc admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:55.170967 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1d1694-460d-4728-b0cc-0d895fe39583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:55.172151 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d1694-460d-4728-b0cc-0d895fe39583 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:55.172437 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d1694-460d-4728-b0cc-0d895fe39583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:55.172708 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d1694-460d-4728-b0cc-0d895fe39583 admin admin] PATH_INFO: `/v3/projects/6d9087c26a8149819bc18c1d1cfb276d/users/39a9a3622a114574980114c16f533f57/roles/43105000610f402ca2486e7648018cca` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:55.189206 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1d1694-460d-4728-b0cc-0d895fe39583 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d9087c26a8149819bc18c1d1cfb276d, user_id=39a9a3622a114574980114c16f533f57, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:55.192451 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1d1694-460d-4728-b0cc-0d895fe39583 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:55.262117 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1196/2365] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:24:55 2022] PUT /identity/v3/projects/6d9087c26a8149819bc18c1d1cfb276d/users/39a9a3622a114574980114c16f533f57/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:24:55.266443 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f35af2-5855-4907-80cf-94fe78641c06 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:55.281689 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f35af2-5855-4907-80cf-94fe78641c06 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:55.338992 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b99e0-8828-45fb-8067-ef37e915d005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:55.339785 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b99e0-8828-45fb-8067-ef37e915d005 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:55.340102 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b99e0-8828-45fb-8067-ef37e915d005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:55.340371 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b99e0-8828-45fb-8067-ef37e915d005 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:55.341112 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870b99e0-8828-45fb-8067-ef37e915d005 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:55.342734 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870b99e0-8828-45fb-8067-ef37e915d005 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:55.353450 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1170/2366] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:24:55 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:24:55.357600 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1d1694-460d-4728-b0cc-0d895fe39583 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:55.368210 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1d1694-460d-4728-b0cc-0d895fe39583 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:55.372885 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d21de-0a81-4410-862b-60ffe3674f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:55.373899 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d21de-0a81-4410-862b-60ffe3674f86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:55.374180 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d21de-0a81-4410-862b-60ffe3674f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:55.374454 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d21de-0a81-4410-862b-60ffe3674f86 admin admin] PATH_INFO: `/v3/projects/6d9087c26a8149819bc18c1d1cfb276d/users/39a9a3622a114574980114c16f533f57/roles/43105000610f402ca2486e7648018cca` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:55.376470 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8d21de-0a81-4410-862b-60ffe3674f86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d9087c26a8149819bc18c1d1cfb276d, user_id=39a9a3622a114574980114c16f533f57, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:55.379677 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8d21de-0a81-4410-862b-60ffe3674f86 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:55.390104 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1197/2367] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:24:55 2022] PUT /identity/v3/projects/6d9087c26a8149819bc18c1d1cfb276d/users/39a9a3622a114574980114c16f533f57/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:24:55.400769 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43609a64-f40c-4d16-b8b1-ba54eb5d2294 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:55.401060 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43609a64-f40c-4d16-b8b1-ba54eb5d2294 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:55.401339 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43609a64-f40c-4d16-b8b1-ba54eb5d2294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:55.427971 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-43609a64-f40c-4d16-b8b1-ba54eb5d2294 None None] MFA Rules not processed for user `39a9a3622a114574980114c16f533f57`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:24:55.429208 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-43609a64-f40c-4d16-b8b1-ba54eb5d2294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:24:55.506249 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1171/2368] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:24:55 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:24:55.518590 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d21de-0a81-4410-862b-60ffe3674f86 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:55.520352 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-4d8d21de-0a81-4410-862b-60ffe3674f86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:24:55.577066 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d21de-0a81-4410-862b-60ffe3674f86 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:55.580741 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38be6c18-a557-49da-aab8-afaf6464c132 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:55.581382 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be6c18-a557-49da-aab8-afaf6464c132 service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:55.581670 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be6c18-a557-49da-aab8-afaf6464c132 service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:55.581948 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be6c18-a557-49da-aab8-afaf6464c132 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:55.590852 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38be6c18-a557-49da-aab8-afaf6464c132 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:55.592318 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38be6c18-a557-49da-aab8-afaf6464c132 service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:55.601633 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1198/2369] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:24:55 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:24:56.515231 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43609a64-f40c-4d16-b8b1-ba54eb5d2294 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:56.516849 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38be6c18-a557-49da-aab8-afaf6464c132 service cinder] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:56.521093 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-38be6c18-a557-49da-aab8-afaf6464c132 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:24:56.526889 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43609a64-f40c-4d16-b8b1-ba54eb5d2294 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:56.532108 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f851e-54c4-444c-be6b-84fc36437acc tempest-VolumeQuotaClassesTest-2058499885 tempest-VolumeQuotaClassesTest-2058499885-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39a9a3622a114574980114c16f533f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d9087c26a8149819bc18c1d1cfb276d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:56.532994 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f851e-54c4-444c-be6b-84fc36437acc tempest-VolumeQuotaClassesTest-2058499885 tempest-VolumeQuotaClassesTest-2058499885-project-admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:56.533282 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f851e-54c4-444c-be6b-84fc36437acc tempest-VolumeQuotaClassesTest-2058499885 tempest-VolumeQuotaClassesTest-2058499885-project-admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:56.538171 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f851e-54c4-444c-be6b-84fc36437acc tempest-VolumeQuotaClassesTest-2058499885 tempest-VolumeQuotaClassesTest-2058499885-project-admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:56.538171 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19f851e-54c4-444c-be6b-84fc36437acc tempest-VolumeQuotaClassesTest-2058499885 tempest-VolumeQuotaClassesTest-2058499885-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:24:56.538171 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19f851e-54c4-444c-be6b-84fc36437acc tempest-VolumeQuotaClassesTest-2058499885 tempest-VolumeQuotaClassesTest-2058499885-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:56.538171 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19f851e-54c4-444c-be6b-84fc36437acc tempest-VolumeQuotaClassesTest-2058499885 tempest-VolumeQuotaClassesTest-2058499885-project-admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:56.553104 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1172/2370] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 10 03:24:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:24:56.554018 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f851e-54c4-444c-be6b-84fc36437acc tempest-VolumeQuotaClassesTest-2058499885 tempest-VolumeQuotaClassesTest-2058499885-project-admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:56.565787 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f851e-54c4-444c-be6b-84fc36437acc tempest-VolumeQuotaClassesTest-2058499885 tempest-VolumeQuotaClassesTest-2058499885-project-admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:56.571220 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63266124-e848-43da-9a60-3c34b41991ba tempest-VolumeQuotaClassesTest-2058499885 tempest-VolumeQuotaClassesTest-2058499885-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39a9a3622a114574980114c16f533f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d9087c26a8149819bc18c1d1cfb276d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:56.572057 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63266124-e848-43da-9a60-3c34b41991ba tempest-VolumeQuotaClassesTest-2058499885 tempest-VolumeQuotaClassesTest-2058499885-project-admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:56.572458 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63266124-e848-43da-9a60-3c34b41991ba tempest-VolumeQuotaClassesTest-2058499885 tempest-VolumeQuotaClassesTest-2058499885-project-admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:56.572841 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63266124-e848-43da-9a60-3c34b41991ba tempest-VolumeQuotaClassesTest-2058499885 tempest-VolumeQuotaClassesTest-2058499885-project-admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:56.574401 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63266124-e848-43da-9a60-3c34b41991ba tempest-VolumeQuotaClassesTest-2058499885 tempest-VolumeQuotaClassesTest-2058499885-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:56.577516 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63266124-e848-43da-9a60-3c34b41991ba tempest-VolumeQuotaClassesTest-2058499885 tempest-VolumeQuotaClassesTest-2058499885-project-admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:56.606744 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38be6c18-a557-49da-aab8-afaf6464c132 service cinder] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:56.611899 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a0d0fc-147e-4645-9e38-5611a912d396 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f646147bdad8476ba0ab9da5d9c50b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:56.612638 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0d0fc-147e-4645-9e38-5611a912d396 service placement] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:56.612927 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0d0fc-147e-4645-9e38-5611a912d396 service placement] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:56.613204 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0d0fc-147e-4645-9e38-5611a912d396 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:56.615605 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-24a0d0fc-147e-4645-9e38-5611a912d396 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:24:56.628235 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a0d0fc-147e-4645-9e38-5611a912d396 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:56.629959 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a0d0fc-147e-4645-9e38-5611a912d396 service placement] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:56.640169 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1199/2371] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:24:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:24:56.673767 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1173/2372] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:24:56 2022] POST /identity/v3/projects => generated 354 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:24:56.678524 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a0d0fc-147e-4645-9e38-5611a912d396 service placement] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:56.692828 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a0d0fc-147e-4645-9e38-5611a912d396 service placement] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:56.764791 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63997c6-f2e8-4011-b3e5-884edeb8095d tempest-VolumeQuotaClassesTest-2058499885 tempest-VolumeQuotaClassesTest-2058499885-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39a9a3622a114574980114c16f533f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d9087c26a8149819bc18c1d1cfb276d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:56.765554 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63997c6-f2e8-4011-b3e5-884edeb8095d tempest-VolumeQuotaClassesTest-2058499885 tempest-VolumeQuotaClassesTest-2058499885-project-admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:56.765902 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63997c6-f2e8-4011-b3e5-884edeb8095d tempest-VolumeQuotaClassesTest-2058499885 tempest-VolumeQuotaClassesTest-2058499885-project-admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:56.766245 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63997c6-f2e8-4011-b3e5-884edeb8095d tempest-VolumeQuotaClassesTest-2058499885 tempest-VolumeQuotaClassesTest-2058499885-project-admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:56.767155 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63997c6-f2e8-4011-b3e5-884edeb8095d tempest-VolumeQuotaClassesTest-2058499885 tempest-VolumeQuotaClassesTest-2058499885-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:24:56.767527 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63997c6-f2e8-4011-b3e5-884edeb8095d tempest-VolumeQuotaClassesTest-2058499885 tempest-VolumeQuotaClassesTest-2058499885-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:56.769349 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63997c6-f2e8-4011-b3e5-884edeb8095d tempest-VolumeQuotaClassesTest-2058499885 tempest-VolumeQuotaClassesTest-2058499885-project-admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:56.784041 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1200/2373] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 10 03:24:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:24:56.822816 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63266124-e848-43da-9a60-3c34b41991ba tempest-VolumeQuotaClassesTest-2058499885 tempest-VolumeQuotaClassesTest-2058499885-project-admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:56.837481 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63266124-e848-43da-9a60-3c34b41991ba tempest-VolumeQuotaClassesTest-2058499885 tempest-VolumeQuotaClassesTest-2058499885-project-admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:56.842279 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f956a52-5dd5-40e0-bd73-bdfb59ac6555 tempest-VolumeQuotaClassesTest-2058499885 tempest-VolumeQuotaClassesTest-2058499885-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39a9a3622a114574980114c16f533f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d9087c26a8149819bc18c1d1cfb276d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:56.843189 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f956a52-5dd5-40e0-bd73-bdfb59ac6555 tempest-VolumeQuotaClassesTest-2058499885 tempest-VolumeQuotaClassesTest-2058499885-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:56.843475 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f956a52-5dd5-40e0-bd73-bdfb59ac6555 tempest-VolumeQuotaClassesTest-2058499885 tempest-VolumeQuotaClassesTest-2058499885-project-admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:56.843748 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f956a52-5dd5-40e0-bd73-bdfb59ac6555 tempest-VolumeQuotaClassesTest-2058499885 tempest-VolumeQuotaClassesTest-2058499885-project-admin] PATH_INFO: `/v3/projects/5fc3b536cc2546a3a5791b8a9af05f90` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:56.844975 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f956a52-5dd5-40e0-bd73-bdfb59ac6555 tempest-VolumeQuotaClassesTest-2058499885 tempest-VolumeQuotaClassesTest-2058499885-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5fc3b536cc2546a3a5791b8a9af05f90)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:56.846927 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f956a52-5dd5-40e0-bd73-bdfb59ac6555 tempest-VolumeQuotaClassesTest-2058499885 tempest-VolumeQuotaClassesTest-2058499885-project-admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:56.952828 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-9f956a52-5dd5-40e0-bd73-bdfb59ac6555 tempest-VolumeQuotaClassesTest-2058499885 tempest-VolumeQuotaClassesTest-2058499885-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fc3b536cc2546a3a5791b8a9af05f90', 'request_id': 'req-9f956a52-5dd5-40e0-bd73-bdfb59ac6555'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:56.960588 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-9f956a52-5dd5-40e0-bd73-bdfb59ac6555 tempest-VolumeQuotaClassesTest-2058499885 tempest-VolumeQuotaClassesTest-2058499885-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fc3b536cc2546a3a5791b8a9af05f90', 'request_id': 'req-9f956a52-5dd5-40e0-bd73-bdfb59ac6555'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:56.967388 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-9f956a52-5dd5-40e0-bd73-bdfb59ac6555 tempest-VolumeQuotaClassesTest-2058499885 tempest-VolumeQuotaClassesTest-2058499885-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fc3b536cc2546a3a5791b8a9af05f90', 'request_id': 'req-9f956a52-5dd5-40e0-bd73-bdfb59ac6555'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:57.063530 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-9f956a52-5dd5-40e0-bd73-bdfb59ac6555 tempest-VolumeQuotaClassesTest-2058499885 tempest-VolumeQuotaClassesTest-2058499885-project-admin] The token cache is being invalidate because project 5fc3b536cc2546a3a5791b8a9af05f90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:24:57.063871 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-9f956a52-5dd5-40e0-bd73-bdfb59ac6555 tempest-VolumeQuotaClassesTest-2058499885 tempest-VolumeQuotaClassesTest-2058499885-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:57.064654 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-9f956a52-5dd5-40e0-bd73-bdfb59ac6555 tempest-VolumeQuotaClassesTest-2058499885 tempest-VolumeQuotaClassesTest-2058499885-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:57.075751 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1174/2374] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:24:56 2022] DELETE /identity/v3/projects/5fc3b536cc2546a3a5791b8a9af05f90 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:24:57.683668 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63997c6-f2e8-4011-b3e5-884edeb8095d tempest-VolumeQuotaClassesTest-2058499885 tempest-VolumeQuotaClassesTest-2058499885-project-admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:57.686280 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-b63997c6-f2e8-4011-b3e5-884edeb8095d tempest-VolumeQuotaClassesTest-2058499885 tempest-VolumeQuotaClassesTest-2058499885-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:24:57.775942 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63997c6-f2e8-4011-b3e5-884edeb8095d tempest-VolumeQuotaClassesTest-2058499885 tempest-VolumeQuotaClassesTest-2058499885-project-admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:57.838308 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844639d8-a960-4a54-817a-701e74284b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:57.839278 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844639d8-a960-4a54-817a-701e74284b29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:57.839757 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844639d8-a960-4a54-817a-701e74284b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:57.840169 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844639d8-a960-4a54-817a-701e74284b29 admin admin] PATH_INFO: `/v3/users/30b750169a0c4d3c82ef690deca7ad40` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:57.841544 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844639d8-a960-4a54-817a-701e74284b29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30b750169a0c4d3c82ef690deca7ad40)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:57.843550 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844639d8-a960-4a54-817a-701e74284b29 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:58.062575 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-844639d8-a960-4a54-817a-701e74284b29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30b750169a0c4d3c82ef690deca7ad40'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:58.074892 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-844639d8-a960-4a54-817a-701e74284b29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30b750169a0c4d3c82ef690deca7ad40'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:58.087674 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-844639d8-a960-4a54-817a-701e74284b29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30b750169a0c4d3c82ef690deca7ad40'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:58.088399 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-844639d8-a960-4a54-817a-701e74284b29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30b750169a0c4d3c82ef690deca7ad40'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:58.089010 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-844639d8-a960-4a54-817a-701e74284b29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30b750169a0c4d3c82ef690deca7ad40'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:58.160113 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1201/2375] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:24:57 2022] DELETE /identity/v3/users/30b750169a0c4d3c82ef690deca7ad40 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:24:58.166408 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50299d2d-9618-4def-a914-83226fd1d99c None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:58.166945 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50299d2d-9618-4def-a914-83226fd1d99c None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:58.167118 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50299d2d-9618-4def-a914-83226fd1d99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:58.191956 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-50299d2d-9618-4def-a914-83226fd1d99c None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:24:58.193394 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-50299d2d-9618-4def-a914-83226fd1d99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:24:58.263933 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1175/2376] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:24:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:24:58.275779 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844639d8-a960-4a54-817a-701e74284b29 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:58.277440 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-844639d8-a960-4a54-817a-701e74284b29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:24:58.343841 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844639d8-a960-4a54-817a-701e74284b29 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:58.360948 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d14b0c0-e864-4f5a-929d-fe348fcb61c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:58.362524 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14b0c0-e864-4f5a-929d-fe348fcb61c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:58.363119 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14b0c0-e864-4f5a-929d-fe348fcb61c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:58.364304 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14b0c0-e864-4f5a-929d-fe348fcb61c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:58.378591 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d14b0c0-e864-4f5a-929d-fe348fcb61c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:58.387106 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d14b0c0-e864-4f5a-929d-fe348fcb61c7 service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:58.401923 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1202/2377] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:24:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:24:59.764042 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50299d2d-9618-4def-a914-83226fd1d99c None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:24:59.765630 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-50299d2d-9618-4def-a914-83226fd1d99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:24:59.778554 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50299d2d-9618-4def-a914-83226fd1d99c None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:24:59.783693 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb7e145-b9bf-4986-b4cd-f64a7b6e8c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:24:59.784941 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7e145-b9bf-4986-b4cd-f64a7b6e8c9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:24:59.785979 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7e145-b9bf-4986-b4cd-f64a7b6e8c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:24:59.786735 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7e145-b9bf-4986-b4cd-f64a7b6e8c9a admin admin] PATH_INFO: `/v3/projects/9ce3961b8e394694a5e2989f1dea9497` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:24:59.788435 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb7e145-b9bf-4986-b4cd-f64a7b6e8c9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ce3961b8e394694a5e2989f1dea9497)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:24:59.790450 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb7e145-b9bf-4986-b4cd-f64a7b6e8c9a admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:24:59.902711 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-ffb7e145-b9bf-4986-b4cd-f64a7b6e8c9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ce3961b8e394694a5e2989f1dea9497', 'request_id': 'req-ffb7e145-b9bf-4986-b4cd-f64a7b6e8c9a'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:59.909371 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-ffb7e145-b9bf-4986-b4cd-f64a7b6e8c9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ce3961b8e394694a5e2989f1dea9497', 'request_id': 'req-ffb7e145-b9bf-4986-b4cd-f64a7b6e8c9a'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:59.916638 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-ffb7e145-b9bf-4986-b4cd-f64a7b6e8c9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ce3961b8e394694a5e2989f1dea9497', 'request_id': 'req-ffb7e145-b9bf-4986-b4cd-f64a7b6e8c9a'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:24:59.997696 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-ffb7e145-b9bf-4986-b4cd-f64a7b6e8c9a admin admin] The token cache is being invalidate because project 9ce3961b8e394694a5e2989f1dea9497 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:25:00.000752 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-ffb7e145-b9bf-4986-b4cd-f64a7b6e8c9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:00.000752 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-ffb7e145-b9bf-4986-b4cd-f64a7b6e8c9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:00.000752 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1176/2378] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:24:59 2022] DELETE /identity/v3/projects/9ce3961b8e394694a5e2989f1dea9497 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:25:00.004331 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d14b0c0-e864-4f5a-929d-fe348fcb61c7 service neutron] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:00.014962 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d14b0c0-e864-4f5a-929d-fe348fcb61c7 service neutron] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:00.070539 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951a620b-db87-4269-b80a-3f25348447a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:00.071442 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a620b-db87-4269-b80a-3f25348447a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:00.071740 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a620b-db87-4269-b80a-3f25348447a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:00.072037 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a620b-db87-4269-b80a-3f25348447a4 admin admin] PATH_INFO: `/v3/users/39a9a3622a114574980114c16f533f57` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:00.073237 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951a620b-db87-4269-b80a-3f25348447a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39a9a3622a114574980114c16f533f57)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:00.075203 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951a620b-db87-4269-b80a-3f25348447a4 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:00.148895 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c55ac8-0106-471a-b7b6-42bf78ff8a32 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:00.149191 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c55ac8-0106-471a-b7b6-42bf78ff8a32 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:00.153372 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c55ac8-0106-471a-b7b6-42bf78ff8a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:00.167930 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-d0c55ac8-0106-471a-b7b6-42bf78ff8a32 None None] MFA Rules not processed for user `6ebfab3ff0b24f4aaabb8c6bb0ad10c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:25:00.169106 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-d0c55ac8-0106-471a-b7b6-42bf78ff8a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:00.222524 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1177/2379] 10.222.0.65 () {58 vars in 1009 bytes} [Tue May 10 03:25:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:25:00.235111 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c55ac8-0106-471a-b7b6-42bf78ff8a32 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:00.236490 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-d0c55ac8-0106-471a-b7b6-42bf78ff8a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:00.268802 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-951a620b-db87-4269-b80a-3f25348447a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39a9a3622a114574980114c16f533f57'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:00.276417 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-951a620b-db87-4269-b80a-3f25348447a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39a9a3622a114574980114c16f533f57'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:00.288671 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-951a620b-db87-4269-b80a-3f25348447a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39a9a3622a114574980114c16f533f57'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:00.289369 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-951a620b-db87-4269-b80a-3f25348447a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39a9a3622a114574980114c16f533f57'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:00.290233 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-951a620b-db87-4269-b80a-3f25348447a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39a9a3622a114574980114c16f533f57'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:00.304155 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c55ac8-0106-471a-b7b6-42bf78ff8a32 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:00.309186 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675040a4-7570-4127-b33f-5b6f9cb12a01 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1cb8ad43a234233ad602f451f0f8ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:00.309830 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675040a4-7570-4127-b33f-5b6f9cb12a01 service swift] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:00.310111 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675040a4-7570-4127-b33f-5b6f9cb12a01 service swift] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:00.310384 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675040a4-7570-4127-b33f-5b6f9cb12a01 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:00.312414 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-675040a4-7570-4127-b33f-5b6f9cb12a01 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:00.323667 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675040a4-7570-4127-b33f-5b6f9cb12a01 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:00.325337 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675040a4-7570-4127-b33f-5b6f9cb12a01 service swift] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:00.335438 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1178/2380] 10.222.0.65 () {60 vars in 1384 bytes} [Tue May 10 03:25:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 10 03:25:00.375263 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1203/2381] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:25:00 2022] DELETE /identity/v3/users/39a9a3622a114574980114c16f533f57 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:25:00.891666 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675040a4-7570-4127-b33f-5b6f9cb12a01 service swift] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:00.893384 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-675040a4-7570-4127-b33f-5b6f9cb12a01 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:00.918765 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675040a4-7570-4127-b33f-5b6f9cb12a01 service swift] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:01.011921 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c48058c-55a7-42dd-b5b9-9386d6a46a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:01.013087 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48058c-55a7-42dd-b5b9-9386d6a46a03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:01.013376 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48058c-55a7-42dd-b5b9-9386d6a46a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:01.013650 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48058c-55a7-42dd-b5b9-9386d6a46a03 admin admin] PATH_INFO: `/v3/projects/6d9087c26a8149819bc18c1d1cfb276d` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:01.014870 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c48058c-55a7-42dd-b5b9-9386d6a46a03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d9087c26a8149819bc18c1d1cfb276d)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:01.017022 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c48058c-55a7-42dd-b5b9-9386d6a46a03 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:01.175359 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-9c48058c-55a7-42dd-b5b9-9386d6a46a03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d9087c26a8149819bc18c1d1cfb276d', 'request_id': 'req-9c48058c-55a7-42dd-b5b9-9386d6a46a03'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:01.185015 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-9c48058c-55a7-42dd-b5b9-9386d6a46a03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d9087c26a8149819bc18c1d1cfb276d', 'request_id': 'req-9c48058c-55a7-42dd-b5b9-9386d6a46a03'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:01.192937 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-9c48058c-55a7-42dd-b5b9-9386d6a46a03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d9087c26a8149819bc18c1d1cfb276d', 'request_id': 'req-9c48058c-55a7-42dd-b5b9-9386d6a46a03'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:01.297482 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-9c48058c-55a7-42dd-b5b9-9386d6a46a03 admin admin] The token cache is being invalidate because project 6d9087c26a8149819bc18c1d1cfb276d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:25:01.298013 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-9c48058c-55a7-42dd-b5b9-9386d6a46a03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:01.300357 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-9c48058c-55a7-42dd-b5b9-9386d6a46a03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:01.304868 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1179/2382] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:25:00 2022] DELETE /identity/v3/projects/6d9087c26a8149819bc18c1d1cfb276d => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:25:01.310915 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f28d4-e2ba-4a69-a35a-735a5790986d None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:01.311410 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f28d4-e2ba-4a69-a35a-735a5790986d None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:01.314351 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f28d4-e2ba-4a69-a35a-735a5790986d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:01.343834 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-c04f28d4-e2ba-4a69-a35a-735a5790986d None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:25:01.345493 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-c04f28d4-e2ba-4a69-a35a-735a5790986d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:01.428363 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1204/2383] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:25:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:25:01.438653 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc3f22c-70e1-43b1-b43a-5730a0e23770 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:01.447173 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc3f22c-70e1-43b1-b43a-5730a0e23770 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:01.447173 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc3f22c-70e1-43b1-b43a-5730a0e23770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:01.478746 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-1bc3f22c-70e1-43b1-b43a-5730a0e23770 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:25:01.482665 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-1bc3f22c-70e1-43b1-b43a-5730a0e23770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:01.490732 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1180/2384] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:25:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:25:01.495539 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f28d4-e2ba-4a69-a35a-735a5790986d None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:01.508978 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f28d4-e2ba-4a69-a35a-735a5790986d None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:01.516044 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce01a47b-ef6b-49b6-b86f-37ddccbfdd84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:01.517214 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01a47b-ef6b-49b6-b86f-37ddccbfdd84 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:01.517889 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01a47b-ef6b-49b6-b86f-37ddccbfdd84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:01.519556 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01a47b-ef6b-49b6-b86f-37ddccbfdd84 admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:01.520715 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce01a47b-ef6b-49b6-b86f-37ddccbfdd84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:25:01.521526 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce01a47b-ef6b-49b6-b86f-37ddccbfdd84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:01.529912 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce01a47b-ef6b-49b6-b86f-37ddccbfdd84 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:01.537114 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1205/2385] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 10 03:25:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:25:01.541357 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc3f22c-70e1-43b1-b43a-5730a0e23770 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:01.552680 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc3f22c-70e1-43b1-b43a-5730a0e23770 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:01.558088 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13715f-045f-47d5-a53f-3779bd1d3e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:01.558940 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13715f-045f-47d5-a53f-3779bd1d3e84 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:01.559414 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13715f-045f-47d5-a53f-3779bd1d3e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:01.559889 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13715f-045f-47d5-a53f-3779bd1d3e84 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:01.560799 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd13715f-045f-47d5-a53f-3779bd1d3e84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:01.562973 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd13715f-045f-47d5-a53f-3779bd1d3e84 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:01.653031 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1181/2386] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:25:01 2022] POST /identity/v3/projects => generated 401 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:25:01.657661 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce01a47b-ef6b-49b6-b86f-37ddccbfdd84 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:01.670001 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce01a47b-ef6b-49b6-b86f-37ddccbfdd84 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:01.747784 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee56109-9d25-42a9-b2b6-1f538b0e71ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:01.748656 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee56109-9d25-42a9-b2b6-1f538b0e71ee admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:01.748941 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee56109-9d25-42a9-b2b6-1f538b0e71ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:01.749225 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee56109-9d25-42a9-b2b6-1f538b0e71ee admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:01.749987 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee56109-9d25-42a9-b2b6-1f538b0e71ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:01.752086 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee56109-9d25-42a9-b2b6-1f538b0e71ee admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:01.838866 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1206/2387] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:25:01 2022] POST /identity/v3/users => generated 301 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:25:01.843619 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13715f-045f-47d5-a53f-3779bd1d3e84 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:01.855628 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13715f-045f-47d5-a53f-3779bd1d3e84 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:01.861057 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c174d771-4bbd-4989-8fdb-4f182699b411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:01.861739 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174d771-4bbd-4989-8fdb-4f182699b411 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:01.862027 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174d771-4bbd-4989-8fdb-4f182699b411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:01.862355 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174d771-4bbd-4989-8fdb-4f182699b411 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:01.863083 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c174d771-4bbd-4989-8fdb-4f182699b411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:01.865475 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c174d771-4bbd-4989-8fdb-4f182699b411 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:01.876819 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1182/2388] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:25:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:25:01.881006 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee56109-9d25-42a9-b2b6-1f538b0e71ee admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:01.894653 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee56109-9d25-42a9-b2b6-1f538b0e71ee admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:01.900151 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3584d602-de4c-4cf5-88c5-85aebd774025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:01.900852 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3584d602-de4c-4cf5-88c5-85aebd774025 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:01.901167 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3584d602-de4c-4cf5-88c5-85aebd774025 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:01.901435 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3584d602-de4c-4cf5-88c5-85aebd774025 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:01.902257 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3584d602-de4c-4cf5-88c5-85aebd774025 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:01.903995 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3584d602-de4c-4cf5-88c5-85aebd774025 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:01.916439 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1207/2389] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:25:01 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:25:01.921122 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c174d771-4bbd-4989-8fdb-4f182699b411 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:01.932981 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c174d771-4bbd-4989-8fdb-4f182699b411 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:01.938195 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa76465-2002-4193-b368-b4d3900a949e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:01.939541 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa76465-2002-4193-b368-b4d3900a949e admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:01.940129 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa76465-2002-4193-b368-b4d3900a949e admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:01.940625 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa76465-2002-4193-b368-b4d3900a949e admin admin] PATH_INFO: `/v3/projects/6184425f3c9247339b0cff0c57cc7703/users/3c1407a5b0ef4451bcaa4b48f4ae5978/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:01.957961 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa76465-2002-4193-b368-b4d3900a949e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6184425f3c9247339b0cff0c57cc7703, user_id=3c1407a5b0ef4451bcaa4b48f4ae5978, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:01.961217 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa76465-2002-4193-b368-b4d3900a949e admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:02.044484 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1183/2390] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:25:01 2022] PUT /identity/v3/projects/6184425f3c9247339b0cff0c57cc7703/users/3c1407a5b0ef4451bcaa4b48f4ae5978/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:25:02.057743 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71517c76-a7e8-4bc8-a596-c4d98613a072 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:02.058034 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71517c76-a7e8-4bc8-a596-c4d98613a072 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:02.058316 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71517c76-a7e8-4bc8-a596-c4d98613a072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:02.084463 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-71517c76-a7e8-4bc8-a596-c4d98613a072 None None] MFA Rules not processed for user `3c1407a5b0ef4451bcaa4b48f4ae5978`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:25:02.085751 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-71517c76-a7e8-4bc8-a596-c4d98613a072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:02.198002 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1208/2391] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:25:02 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:25:02.202422 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa76465-2002-4193-b368-b4d3900a949e admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:02.228816 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71517c76-a7e8-4bc8-a596-c4d98613a072 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:02.230875 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-71517c76-a7e8-4bc8-a596-c4d98613a072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:02.309623 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa76465-2002-4193-b368-b4d3900a949e admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:02.314872 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927e904c-a765-4c89-a8e2-f2830233c34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:02.316935 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e904c-a765-4c89-a8e2-f2830233c34d admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:02.317424 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e904c-a765-4c89-a8e2-f2830233c34d admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:02.317884 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e904c-a765-4c89-a8e2-f2830233c34d admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:02.318997 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927e904c-a765-4c89-a8e2-f2830233c34d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:02.321468 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927e904c-a765-4c89-a8e2-f2830233c34d admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:02.343661 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71517c76-a7e8-4bc8-a596-c4d98613a072 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:02.347535 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f8f188-bff2-4d66-9031-3ed48d9581f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:02.348987 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f8f188-bff2-4d66-9031-3ed48d9581f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:02.349355 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f8f188-bff2-4d66-9031-3ed48d9581f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:02.349846 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f8f188-bff2-4d66-9031-3ed48d9581f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:02.352415 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-51f8f188-bff2-4d66-9031-3ed48d9581f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:02.406642 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f8f188-bff2-4d66-9031-3ed48d9581f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:02.408421 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f8f188-bff2-4d66-9031-3ed48d9581f9 service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:02.432121 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1184/2392] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:25:02 2022] POST /identity/v3/projects => generated 401 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:25:02.435717 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927e904c-a765-4c89-a8e2-f2830233c34d admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:02.443748 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1209/2393] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:25:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:25:02.574250 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927e904c-a765-4c89-a8e2-f2830233c34d admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:02.579269 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b49171-98e5-41ae-9303-2332d2124256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:02.580023 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b49171-98e5-41ae-9303-2332d2124256 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:02.580322 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b49171-98e5-41ae-9303-2332d2124256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:02.580676 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b49171-98e5-41ae-9303-2332d2124256 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:02.581434 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b49171-98e5-41ae-9303-2332d2124256 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:02.585234 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b49171-98e5-41ae-9303-2332d2124256 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:02.703615 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1185/2394] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:25:02 2022] POST /identity/v3/users => generated 307 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:25:02.708458 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f8f188-bff2-4d66-9031-3ed48d9581f9 service neutron] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:02.718609 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f8f188-bff2-4d66-9031-3ed48d9581f9 service neutron] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:02.729575 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a1825-b68e-420b-800c-9ffe22d4f85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:02.730266 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a1825-b68e-420b-800c-9ffe22d4f85e admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:02.730551 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a1825-b68e-420b-800c-9ffe22d4f85e admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:02.730831 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a1825-b68e-420b-800c-9ffe22d4f85e admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:02.731581 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550a1825-b68e-420b-800c-9ffe22d4f85e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:02.733581 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550a1825-b68e-420b-800c-9ffe22d4f85e admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:02.758120 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1210/2395] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:25:02 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:25:02.762418 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b49171-98e5-41ae-9303-2332d2124256 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:02.775407 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b49171-98e5-41ae-9303-2332d2124256 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:02.790029 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c17c00d-f27e-44f9-8a8b-5331a3012b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:02.790875 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c17c00d-f27e-44f9-8a8b-5331a3012b1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:02.791234 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c17c00d-f27e-44f9-8a8b-5331a3012b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:02.791507 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c17c00d-f27e-44f9-8a8b-5331a3012b1d admin admin] PATH_INFO: `/v3/projects/2f6005131f934e2da3d8dbb444d05b41/users/0362a92fa1f84c108d6721c2379837d3/roles/43105000610f402ca2486e7648018cca` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:02.820761 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c17c00d-f27e-44f9-8a8b-5331a3012b1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f6005131f934e2da3d8dbb444d05b41, user_id=0362a92fa1f84c108d6721c2379837d3, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:02.824431 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c17c00d-f27e-44f9-8a8b-5331a3012b1d admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:02.905441 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1186/2396] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:25:02 2022] PUT /identity/v3/projects/2f6005131f934e2da3d8dbb444d05b41/users/0362a92fa1f84c108d6721c2379837d3/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:25:02.911999 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a1825-b68e-420b-800c-9ffe22d4f85e admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:02.923389 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a1825-b68e-420b-800c-9ffe22d4f85e admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:03.077474 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee7a3f0-5de0-48a1-9463-9821b952a5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:03.078146 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7a3f0-5de0-48a1-9463-9821b952a5d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:03.078436 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7a3f0-5de0-48a1-9463-9821b952a5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:03.078766 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7a3f0-5de0-48a1-9463-9821b952a5d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:03.079520 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee7a3f0-5de0-48a1-9463-9821b952a5d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:03.081485 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee7a3f0-5de0-48a1-9463-9821b952a5d6 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:03.097536 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c17c00d-f27e-44f9-8a8b-5331a3012b1d admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:03.100264 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1211/2397] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:25:02 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:25:03.110066 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c17c00d-f27e-44f9-8a8b-5331a3012b1d admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:03.115457 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f20b5-ca30-4405-b9a5-cf4b20fafa33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:03.116630 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f20b5-ca30-4405-b9a5-cf4b20fafa33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:03.117153 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f20b5-ca30-4405-b9a5-cf4b20fafa33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:03.117615 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f20b5-ca30-4405-b9a5-cf4b20fafa33 admin admin] PATH_INFO: `/v3/projects/2f6005131f934e2da3d8dbb444d05b41/users/0362a92fa1f84c108d6721c2379837d3/roles/43105000610f402ca2486e7648018cca` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:03.119664 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6f20b5-ca30-4405-b9a5-cf4b20fafa33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f6005131f934e2da3d8dbb444d05b41, user_id=0362a92fa1f84c108d6721c2379837d3, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:03.122721 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6f20b5-ca30-4405-b9a5-cf4b20fafa33 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:03.155567 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1187/2398] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:25:03 2022] PUT /identity/v3/projects/2f6005131f934e2da3d8dbb444d05b41/users/0362a92fa1f84c108d6721c2379837d3/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:25:03.157563 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa08e978-adf3-4e86-8af0-0eb62e0b6881 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:03.157838 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa08e978-adf3-4e86-8af0-0eb62e0b6881 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:03.158124 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa08e978-adf3-4e86-8af0-0eb62e0b6881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:03.205724 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-aa08e978-adf3-4e86-8af0-0eb62e0b6881 None None] MFA Rules not processed for user `0362a92fa1f84c108d6721c2379837d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:25:03.213040 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-aa08e978-adf3-4e86-8af0-0eb62e0b6881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:03.301430 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1212/2399] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:25:03 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:25:03.320050 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f20b5-ca30-4405-b9a5-cf4b20fafa33 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:03.322960 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-dc6f20b5-ca30-4405-b9a5-cf4b20fafa33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:03.389836 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f20b5-ca30-4405-b9a5-cf4b20fafa33 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:03.394151 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659a431-b379-481d-b6b4-b35825a50276 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:03.395511 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659a431-b379-481d-b6b4-b35825a50276 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:03.395937 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659a431-b379-481d-b6b4-b35825a50276 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:03.397084 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659a431-b379-481d-b6b4-b35825a50276 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:03.413448 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2659a431-b379-481d-b6b4-b35825a50276 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:03.416408 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2659a431-b379-481d-b6b4-b35825a50276 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:03.443351 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1188/2400] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:25:03 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:25:03.663987 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa08e978-adf3-4e86-8af0-0eb62e0b6881 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:03.675083 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa08e978-adf3-4e86-8af0-0eb62e0b6881 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:03.679540 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefe0a0b-882d-4bee-b66f-e5110a3d1afd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:03.680223 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe0a0b-882d-4bee-b66f-e5110a3d1afd service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:03.680506 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe0a0b-882d-4bee-b66f-e5110a3d1afd service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:03.680876 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe0a0b-882d-4bee-b66f-e5110a3d1afd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:03.749089 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefe0a0b-882d-4bee-b66f-e5110a3d1afd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:03.750657 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefe0a0b-882d-4bee-b66f-e5110a3d1afd service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:03.769698 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1213/2401] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:25:03 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:25:04.115107 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659a431-b379-481d-b6b4-b35825a50276 service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:04.117338 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-2659a431-b379-481d-b6b4-b35825a50276 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:04.187010 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659a431-b379-481d-b6b4-b35825a50276 service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:04.192893 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae4ce81-17d0-445a-b3fc-85e29ce6318f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:04.194035 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4ce81-17d0-445a-b3fc-85e29ce6318f service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:04.194504 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4ce81-17d0-445a-b3fc-85e29ce6318f service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:04.194935 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4ce81-17d0-445a-b3fc-85e29ce6318f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:04.196950 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-4ae4ce81-17d0-445a-b3fc-85e29ce6318f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:04.284691 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae4ce81-17d0-445a-b3fc-85e29ce6318f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:04.286358 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae4ce81-17d0-445a-b3fc-85e29ce6318f service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:04.302581 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1189/2402] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:25:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:25:08.407510 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefe0a0b-882d-4bee-b66f-e5110a3d1afd service cinder] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:08.409683 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-aefe0a0b-882d-4bee-b66f-e5110a3d1afd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:08.445468 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefe0a0b-882d-4bee-b66f-e5110a3d1afd service cinder] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:08.456687 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48a3a2-c4c1-450c-b313-14351d51efb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:08.457926 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48a3a2-c4c1-450c-b313-14351d51efb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:08.458378 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48a3a2-c4c1-450c-b313-14351d51efb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:08.458868 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48a3a2-c4c1-450c-b313-14351d51efb1 admin admin] PATH_INFO: `/v3/users/a14e317d371c4f9f994a568798c00e90` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:08.461247 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb48a3a2-c4c1-450c-b313-14351d51efb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a14e317d371c4f9f994a568798c00e90)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:08.463508 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb48a3a2-c4c1-450c-b313-14351d51efb1 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:08.701609 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-bb48a3a2-c4c1-450c-b313-14351d51efb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a14e317d371c4f9f994a568798c00e90'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:08.724475 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-bb48a3a2-c4c1-450c-b313-14351d51efb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a14e317d371c4f9f994a568798c00e90'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:08.765674 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-bb48a3a2-c4c1-450c-b313-14351d51efb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a14e317d371c4f9f994a568798c00e90'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:08.881302 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-bb48a3a2-c4c1-450c-b313-14351d51efb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a14e317d371c4f9f994a568798c00e90'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:08.881302 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-bb48a3a2-c4c1-450c-b313-14351d51efb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a14e317d371c4f9f994a568798c00e90'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:09.034819 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1214/2403] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:25:08 2022] DELETE /identity/v3/users/a14e317d371c4f9f994a568798c00e90 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:25:09.333198 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae4ce81-17d0-445a-b3fc-85e29ce6318f service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:09.346884 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae4ce81-17d0-445a-b3fc-85e29ce6318f service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:09.433349 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6111344b-e173-4ba6-813f-802b3e6eb9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:09.434224 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111344b-e173-4ba6-813f-802b3e6eb9f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:09.434514 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111344b-e173-4ba6-813f-802b3e6eb9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:09.434791 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111344b-e173-4ba6-813f-802b3e6eb9f8 admin admin] PATH_INFO: `/v3/projects/813036cfbb6e4f1b93bbf75a982aa96f` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:09.436016 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6111344b-e173-4ba6-813f-802b3e6eb9f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=813036cfbb6e4f1b93bbf75a982aa96f)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:09.438065 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6111344b-e173-4ba6-813f-802b3e6eb9f8 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:09.501009 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48a3a2-c4c1-450c-b313-14351d51efb1 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:09.502624 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-bb48a3a2-c4c1-450c-b313-14351d51efb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:09.517172 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48a3a2-c4c1-450c-b313-14351d51efb1 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:09.522504 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f8a1a-3690-45b6-90a6-0820bc283337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:09.523379 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f8a1a-3690-45b6-90a6-0820bc283337 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:09.523822 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f8a1a-3690-45b6-90a6-0820bc283337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:09.524131 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f8a1a-3690-45b6-90a6-0820bc283337 admin admin] PATH_INFO: `/v3/users/3c1407a5b0ef4451bcaa4b48f4ae5978` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:09.525321 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129f8a1a-3690-45b6-90a6-0820bc283337 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c1407a5b0ef4451bcaa4b48f4ae5978)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:09.527215 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129f8a1a-3690-45b6-90a6-0820bc283337 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:09.640136 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-6111344b-e173-4ba6-813f-802b3e6eb9f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '813036cfbb6e4f1b93bbf75a982aa96f', 'request_id': 'req-6111344b-e173-4ba6-813f-802b3e6eb9f8'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:09.646402 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-6111344b-e173-4ba6-813f-802b3e6eb9f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '813036cfbb6e4f1b93bbf75a982aa96f', 'request_id': 'req-6111344b-e173-4ba6-813f-802b3e6eb9f8'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:09.653465 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-6111344b-e173-4ba6-813f-802b3e6eb9f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '813036cfbb6e4f1b93bbf75a982aa96f', 'request_id': 'req-6111344b-e173-4ba6-813f-802b3e6eb9f8'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:09.735851 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-129f8a1a-3690-45b6-90a6-0820bc283337 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c1407a5b0ef4451bcaa4b48f4ae5978'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:09.745496 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-129f8a1a-3690-45b6-90a6-0820bc283337 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c1407a5b0ef4451bcaa4b48f4ae5978'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:09.746646 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-6111344b-e173-4ba6-813f-802b3e6eb9f8 admin admin] The token cache is being invalidate because project 813036cfbb6e4f1b93bbf75a982aa96f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:25:09.747235 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-6111344b-e173-4ba6-813f-802b3e6eb9f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:09.751825 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-6111344b-e173-4ba6-813f-802b3e6eb9f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:09.754878 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1190/2404] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:25:09 2022] DELETE /identity/v3/projects/813036cfbb6e4f1b93bbf75a982aa96f => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:25:09.762854 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb024797-6f66-4598-906d-11bfc1a0902c None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:09.763974 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb024797-6f66-4598-906d-11bfc1a0902c None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:09.764565 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb024797-6f66-4598-906d-11bfc1a0902c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:09.767466 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-129f8a1a-3690-45b6-90a6-0820bc283337 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c1407a5b0ef4451bcaa4b48f4ae5978'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:09.768497 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-129f8a1a-3690-45b6-90a6-0820bc283337 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c1407a5b0ef4451bcaa4b48f4ae5978'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:09.769282 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-129f8a1a-3690-45b6-90a6-0820bc283337 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c1407a5b0ef4451bcaa4b48f4ae5978'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:09.793518 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-fb024797-6f66-4598-906d-11bfc1a0902c None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:25:09.793981 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-fb024797-6f66-4598-906d-11bfc1a0902c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:09.834788 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1215/2405] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:25:09 2022] DELETE /identity/v3/users/3c1407a5b0ef4451bcaa4b48f4ae5978 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:25:09.839715 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14564888-69df-418e-867b-dd05b76c5c93 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:09.846632 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14564888-69df-418e-867b-dd05b76c5c93 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:09.846632 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14564888-69df-418e-867b-dd05b76c5c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:09.864178 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-14564888-69df-418e-867b-dd05b76c5c93 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:25:09.866108 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-14564888-69df-418e-867b-dd05b76c5c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:09.872161 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1191/2406] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:25:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:25:09.873973 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598dd7fa-f7c4-45e7-b2d3-71c63c11a35b None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:09.874262 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598dd7fa-f7c4-45e7-b2d3-71c63c11a35b None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:09.874537 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598dd7fa-f7c4-45e7-b2d3-71c63c11a35b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:09.897521 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-598dd7fa-f7c4-45e7-b2d3-71c63c11a35b None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:25:09.898828 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-598dd7fa-f7c4-45e7-b2d3-71c63c11a35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:09.941276 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1216/2407] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:25:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:25:09.950961 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14564888-69df-418e-867b-dd05b76c5c93 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:09.952602 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-14564888-69df-418e-867b-dd05b76c5c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:09.980238 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1192/2408] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:25:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:25:09.983672 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598dd7fa-f7c4-45e7-b2d3-71c63c11a35b None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:09.993593 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598dd7fa-f7c4-45e7-b2d3-71c63c11a35b None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:09.998458 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d608788a-686e-447a-812f-9b0c75d2a8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:09.999123 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d608788a-686e-447a-812f-9b0c75d2a8f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:09.999409 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d608788a-686e-447a-812f-9b0c75d2a8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:09.999693 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d608788a-686e-447a-812f-9b0c75d2a8f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:10.000473 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d608788a-686e-447a-812f-9b0c75d2a8f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:25:10.000769 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d608788a-686e-447a-812f-9b0c75d2a8f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:10.002388 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d608788a-686e-447a-812f-9b0c75d2a8f2 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:10.014968 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14564888-69df-418e-867b-dd05b76c5c93 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:10.020594 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1193/2409] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 10 03:25:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:25:10.020777 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25594a7-76f1-47c2-9317-3fb84d64f4a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:10.020777 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25594a7-76f1-47c2-9317-3fb84d64f4a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:10.021812 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d608788a-686e-447a-812f-9b0c75d2a8f2 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:10.022354 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25594a7-76f1-47c2-9317-3fb84d64f4a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:10.022697 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25594a7-76f1-47c2-9317-3fb84d64f4a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:10.033369 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d608788a-686e-447a-812f-9b0c75d2a8f2 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:10.038358 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25594a7-76f1-47c2-9317-3fb84d64f4a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:10.041101 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25594a7-76f1-47c2-9317-3fb84d64f4a1 service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:10.041220 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e848aca-eaa8-42c3-861d-cd2faf2f95a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:10.041220 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e848aca-eaa8-42c3-861d-cd2faf2f95a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:10.041460 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e848aca-eaa8-42c3-861d-cd2faf2f95a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:10.041563 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e848aca-eaa8-42c3-861d-cd2faf2f95a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:10.042225 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e848aca-eaa8-42c3-861d-cd2faf2f95a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:10.044268 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e848aca-eaa8-42c3-861d-cd2faf2f95a3 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:10.052329 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1217/2410] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:25:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:25:10.164352 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1194/2411] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:25:10 2022] POST /identity/v3/projects => generated 405 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:25:10.165796 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25594a7-76f1-47c2-9317-3fb84d64f4a1 service neutron] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:10.176149 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25594a7-76f1-47c2-9317-3fb84d64f4a1 service neutron] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:10.234736 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b34885-30de-471a-9a5d-cc0545e296dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:10.235355 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b34885-30de-471a-9a5d-cc0545e296dc admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:10.235640 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b34885-30de-471a-9a5d-cc0545e296dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:10.235921 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b34885-30de-471a-9a5d-cc0545e296dc admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:10.236763 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b34885-30de-471a-9a5d-cc0545e296dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:10.240998 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b34885-30de-471a-9a5d-cc0545e296dc admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:10.331444 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1218/2412] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:25:10 2022] POST /identity/v3/users => generated 303 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:25:10.335931 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e848aca-eaa8-42c3-861d-cd2faf2f95a3 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:10.347422 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e848aca-eaa8-42c3-861d-cd2faf2f95a3 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:10.353357 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431dfc03-44f2-4732-80d2-d4413c68da18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:10.354707 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431dfc03-44f2-4732-80d2-d4413c68da18 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:10.355124 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431dfc03-44f2-4732-80d2-d4413c68da18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:10.355843 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431dfc03-44f2-4732-80d2-d4413c68da18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:10.357055 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431dfc03-44f2-4732-80d2-d4413c68da18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:10.363749 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431dfc03-44f2-4732-80d2-d4413c68da18 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:10.368956 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b34885-30de-471a-9a5d-cc0545e296dc admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:10.370564 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1195/2413] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:25:10.373533 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-18b34885-30de-471a-9a5d-cc0545e296dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:10.374640 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431dfc03-44f2-4732-80d2-d4413c68da18 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:10.390218 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431dfc03-44f2-4732-80d2-d4413c68da18 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:10.396954 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b34885-30de-471a-9a5d-cc0545e296dc admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:10.400294 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa822b77-f154-4d80-909e-603375d29129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:10.401362 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa822b77-f154-4d80-909e-603375d29129 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:10.401893 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa822b77-f154-4d80-909e-603375d29129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:10.404541 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa822b77-f154-4d80-909e-603375d29129 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:10.405168 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa822b77-f154-4d80-909e-603375d29129 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:10.405760 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259dba86-9f7d-49bb-b56e-6f827d4eb9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:10.406795 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa822b77-f154-4d80-909e-603375d29129 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:10.407085 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259dba86-9f7d-49bb-b56e-6f827d4eb9b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:10.407471 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259dba86-9f7d-49bb-b56e-6f827d4eb9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:10.408279 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259dba86-9f7d-49bb-b56e-6f827d4eb9b5 admin admin] PATH_INFO: `/v3/users/9407e88fdbd74ba196ffd9fd221e15f5` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:10.410218 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259dba86-9f7d-49bb-b56e-6f827d4eb9b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9407e88fdbd74ba196ffd9fd221e15f5)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:10.413078 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259dba86-9f7d-49bb-b56e-6f827d4eb9b5 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:10.424226 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1196/2414] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:25:10.432454 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa822b77-f154-4d80-909e-603375d29129 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:10.447984 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa822b77-f154-4d80-909e-603375d29129 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:10.453555 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425d78af-6fec-42db-a9fc-eefe95d0df91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:10.456291 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d78af-6fec-42db-a9fc-eefe95d0df91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:10.456782 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d78af-6fec-42db-a9fc-eefe95d0df91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:10.457277 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d78af-6fec-42db-a9fc-eefe95d0df91 admin admin] PATH_INFO: `/v3/projects/45772be5dd66480a9d03cdff71e96bc3/users/0b12a08a6eee48c2818b3738cb14fb55/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:10.473249 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425d78af-6fec-42db-a9fc-eefe95d0df91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45772be5dd66480a9d03cdff71e96bc3, user_id=0b12a08a6eee48c2818b3738cb14fb55, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:10.475895 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425d78af-6fec-42db-a9fc-eefe95d0df91 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:10.593485 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1197/2415] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:25:10 2022] PUT /identity/v3/projects/45772be5dd66480a9d03cdff71e96bc3/users/0b12a08a6eee48c2818b3738cb14fb55/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:25:10.595993 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425d78af-6fec-42db-a9fc-eefe95d0df91 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:10.597607 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-425d78af-6fec-42db-a9fc-eefe95d0df91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:10.664196 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425d78af-6fec-42db-a9fc-eefe95d0df91 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:10.668274 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-259dba86-9f7d-49bb-b56e-6f827d4eb9b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9407e88fdbd74ba196ffd9fd221e15f5'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:10.669243 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf3240-f182-4e02-a131-a72b00effd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:10.670151 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf3240-f182-4e02-a131-a72b00effd08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:10.670442 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf3240-f182-4e02-a131-a72b00effd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:10.670714 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf3240-f182-4e02-a131-a72b00effd08 admin admin] PATH_INFO: `/v3/projects/6184425f3c9247339b0cff0c57cc7703` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:10.672236 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cf3240-f182-4e02-a131-a72b00effd08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6184425f3c9247339b0cff0c57cc7703)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:10.674865 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cf3240-f182-4e02-a131-a72b00effd08 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:10.675475 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-259dba86-9f7d-49bb-b56e-6f827d4eb9b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9407e88fdbd74ba196ffd9fd221e15f5'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:10.687563 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-259dba86-9f7d-49bb-b56e-6f827d4eb9b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9407e88fdbd74ba196ffd9fd221e15f5'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:10.688302 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-259dba86-9f7d-49bb-b56e-6f827d4eb9b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9407e88fdbd74ba196ffd9fd221e15f5'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:10.688945 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-259dba86-9f7d-49bb-b56e-6f827d4eb9b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9407e88fdbd74ba196ffd9fd221e15f5'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:10.775513 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1219/2416] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:25:10 2022] DELETE /identity/v3/users/9407e88fdbd74ba196ffd9fd221e15f5 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:25:10.776866 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ebf85-1476-44eb-9994-a0a808177778 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:10.777156 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ebf85-1476-44eb-9994-a0a808177778 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:10.777431 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ebf85-1476-44eb-9994-a0a808177778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:10.804972 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-039ebf85-1476-44eb-9994-a0a808177778 None None] MFA Rules not processed for user `0b12a08a6eee48c2818b3738cb14fb55`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:25:10.808608 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-039ebf85-1476-44eb-9994-a0a808177778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:10.821094 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e2cf3240-f182-4e02-a131-a72b00effd08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6184425f3c9247339b0cff0c57cc7703', 'request_id': 'req-e2cf3240-f182-4e02-a131-a72b00effd08'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:10.830341 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e2cf3240-f182-4e02-a131-a72b00effd08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6184425f3c9247339b0cff0c57cc7703', 'request_id': 'req-e2cf3240-f182-4e02-a131-a72b00effd08'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:10.837545 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e2cf3240-f182-4e02-a131-a72b00effd08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6184425f3c9247339b0cff0c57cc7703', 'request_id': 'req-e2cf3240-f182-4e02-a131-a72b00effd08'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:10.876440 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1220/2417] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:25:10 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:25:10.885874 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ebf85-1476-44eb-9994-a0a808177778 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:10.887241 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-039ebf85-1476-44eb-9994-a0a808177778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:10.903219 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e2cf3240-f182-4e02-a131-a72b00effd08 admin admin] The token cache is being invalidate because project 6184425f3c9247339b0cff0c57cc7703 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:25:10.903219 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e2cf3240-f182-4e02-a131-a72b00effd08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:10.903219 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e2cf3240-f182-4e02-a131-a72b00effd08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:10.903529 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1198/2418] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:25:10 2022] DELETE /identity/v3/projects/6184425f3c9247339b0cff0c57cc7703 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:25:10.907499 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf3240-f182-4e02-a131-a72b00effd08 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:10.909547 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-e2cf3240-f182-4e02-a131-a72b00effd08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:10.960826 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ebf85-1476-44eb-9994-a0a808177778 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:10.965723 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47b91bd-8e71-422a-9913-685127ede7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:10.966457 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b91bd-8e71-422a-9913-685127ede7b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:10.966659 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b91bd-8e71-422a-9913-685127ede7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:10.966933 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b91bd-8e71-422a-9913-685127ede7b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:10.967644 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47b91bd-8e71-422a-9913-685127ede7b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:10.969632 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47b91bd-8e71-422a-9913-685127ede7b3 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:10.989755 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf3240-f182-4e02-a131-a72b00effd08 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:10.994979 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0405cb-412b-4ed7-a894-a42782ac4906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:10.995750 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0405cb-412b-4ed7-a894-a42782ac4906 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:10.996047 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0405cb-412b-4ed7-a894-a42782ac4906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:10.996400 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0405cb-412b-4ed7-a894-a42782ac4906 admin admin] PATH_INFO: `/v3/users/0362a92fa1f84c108d6721c2379837d3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:10.997688 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0405cb-412b-4ed7-a894-a42782ac4906 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0362a92fa1f84c108d6721c2379837d3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:10.999879 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0405cb-412b-4ed7-a894-a42782ac4906 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:11.058817 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1221/2419] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:25:10 2022] POST /identity/v3/projects => generated 405 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:25:11.058817 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47b91bd-8e71-422a-9913-685127ede7b3 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:11.058817 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-b47b91bd-8e71-422a-9913-685127ede7b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:11.131311 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47b91bd-8e71-422a-9913-685127ede7b3 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:11.136031 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a86c0b7-1d19-4802-8690-2d72230ae1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:11.136990 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86c0b7-1d19-4802-8690-2d72230ae1e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:11.137277 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86c0b7-1d19-4802-8690-2d72230ae1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:11.137554 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86c0b7-1d19-4802-8690-2d72230ae1e9 admin admin] PATH_INFO: `/v3/projects/0b7c607953b94c02977d60c0b0536e24` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:11.138783 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a86c0b7-1d19-4802-8690-2d72230ae1e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b7c607953b94c02977d60c0b0536e24)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:11.140754 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a86c0b7-1d19-4802-8690-2d72230ae1e9 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:11.160053 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-4f0405cb-412b-4ed7-a894-a42782ac4906 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0362a92fa1f84c108d6721c2379837d3'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:11.161432 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-4f0405cb-412b-4ed7-a894-a42782ac4906 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0362a92fa1f84c108d6721c2379837d3'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:11.168239 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-4f0405cb-412b-4ed7-a894-a42782ac4906 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0362a92fa1f84c108d6721c2379837d3'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:11.244438 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-0a86c0b7-1d19-4802-8690-2d72230ae1e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b7c607953b94c02977d60c0b0536e24', 'request_id': 'req-0a86c0b7-1d19-4802-8690-2d72230ae1e9'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:11.249038 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-4f0405cb-412b-4ed7-a894-a42782ac4906 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0362a92fa1f84c108d6721c2379837d3'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:11.249666 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-0a86c0b7-1d19-4802-8690-2d72230ae1e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b7c607953b94c02977d60c0b0536e24', 'request_id': 'req-0a86c0b7-1d19-4802-8690-2d72230ae1e9'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:11.249807 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-4f0405cb-412b-4ed7-a894-a42782ac4906 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0362a92fa1f84c108d6721c2379837d3'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:11.255691 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-0a86c0b7-1d19-4802-8690-2d72230ae1e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b7c607953b94c02977d60c0b0536e24', 'request_id': 'req-0a86c0b7-1d19-4802-8690-2d72230ae1e9'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:11.267105 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1199/2420] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:25:10 2022] DELETE /identity/v3/users/0362a92fa1f84c108d6721c2379837d3 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:25:11.267891 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0405cb-412b-4ed7-a894-a42782ac4906 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:11.269249 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-4f0405cb-412b-4ed7-a894-a42782ac4906 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:11.333331 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0405cb-412b-4ed7-a894-a42782ac4906 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:11.338427 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e18873-1007-4a1b-9d31-1e476a2457ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:11.339229 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e18873-1007-4a1b-9d31-1e476a2457ec admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:11.339610 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e18873-1007-4a1b-9d31-1e476a2457ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:11.339960 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e18873-1007-4a1b-9d31-1e476a2457ec admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:11.340749 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e18873-1007-4a1b-9d31-1e476a2457ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:11.342766 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e18873-1007-4a1b-9d31-1e476a2457ec admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:11.348503 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-0a86c0b7-1d19-4802-8690-2d72230ae1e9 admin admin] The token cache is being invalidate because project 0b7c607953b94c02977d60c0b0536e24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:25:11.351891 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-0a86c0b7-1d19-4802-8690-2d72230ae1e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:11.351891 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-0a86c0b7-1d19-4802-8690-2d72230ae1e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:11.351891 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1222/2421] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:25:11 2022] DELETE /identity/v3/projects/0b7c607953b94c02977d60c0b0536e24 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:25:11.356581 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5546f4-0357-44d4-a159-b8c743b8a08e None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:11.356949 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5546f4-0357-44d4-a159-b8c743b8a08e None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:11.357297 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5546f4-0357-44d4-a159-b8c743b8a08e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:11.375269 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-9f5546f4-0357-44d4-a159-b8c743b8a08e None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:25:11.379589 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-9f5546f4-0357-44d4-a159-b8c743b8a08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:11.385284 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1223/2422] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:25:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:25:11.393324 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec08f4-a0f2-471e-9494-47827627de15 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:11.393606 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec08f4-a0f2-471e-9494-47827627de15 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:11.393884 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec08f4-a0f2-471e-9494-47827627de15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:11.412382 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-5cec08f4-a0f2-471e-9494-47827627de15 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:25:11.413596 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-5cec08f4-a0f2-471e-9494-47827627de15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:11.421341 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1224/2423] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:25:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:25:11.425427 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec08f4-a0f2-471e-9494-47827627de15 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:11.432927 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1200/2424] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:25:11 2022] POST /identity/v3/users => generated 309 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:25:11.434154 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec08f4-a0f2-471e-9494-47827627de15 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:11.436727 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e18873-1007-4a1b-9d31-1e476a2457ec admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:11.438530 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-72e18873-1007-4a1b-9d31-1e476a2457ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:11.438976 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f12e89-f806-47a8-8136-aa6001382bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:11.439654 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f12e89-f806-47a8-8136-aa6001382bf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:11.439934 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f12e89-f806-47a8-8136-aa6001382bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:11.440246 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f12e89-f806-47a8-8136-aa6001382bf4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:11.440970 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f12e89-f806-47a8-8136-aa6001382bf4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:25:11.441271 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f12e89-f806-47a8-8136-aa6001382bf4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:11.442873 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f12e89-f806-47a8-8136-aa6001382bf4 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:11.454582 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1225/2425] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 10 03:25:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:25:11.459282 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f12e89-f806-47a8-8136-aa6001382bf4 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:11.459820 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e18873-1007-4a1b-9d31-1e476a2457ec admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:11.464718 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be3b6f7-b0b9-48fc-b2db-3c05ac10b661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:11.465542 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3b6f7-b0b9-48fc-b2db-3c05ac10b661 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:11.465886 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3b6f7-b0b9-48fc-b2db-3c05ac10b661 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:11.466171 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3b6f7-b0b9-48fc-b2db-3c05ac10b661 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:11.466952 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be3b6f7-b0b9-48fc-b2db-3c05ac10b661 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:11.468634 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be3b6f7-b0b9-48fc-b2db-3c05ac10b661 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:11.471723 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f12e89-f806-47a8-8136-aa6001382bf4 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:11.475434 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694e7b73-3462-400f-9bfb-c077566842aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:11.476097 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e7b73-3462-400f-9bfb-c077566842aa admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:11.476454 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e7b73-3462-400f-9bfb-c077566842aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:11.476895 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e7b73-3462-400f-9bfb-c077566842aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:11.477582 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694e7b73-3462-400f-9bfb-c077566842aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:11.479453 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1201/2426] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:25:11 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:25:11.479578 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694e7b73-3462-400f-9bfb-c077566842aa admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:11.483346 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be3b6f7-b0b9-48fc-b2db-3c05ac10b661 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:11.492827 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be3b6f7-b0b9-48fc-b2db-3c05ac10b661 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:11.497884 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f8570-59d4-40b1-ab2e-af2e070f9e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:11.498714 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f8570-59d4-40b1-ab2e-af2e070f9e27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:11.498992 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f8570-59d4-40b1-ab2e-af2e070f9e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:11.499267 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f8570-59d4-40b1-ab2e-af2e070f9e27 admin admin] PATH_INFO: `/v3/projects/365644d596d6466d9efa8577aa1c2df5/users/ab54c642e9c34bc9bb48bcad5e2ef408/roles/43105000610f402ca2486e7648018cca` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:11.513775 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028f8570-59d4-40b1-ab2e-af2e070f9e27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=365644d596d6466d9efa8577aa1c2df5, user_id=ab54c642e9c34bc9bb48bcad5e2ef408, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:11.516486 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028f8570-59d4-40b1-ab2e-af2e070f9e27 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:11.598685 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1226/2427] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:25:11 2022] POST /identity/v3/projects => generated 371 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:25:11.602318 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694e7b73-3462-400f-9bfb-c077566842aa admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:11.623885 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1202/2428] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:25:11 2022] PUT /identity/v3/projects/365644d596d6466d9efa8577aa1c2df5/users/ab54c642e9c34bc9bb48bcad5e2ef408/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:25:11.626925 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f8570-59d4-40b1-ab2e-af2e070f9e27 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:11.690676 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694e7b73-3462-400f-9bfb-c077566842aa admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:11.724287 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f8570-59d4-40b1-ab2e-af2e070f9e27 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:11.729154 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e4e0f-9cce-4a64-9022-763af8a603ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:11.729832 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e4e0f-9cce-4a64-9022-763af8a603ba admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:11.730119 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e4e0f-9cce-4a64-9022-763af8a603ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:11.730394 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e4e0f-9cce-4a64-9022-763af8a603ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:11.731751 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5e4e0f-9cce-4a64-9022-763af8a603ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:11.732752 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5e4e0f-9cce-4a64-9022-763af8a603ba admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:11.742744 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1203/2429] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:25:11 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:25:11.747372 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e4e0f-9cce-4a64-9022-763af8a603ba admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:11.756617 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae713a91-2bf1-4821-a9a1-7a9fa07e4562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:11.757193 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e4e0f-9cce-4a64-9022-763af8a603ba admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:11.757327 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae713a91-2bf1-4821-a9a1-7a9fa07e4562 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:11.757487 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae713a91-2bf1-4821-a9a1-7a9fa07e4562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:11.757760 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae713a91-2bf1-4821-a9a1-7a9fa07e4562 admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:11.758443 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae713a91-2bf1-4821-a9a1-7a9fa07e4562 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:11.760380 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae713a91-2bf1-4821-a9a1-7a9fa07e4562 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:11.762386 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a482b346-3caa-4ed8-a755-3b78cc7a9051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:11.763279 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482b346-3caa-4ed8-a755-3b78cc7a9051 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:11.763558 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482b346-3caa-4ed8-a755-3b78cc7a9051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:11.763831 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482b346-3caa-4ed8-a755-3b78cc7a9051 admin admin] PATH_INFO: `/v3/projects/365644d596d6466d9efa8577aa1c2df5/users/ab54c642e9c34bc9bb48bcad5e2ef408/roles/43105000610f402ca2486e7648018cca` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:11.765834 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a482b346-3caa-4ed8-a755-3b78cc7a9051 admin admin] RBAC: Authorizing `identity:create_grant(project_id=365644d596d6466d9efa8577aa1c2df5, user_id=ab54c642e9c34bc9bb48bcad5e2ef408, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:11.772277 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a482b346-3caa-4ed8-a755-3b78cc7a9051 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:11.779326 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1204/2430] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:25:11 2022] PUT /identity/v3/projects/365644d596d6466d9efa8577aa1c2df5/users/ab54c642e9c34bc9bb48bcad5e2ef408/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:25:11.790317 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fbccb4-6f83-4b16-9661-6e18043594b8 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:11.794026 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fbccb4-6f83-4b16-9661-6e18043594b8 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:11.794026 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fbccb4-6f83-4b16-9661-6e18043594b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:11.818678 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-b3fbccb4-6f83-4b16-9661-6e18043594b8 None None] MFA Rules not processed for user `ab54c642e9c34bc9bb48bcad5e2ef408`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:25:11.824986 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-b3fbccb4-6f83-4b16-9661-6e18043594b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:11.853897 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1227/2431] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:25:11 2022] POST /identity/v3/users => generated 286 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:25:11.855023 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae713a91-2bf1-4821-a9a1-7a9fa07e4562 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:11.856746 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-ae713a91-2bf1-4821-a9a1-7a9fa07e4562 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:11.868443 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae713a91-2bf1-4821-a9a1-7a9fa07e4562 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:11.891646 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1205/2432] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:25:11 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:25:11.896844 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fbccb4-6f83-4b16-9661-6e18043594b8 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:11.923796 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3571f8c-0a1a-429e-8b39-199c7c489b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:11.924685 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3571f8c-0a1a-429e-8b39-199c7c489b2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:11.924966 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3571f8c-0a1a-429e-8b39-199c7c489b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:11.925243 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3571f8c-0a1a-429e-8b39-199c7c489b2d admin admin] PATH_INFO: `/v3/projects/2f6005131f934e2da3d8dbb444d05b41` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:11.926911 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3571f8c-0a1a-429e-8b39-199c7c489b2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f6005131f934e2da3d8dbb444d05b41)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:11.928866 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3571f8c-0a1a-429e-8b39-199c7c489b2d admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:11.958644 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fbccb4-6f83-4b16-9661-6e18043594b8 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:11.963517 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac1bdc-f86e-4c43-a38b-8912e6e56a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:11.964217 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac1bdc-f86e-4c43-a38b-8912e6e56a28 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:11.967948 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac1bdc-f86e-4c43-a38b-8912e6e56a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:11.967948 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac1bdc-f86e-4c43-a38b-8912e6e56a28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:11.967948 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ac1bdc-f86e-4c43-a38b-8912e6e56a28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:11.967948 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ac1bdc-f86e-4c43-a38b-8912e6e56a28 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:11.976796 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1206/2433] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:25:11 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:25:11.977578 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac1bdc-f86e-4c43-a38b-8912e6e56a28 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:11.979234 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-11ac1bdc-f86e-4c43-a38b-8912e6e56a28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:12.031806 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-f3571f8c-0a1a-429e-8b39-199c7c489b2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f6005131f934e2da3d8dbb444d05b41', 'request_id': 'req-f3571f8c-0a1a-429e-8b39-199c7c489b2d'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:12.033804 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac1bdc-f86e-4c43-a38b-8912e6e56a28 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:12.037058 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-f3571f8c-0a1a-429e-8b39-199c7c489b2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f6005131f934e2da3d8dbb444d05b41', 'request_id': 'req-f3571f8c-0a1a-429e-8b39-199c7c489b2d'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:12.043120 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-f3571f8c-0a1a-429e-8b39-199c7c489b2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f6005131f934e2da3d8dbb444d05b41', 'request_id': 'req-f3571f8c-0a1a-429e-8b39-199c7c489b2d'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:12.081079 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4950a5-66b4-438b-8388-e60eb23e10bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:12.081732 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4950a5-66b4-438b-8388-e60eb23e10bf service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:12.082076 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4950a5-66b4-438b-8388-e60eb23e10bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:12.082360 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4950a5-66b4-438b-8388-e60eb23e10bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:12.094345 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-f3571f8c-0a1a-429e-8b39-199c7c489b2d admin admin] The token cache is being invalidate because project 2f6005131f934e2da3d8dbb444d05b41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:25:12.097870 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-f3571f8c-0a1a-429e-8b39-199c7c489b2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:12.097870 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-f3571f8c-0a1a-429e-8b39-199c7c489b2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:12.097870 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1228/2434] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:25:11 2022] DELETE /identity/v3/projects/2f6005131f934e2da3d8dbb444d05b41 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:25:12.097870 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3571f8c-0a1a-429e-8b39-199c7c489b2d admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:12.101406 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-f3571f8c-0a1a-429e-8b39-199c7c489b2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:12.146782 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4950a5-66b4-438b-8388-e60eb23e10bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:12.148267 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4950a5-66b4-438b-8388-e60eb23e10bf service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:12.157825 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1207/2435] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:25:11 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:25:12.159078 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826d4e1-3148-45fc-b738-68371e60da20 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:12.159366 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826d4e1-3148-45fc-b738-68371e60da20 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:12.159642 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826d4e1-3148-45fc-b738-68371e60da20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:12.167714 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3571f8c-0a1a-429e-8b39-199c7c489b2d admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:12.175473 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b46ac2f-7f15-4bbe-9477-66ddb765e5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:12.176986 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46ac2f-7f15-4bbe-9477-66ddb765e5c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:12.177373 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46ac2f-7f15-4bbe-9477-66ddb765e5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:12.177658 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-1826d4e1-3148-45fc-b738-68371e60da20 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:25:12.177833 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46ac2f-7f15-4bbe-9477-66ddb765e5c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:12.178663 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b46ac2f-7f15-4bbe-9477-66ddb765e5c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:12.178875 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-1826d4e1-3148-45fc-b738-68371e60da20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:12.183091 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b46ac2f-7f15-4bbe-9477-66ddb765e5c6 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:12.190479 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1208/2436] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:25:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:25:12.198142 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1229/2437] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:25:12 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:25:12.199078 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b46ac2f-7f15-4bbe-9477-66ddb765e5c6 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:12.199297 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96cc87-fd27-4e02-9295-f661ccd728f8 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:12.199589 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96cc87-fd27-4e02-9295-f661ccd728f8 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:12.199928 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96cc87-fd27-4e02-9295-f661ccd728f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:12.209262 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b46ac2f-7f15-4bbe-9477-66ddb765e5c6 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:12.214496 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86951d8-60c1-489a-9b9d-49b6870b55fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:12.215571 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86951d8-60c1-489a-9b9d-49b6870b55fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:12.215957 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86951d8-60c1-489a-9b9d-49b6870b55fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:12.216396 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86951d8-60c1-489a-9b9d-49b6870b55fa admin admin] PATH_INFO: `/v3/projects/bd721ccc0d1849f98ff8a5e0bcfa6df1/users/e95373add6a64bc6aa2225f3b7956fc6/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:12.223413 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-ae96cc87-fd27-4e02-9295-f661ccd728f8 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:25:12.224718 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-ae96cc87-fd27-4e02-9295-f661ccd728f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:12.233612 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1209/2438] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:25:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:25:12.237302 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae96cc87-fd27-4e02-9295-f661ccd728f8 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:12.241975 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86951d8-60c1-489a-9b9d-49b6870b55fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd721ccc0d1849f98ff8a5e0bcfa6df1, user_id=e95373add6a64bc6aa2225f3b7956fc6, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:12.244836 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86951d8-60c1-489a-9b9d-49b6870b55fa admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:12.248022 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae96cc87-fd27-4e02-9295-f661ccd728f8 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:12.258147 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9884a3a-9e81-473c-8cc1-39b8d0dec118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:12.258147 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9884a3a-9e81-473c-8cc1-39b8d0dec118 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:12.258147 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9884a3a-9e81-473c-8cc1-39b8d0dec118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:12.258147 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9884a3a-9e81-473c-8cc1-39b8d0dec118 admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:12.258476 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9884a3a-9e81-473c-8cc1-39b8d0dec118 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:25:12.258476 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9884a3a-9e81-473c-8cc1-39b8d0dec118 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:12.258838 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9884a3a-9e81-473c-8cc1-39b8d0dec118 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:12.271196 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1210/2439] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 10 03:25:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:25:12.275245 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9884a3a-9e81-473c-8cc1-39b8d0dec118 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:12.284823 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9884a3a-9e81-473c-8cc1-39b8d0dec118 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:12.289477 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2795d875-40e9-4fbd-91a8-09e1bd9cb1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:12.290121 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2795d875-40e9-4fbd-91a8-09e1bd9cb1bd admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:12.290401 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2795d875-40e9-4fbd-91a8-09e1bd9cb1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:12.290743 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2795d875-40e9-4fbd-91a8-09e1bd9cb1bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:12.291424 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2795d875-40e9-4fbd-91a8-09e1bd9cb1bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:12.293361 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2795d875-40e9-4fbd-91a8-09e1bd9cb1bd admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:12.381846 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1230/2440] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:25:12 2022] PUT /identity/v3/projects/bd721ccc0d1849f98ff8a5e0bcfa6df1/users/e95373add6a64bc6aa2225f3b7956fc6/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:25:12.382683 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86951d8-60c1-489a-9b9d-49b6870b55fa admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:12.384389 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-d86951d8-60c1-489a-9b9d-49b6870b55fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:12.405721 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1211/2441] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:25:12 2022] POST /identity/v3/projects => generated 373 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:25:12.407679 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8adf0-cc4b-422d-b1be-d7dd5171a5f7 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:12.407962 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8adf0-cc4b-422d-b1be-d7dd5171a5f7 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:12.408265 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8adf0-cc4b-422d-b1be-d7dd5171a5f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:12.434966 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-bbd8adf0-cc4b-422d-b1be-d7dd5171a5f7 None None] MFA Rules not processed for user `e95373add6a64bc6aa2225f3b7956fc6`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:25:12.436198 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-bbd8adf0-cc4b-422d-b1be-d7dd5171a5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:12.463371 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86951d8-60c1-489a-9b9d-49b6870b55fa admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:12.500883 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1212/2442] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:25:12 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:25:12.501705 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd8adf0-cc4b-422d-b1be-d7dd5171a5f7 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:12.519052 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d58ee-22e7-44df-b1f0-5d392e29e5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:12.520925 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d58ee-22e7-44df-b1f0-5d392e29e5f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:12.521358 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d58ee-22e7-44df-b1f0-5d392e29e5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:12.521643 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d58ee-22e7-44df-b1f0-5d392e29e5f4 admin admin] PATH_INFO: `/v3/users/0b12a08a6eee48c2818b3738cb14fb55` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:12.522858 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d58ee-22e7-44df-b1f0-5d392e29e5f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b12a08a6eee48c2818b3738cb14fb55)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:12.524848 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d58ee-22e7-44df-b1f0-5d392e29e5f4 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:12.568038 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd8adf0-cc4b-422d-b1be-d7dd5171a5f7 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:12.572651 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b07cbda-4968-4074-b825-5441c7010902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:12.573439 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07cbda-4968-4074-b825-5441c7010902 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:12.573736 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07cbda-4968-4074-b825-5441c7010902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:12.574019 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07cbda-4968-4074-b825-5441c7010902 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:12.574706 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b07cbda-4968-4074-b825-5441c7010902 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:12.576670 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b07cbda-4968-4074-b825-5441c7010902 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:12.714078 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1213/2443] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:25:12 2022] POST /identity/v3/users => generated 287 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:25:12.716496 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b07cbda-4968-4074-b825-5441c7010902 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:12.730577 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b07cbda-4968-4074-b825-5441c7010902 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:12.736484 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-e88d58ee-22e7-44df-b1f0-5d392e29e5f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b12a08a6eee48c2818b3738cb14fb55'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:12.736924 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd37414a-4cda-4866-9c84-e7c9b327d2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:12.737413 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37414a-4cda-4866-9c84-e7c9b327d2c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:12.737845 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37414a-4cda-4866-9c84-e7c9b327d2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:12.738231 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37414a-4cda-4866-9c84-e7c9b327d2c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:12.739186 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd37414a-4cda-4866-9c84-e7c9b327d2c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:12.741398 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd37414a-4cda-4866-9c84-e7c9b327d2c7 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:12.744267 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-e88d58ee-22e7-44df-b1f0-5d392e29e5f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b12a08a6eee48c2818b3738cb14fb55'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:12.758598 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-e88d58ee-22e7-44df-b1f0-5d392e29e5f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b12a08a6eee48c2818b3738cb14fb55'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:12.759331 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-e88d58ee-22e7-44df-b1f0-5d392e29e5f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b12a08a6eee48c2818b3738cb14fb55'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:12.760163 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-e88d58ee-22e7-44df-b1f0-5d392e29e5f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b12a08a6eee48c2818b3738cb14fb55'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:12.834304 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1214/2444] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:25:12 2022] POST /identity/v3/projects => generated 373 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:25:12.835332 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd37414a-4cda-4866-9c84-e7c9b327d2c7 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:12.836974 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-fd37414a-4cda-4866-9c84-e7c9b327d2c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:12.875548 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1231/2445] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:25:12 2022] DELETE /identity/v3/users/0b12a08a6eee48c2818b3738cb14fb55 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:25:12.876870 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d58ee-22e7-44df-b1f0-5d392e29e5f4 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:12.878822 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-e88d58ee-22e7-44df-b1f0-5d392e29e5f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:12.903631 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd37414a-4cda-4866-9c84-e7c9b327d2c7 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:12.957962 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d58ee-22e7-44df-b1f0-5d392e29e5f4 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:12.961171 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6590fb-38cc-484a-9ccd-4c498d613aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:12.961854 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6590fb-38cc-484a-9ccd-4c498d613aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:12.962141 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6590fb-38cc-484a-9ccd-4c498d613aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:12.962417 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6590fb-38cc-484a-9ccd-4c498d613aa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:12.962901 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff4b7fb-e972-461f-8c50-b72b5f6f1908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:12.963142 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6590fb-38cc-484a-9ccd-4c498d613aa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:12.963708 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4b7fb-e972-461f-8c50-b72b5f6f1908 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:12.964089 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4b7fb-e972-461f-8c50-b72b5f6f1908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:12.964429 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4b7fb-e972-461f-8c50-b72b5f6f1908 admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:12.964787 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6590fb-38cc-484a-9ccd-4c498d613aa2 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:12.965250 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff4b7fb-e972-461f-8c50-b72b5f6f1908 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:12.967207 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff4b7fb-e972-461f-8c50-b72b5f6f1908 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:12.974486 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1215/2446] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:25:12 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:25:12.975711 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe43ae-5663-43ea-b16a-d03cc603f731 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:12.975996 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe43ae-5663-43ea-b16a-d03cc603f731 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:12.976298 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe43ae-5663-43ea-b16a-d03cc603f731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:12.993058 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-4efe43ae-5663-43ea-b16a-d03cc603f731 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:25:12.994253 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-4efe43ae-5663-43ea-b16a-d03cc603f731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:13.001915 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1216/2447] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:25:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:25:13.002667 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe43ae-5663-43ea-b16a-d03cc603f731 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:13.012538 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe43ae-5663-43ea-b16a-d03cc603f731 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:13.017306 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e3d0c7-edb7-406b-aa98-87a5969a85d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:13.017949 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e3d0c7-edb7-406b-aa98-87a5969a85d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:13.025625 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e3d0c7-edb7-406b-aa98-87a5969a85d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:13.025625 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e3d0c7-edb7-406b-aa98-87a5969a85d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:13.025625 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e3d0c7-edb7-406b-aa98-87a5969a85d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:13.025625 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e3d0c7-edb7-406b-aa98-87a5969a85d6 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:13.031415 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1217/2448] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:25:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:25:13.032227 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e3d0c7-edb7-406b-aa98-87a5969a85d6 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:13.033913 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-d2e3d0c7-edb7-406b-aa98-87a5969a85d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:13.044183 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1232/2449] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:25:12 2022] POST /identity/v3/users => generated 293 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:25:13.045046 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff4b7fb-e972-461f-8c50-b72b5f6f1908 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:13.055480 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff4b7fb-e972-461f-8c50-b72b5f6f1908 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:13.060218 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b26e2ab-831b-4a19-8464-8a4baaa0737f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:13.061085 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26e2ab-831b-4a19-8464-8a4baaa0737f admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:13.061367 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26e2ab-831b-4a19-8464-8a4baaa0737f admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:13.061644 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26e2ab-831b-4a19-8464-8a4baaa0737f admin admin] PATH_INFO: `/v3/projects/08dc4e7cbf524d38827fd40fc2c5e59d/users/8c14a8e67f9f426b89cac58d98a1e684/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:13.076648 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b26e2ab-831b-4a19-8464-8a4baaa0737f admin admin] RBAC: Authorizing `identity:create_grant(project_id=08dc4e7cbf524d38827fd40fc2c5e59d, user_id=8c14a8e67f9f426b89cac58d98a1e684, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:13.079214 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b26e2ab-831b-4a19-8464-8a4baaa0737f admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:13.093076 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e3d0c7-edb7-406b-aa98-87a5969a85d6 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:13.096958 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30066f6c-fb15-4905-8fb2-6512a602ed18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:13.097614 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30066f6c-fb15-4905-8fb2-6512a602ed18 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:13.097927 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30066f6c-fb15-4905-8fb2-6512a602ed18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:13.098204 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30066f6c-fb15-4905-8fb2-6512a602ed18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:13.107470 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30066f6c-fb15-4905-8fb2-6512a602ed18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:13.108937 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30066f6c-fb15-4905-8fb2-6512a602ed18 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:13.119393 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1218/2450] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:25:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:25:13.120092 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30066f6c-fb15-4905-8fb2-6512a602ed18 service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:13.124564 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1233/2451] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:25:13 2022] PUT /identity/v3/projects/08dc4e7cbf524d38827fd40fc2c5e59d/users/8c14a8e67f9f426b89cac58d98a1e684/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:25:13.130887 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30066f6c-fb15-4905-8fb2-6512a602ed18 service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:13.137107 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4112fe5f-d24b-4344-8f58-8dd3828c1063 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:13.137467 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4112fe5f-d24b-4344-8f58-8dd3828c1063 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:13.137785 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4112fe5f-d24b-4344-8f58-8dd3828c1063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:13.165756 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-4112fe5f-d24b-4344-8f58-8dd3828c1063 None None] MFA Rules not processed for user `8c14a8e67f9f426b89cac58d98a1e684`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:25:13.167075 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-4112fe5f-d24b-4344-8f58-8dd3828c1063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:13.190517 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a50fb-93da-4fc5-a01d-fa21bafb9e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:13.191286 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a50fb-93da-4fc5-a01d-fa21bafb9e9a admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:13.191608 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a50fb-93da-4fc5-a01d-fa21bafb9e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:13.191890 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a50fb-93da-4fc5-a01d-fa21bafb9e9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:13.192807 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811a50fb-93da-4fc5-a01d-fa21bafb9e9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:13.194534 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811a50fb-93da-4fc5-a01d-fa21bafb9e9a admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:13.211007 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1219/2452] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:25:13 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:25:13.211934 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a50fb-93da-4fc5-a01d-fa21bafb9e9a admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:13.224626 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a50fb-93da-4fc5-a01d-fa21bafb9e9a admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:13.235849 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f8b4f0-cb71-46d7-8636-2aaa8b63fb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:13.236947 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f8b4f0-cb71-46d7-8636-2aaa8b63fb79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:13.237236 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f8b4f0-cb71-46d7-8636-2aaa8b63fb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:13.242808 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f8b4f0-cb71-46d7-8636-2aaa8b63fb79 admin admin] PATH_INFO: `/v3/projects/14fc128dbfae42a4b62fb6421fc9a9d9/users/0fcedbd0d4ed4bbaa3aaaa3050ab115e/roles/43105000610f402ca2486e7648018cca` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:13.242966 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1234/2453] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:25:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:25:13.257733 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f8b4f0-cb71-46d7-8636-2aaa8b63fb79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14fc128dbfae42a4b62fb6421fc9a9d9, user_id=0fcedbd0d4ed4bbaa3aaaa3050ab115e, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:13.257926 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4112fe5f-d24b-4344-8f58-8dd3828c1063 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:13.259280 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-4112fe5f-d24b-4344-8f58-8dd3828c1063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:13.261009 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f8b4f0-cb71-46d7-8636-2aaa8b63fb79 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:13.315883 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4112fe5f-d24b-4344-8f58-8dd3828c1063 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:13.319591 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aaf9f0-fe91-44d3-89a5-650c15f3258f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c79f0a3a3223444c82589da07305469f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:13.320272 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aaf9f0-fe91-44d3-89a5-650c15f3258f service glance] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:13.320555 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aaf9f0-fe91-44d3-89a5-650c15f3258f service glance] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:13.320834 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aaf9f0-fe91-44d3-89a5-650c15f3258f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:13.329387 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aaf9f0-fe91-44d3-89a5-650c15f3258f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:13.330747 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aaf9f0-fe91-44d3-89a5-650c15f3258f service glance] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:13.340217 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1235/2454] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:25:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:25:13.353724 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1220/2455] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:25:13 2022] PUT /identity/v3/projects/14fc128dbfae42a4b62fb6421fc9a9d9/users/0fcedbd0d4ed4bbaa3aaaa3050ab115e/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:25:13.357617 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aaf9f0-fe91-44d3-89a5-650c15f3258f service glance] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:13.371161 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aaf9f0-fe91-44d3-89a5-650c15f3258f service glance] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:13.439593 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24619f7d-f3e1-41bf-8589-596947941dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:13.440322 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24619f7d-f3e1-41bf-8589-596947941dc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:13.440617 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24619f7d-f3e1-41bf-8589-596947941dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:13.441005 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24619f7d-f3e1-41bf-8589-596947941dc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:13.442273 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24619f7d-f3e1-41bf-8589-596947941dc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:13.443887 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24619f7d-f3e1-41bf-8589-596947941dc5 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:13.462093 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1236/2456] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:25:13 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:25:13.462238 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f8b4f0-cb71-46d7-8636-2aaa8b63fb79 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:13.474029 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f8b4f0-cb71-46d7-8636-2aaa8b63fb79 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:13.479302 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25efcd63-af99-4fec-aee4-9cb57df88792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:13.480378 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25efcd63-af99-4fec-aee4-9cb57df88792 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:13.480933 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25efcd63-af99-4fec-aee4-9cb57df88792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:13.481276 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25efcd63-af99-4fec-aee4-9cb57df88792 admin admin] PATH_INFO: `/v3/projects/14fc128dbfae42a4b62fb6421fc9a9d9/users/0fcedbd0d4ed4bbaa3aaaa3050ab115e/roles/43105000610f402ca2486e7648018cca` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:13.483420 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25efcd63-af99-4fec-aee4-9cb57df88792 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14fc128dbfae42a4b62fb6421fc9a9d9, user_id=0fcedbd0d4ed4bbaa3aaaa3050ab115e, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:13.489856 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25efcd63-af99-4fec-aee4-9cb57df88792 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:13.498364 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1221/2457] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:25:13 2022] PUT /identity/v3/projects/14fc128dbfae42a4b62fb6421fc9a9d9/users/0fcedbd0d4ed4bbaa3aaaa3050ab115e/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:25:13.509123 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7dbe22-08d8-46ce-972a-6720ccaaedde None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:13.509488 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7dbe22-08d8-46ce-972a-6720ccaaedde None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:13.509836 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7dbe22-08d8-46ce-972a-6720ccaaedde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:13.536942 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-3b7dbe22-08d8-46ce-972a-6720ccaaedde None None] MFA Rules not processed for user `0fcedbd0d4ed4bbaa3aaaa3050ab115e`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:25:13.538168 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-3b7dbe22-08d8-46ce-972a-6720ccaaedde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:13.611863 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1237/2458] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:25:13 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:25:13.623599 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25efcd63-af99-4fec-aee4-9cb57df88792 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:13.625488 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-25efcd63-af99-4fec-aee4-9cb57df88792 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:13.682248 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25efcd63-af99-4fec-aee4-9cb57df88792 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:13.685898 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368bc01-0315-4bd0-8731-239897a95c3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:13.686541 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368bc01-0315-4bd0-8731-239897a95c3b service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:13.686823 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368bc01-0315-4bd0-8731-239897a95c3b service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:13.687102 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368bc01-0315-4bd0-8731-239897a95c3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:13.692255 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7dbe22-08d8-46ce-972a-6720ccaaedde None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:13.694096 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-3b7dbe22-08d8-46ce-972a-6720ccaaedde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:13.697984 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8368bc01-0315-4bd0-8731-239897a95c3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:13.699436 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8368bc01-0315-4bd0-8731-239897a95c3b service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:13.711264 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1222/2459] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:25:13 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:25:13.766165 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7dbe22-08d8-46ce-972a-6720ccaaedde None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:13.771623 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dd91a6-5560-47c6-b3a2-da8fecb18d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:13.772514 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd91a6-5560-47c6-b3a2-da8fecb18d5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:13.772802 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd91a6-5560-47c6-b3a2-da8fecb18d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:13.773080 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd91a6-5560-47c6-b3a2-da8fecb18d5c admin admin] PATH_INFO: `/v3/projects/45772be5dd66480a9d03cdff71e96bc3` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:13.774458 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dd91a6-5560-47c6-b3a2-da8fecb18d5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=45772be5dd66480a9d03cdff71e96bc3)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:13.777421 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dd91a6-5560-47c6-b3a2-da8fecb18d5c admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:13.927178 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-13dd91a6-5560-47c6-b3a2-da8fecb18d5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45772be5dd66480a9d03cdff71e96bc3', 'request_id': 'req-13dd91a6-5560-47c6-b3a2-da8fecb18d5c'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:13.932813 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-13dd91a6-5560-47c6-b3a2-da8fecb18d5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45772be5dd66480a9d03cdff71e96bc3', 'request_id': 'req-13dd91a6-5560-47c6-b3a2-da8fecb18d5c'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:13.944709 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-13dd91a6-5560-47c6-b3a2-da8fecb18d5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45772be5dd66480a9d03cdff71e96bc3', 'request_id': 'req-13dd91a6-5560-47c6-b3a2-da8fecb18d5c'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:13.949520 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368bc01-0315-4bd0-8731-239897a95c3b service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:13.960221 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368bc01-0315-4bd0-8731-239897a95c3b service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:14.021968 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41997441-fbf0-4af9-a0cc-da8063bad3ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:14.021968 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41997441-fbf0-4af9-a0cc-da8063bad3ae service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:14.021968 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41997441-fbf0-4af9-a0cc-da8063bad3ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:14.021968 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41997441-fbf0-4af9-a0cc-da8063bad3ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:14.022368 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-41997441-fbf0-4af9-a0cc-da8063bad3ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:14.085065 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41997441-fbf0-4af9-a0cc-da8063bad3ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:14.086512 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41997441-fbf0-4af9-a0cc-da8063bad3ae service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:14.096139 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1223/2460] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:25:13 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:25:14.804885 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-13dd91a6-5560-47c6-b3a2-da8fecb18d5c admin admin] The token cache is being invalidate because project 45772be5dd66480a9d03cdff71e96bc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:25:14.805307 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-13dd91a6-5560-47c6-b3a2-da8fecb18d5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:14.807329 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-13dd91a6-5560-47c6-b3a2-da8fecb18d5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:14.808595 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1238/2461] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:25:13 2022] DELETE /identity/v3/projects/45772be5dd66480a9d03cdff71e96bc3 => generated 0 bytes in 1117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:25:14.812420 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41997441-fbf0-4af9-a0cc-da8063bad3ae service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:14.874762 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41997441-fbf0-4af9-a0cc-da8063bad3ae service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:14.879441 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c252d6a-1ca5-4c0b-88a7-e7e5de53fadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:14.880892 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c252d6a-1ca5-4c0b-88a7-e7e5de53fadf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:14.881193 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c252d6a-1ca5-4c0b-88a7-e7e5de53fadf admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:14.881488 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c252d6a-1ca5-4c0b-88a7-e7e5de53fadf admin admin] PATH_INFO: `/v3/users/ab54c642e9c34bc9bb48bcad5e2ef408` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:14.882717 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c252d6a-1ca5-4c0b-88a7-e7e5de53fadf admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab54c642e9c34bc9bb48bcad5e2ef408)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:14.884691 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c252d6a-1ca5-4c0b-88a7-e7e5de53fadf admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:15.124119 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8c252d6a-1ca5-4c0b-88a7-e7e5de53fadf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab54c642e9c34bc9bb48bcad5e2ef408'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:15.128153 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8c252d6a-1ca5-4c0b-88a7-e7e5de53fadf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab54c642e9c34bc9bb48bcad5e2ef408'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:15.133573 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8c252d6a-1ca5-4c0b-88a7-e7e5de53fadf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab54c642e9c34bc9bb48bcad5e2ef408'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:15.231939 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8c252d6a-1ca5-4c0b-88a7-e7e5de53fadf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab54c642e9c34bc9bb48bcad5e2ef408'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:15.231939 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8c252d6a-1ca5-4c0b-88a7-e7e5de53fadf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab54c642e9c34bc9bb48bcad5e2ef408'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:15.253316 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1224/2462] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:25:14 2022] DELETE /identity/v3/users/ab54c642e9c34bc9bb48bcad5e2ef408 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:25:15.685694 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dd91a6-5560-47c6-b3a2-da8fecb18d5c admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:15.687301 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-13dd91a6-5560-47c6-b3a2-da8fecb18d5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:15.704088 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dd91a6-5560-47c6-b3a2-da8fecb18d5c admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:15.761937 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aca4dc-3ae4-4091-9417-0be78b17edac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:15.762820 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aca4dc-3ae4-4091-9417-0be78b17edac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:15.763104 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aca4dc-3ae4-4091-9417-0be78b17edac admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:15.763380 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aca4dc-3ae4-4091-9417-0be78b17edac admin admin] PATH_INFO: `/v3/projects/365644d596d6466d9efa8577aa1c2df5` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:15.764591 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aca4dc-3ae4-4091-9417-0be78b17edac admin admin] RBAC: Authorizing `identity:delete_project(project_id=365644d596d6466d9efa8577aa1c2df5)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:15.766486 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aca4dc-3ae4-4091-9417-0be78b17edac admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:15.850329 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-44aca4dc-3ae4-4091-9417-0be78b17edac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '365644d596d6466d9efa8577aa1c2df5', 'request_id': 'req-44aca4dc-3ae4-4091-9417-0be78b17edac'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:15.855811 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-44aca4dc-3ae4-4091-9417-0be78b17edac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '365644d596d6466d9efa8577aa1c2df5', 'request_id': 'req-44aca4dc-3ae4-4091-9417-0be78b17edac'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:15.862401 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-44aca4dc-3ae4-4091-9417-0be78b17edac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '365644d596d6466d9efa8577aa1c2df5', 'request_id': 'req-44aca4dc-3ae4-4091-9417-0be78b17edac'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:15.918416 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-44aca4dc-3ae4-4091-9417-0be78b17edac admin admin] The token cache is being invalidate because project 365644d596d6466d9efa8577aa1c2df5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:25:15.918709 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-44aca4dc-3ae4-4091-9417-0be78b17edac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:15.919359 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-44aca4dc-3ae4-4091-9417-0be78b17edac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:15.920942 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1239/2463] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:25:15 2022] DELETE /identity/v3/projects/365644d596d6466d9efa8577aa1c2df5 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:25:15.927317 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea9761-0883-4c90-86b6-ce543e663789 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:15.927771 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea9761-0883-4c90-86b6-ce543e663789 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:15.931079 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea9761-0883-4c90-86b6-ce543e663789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:15.948508 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-7aea9761-0883-4c90-86b6-ce543e663789 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:25:15.952961 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-7aea9761-0883-4c90-86b6-ce543e663789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:16.010531 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1225/2464] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:25:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:25:16.018211 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52048a5d-da88-4710-ba92-134f37f15ad5 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:16.018502 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52048a5d-da88-4710-ba92-134f37f15ad5 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:16.018787 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52048a5d-da88-4710-ba92-134f37f15ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:16.037403 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-52048a5d-da88-4710-ba92-134f37f15ad5 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:25:16.038796 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-52048a5d-da88-4710-ba92-134f37f15ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:16.047412 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1240/2465] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:25:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:25:16.052270 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aea9761-0883-4c90-86b6-ce543e663789 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:16.062155 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aea9761-0883-4c90-86b6-ce543e663789 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:16.068080 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1bb0a5-ed5e-4aa0-9c6e-3441528de2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:16.068690 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1bb0a5-ed5e-4aa0-9c6e-3441528de2e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:16.068973 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1bb0a5-ed5e-4aa0-9c6e-3441528de2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:16.069247 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1bb0a5-ed5e-4aa0-9c6e-3441528de2e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:16.069973 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1bb0a5-ed5e-4aa0-9c6e-3441528de2e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:25:16.070280 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1bb0a5-ed5e-4aa0-9c6e-3441528de2e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:16.071874 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1bb0a5-ed5e-4aa0-9c6e-3441528de2e6 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:16.083616 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1226/2466] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 10 03:25:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:25:16.087791 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52048a5d-da88-4710-ba92-134f37f15ad5 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:16.097712 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52048a5d-da88-4710-ba92-134f37f15ad5 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:16.103056 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4ca59-edbd-4409-9c46-7d9167078f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:16.103658 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4ca59-edbd-4409-9c46-7d9167078f59 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:16.103944 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4ca59-edbd-4409-9c46-7d9167078f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:16.104252 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4ca59-edbd-4409-9c46-7d9167078f59 admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:16.104953 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff4ca59-edbd-4409-9c46-7d9167078f59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:16.106857 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff4ca59-edbd-4409-9c46-7d9167078f59 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:16.239864 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1241/2467] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:25:16 2022] POST /identity/v3/projects => generated 365 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:25:16.243964 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1bb0a5-ed5e-4aa0-9c6e-3441528de2e6 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:16.253772 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1bb0a5-ed5e-4aa0-9c6e-3441528de2e6 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:16.315484 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f622969-d697-4cd5-9493-846502404144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:16.316215 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f622969-d697-4cd5-9493-846502404144 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:16.316499 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f622969-d697-4cd5-9493-846502404144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:16.316774 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f622969-d697-4cd5-9493-846502404144 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:16.317467 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f622969-d697-4cd5-9493-846502404144 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:16.321743 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f622969-d697-4cd5-9493-846502404144 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:16.416301 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1227/2468] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:25:16 2022] POST /identity/v3/users => generated 283 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:25:16.420845 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4ca59-edbd-4409-9c46-7d9167078f59 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:16.436285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4ca59-edbd-4409-9c46-7d9167078f59 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:16.441770 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5a20a-ef83-4d96-a7c1-427c48076ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:16.443015 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5a20a-ef83-4d96-a7c1-427c48076ad6 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:16.443303 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5a20a-ef83-4d96-a7c1-427c48076ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:16.443669 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5a20a-ef83-4d96-a7c1-427c48076ad6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:16.444337 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c5a20a-ef83-4d96-a7c1-427c48076ad6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:16.446014 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c5a20a-ef83-4d96-a7c1-427c48076ad6 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:16.468033 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1242/2469] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:25:16.472982 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f622969-d697-4cd5-9493-846502404144 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:16.483579 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f622969-d697-4cd5-9493-846502404144 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:16.488591 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ee40d9-e576-4ac3-84ac-e65a3576d1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:16.489282 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ee40d9-e576-4ac3-84ac-e65a3576d1c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:16.501042 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ee40d9-e576-4ac3-84ac-e65a3576d1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:16.501042 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ee40d9-e576-4ac3-84ac-e65a3576d1c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:16.501042 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ee40d9-e576-4ac3-84ac-e65a3576d1c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:16.501042 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ee40d9-e576-4ac3-84ac-e65a3576d1c7 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:16.502327 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1228/2470] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:25:16.507257 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5a20a-ef83-4d96-a7c1-427c48076ad6 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:16.517897 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5a20a-ef83-4d96-a7c1-427c48076ad6 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:16.524696 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa48fe-c5df-441d-9050-e4e767b30150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:16.525580 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa48fe-c5df-441d-9050-e4e767b30150 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:16.525866 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa48fe-c5df-441d-9050-e4e767b30150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:16.526148 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa48fe-c5df-441d-9050-e4e767b30150 admin admin] PATH_INFO: `/v3/projects/5e4bd5f160eb4fad9d3d48fb0e63e1de/users/df4458f2cd2f4c09982672554e414f83/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:16.541023 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaa48fe-c5df-441d-9050-e4e767b30150 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e4bd5f160eb4fad9d3d48fb0e63e1de, user_id=df4458f2cd2f4c09982672554e414f83, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:16.543827 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaa48fe-c5df-441d-9050-e4e767b30150 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:16.621370 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1243/2471] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:25:16 2022] PUT /identity/v3/projects/5e4bd5f160eb4fad9d3d48fb0e63e1de/users/df4458f2cd2f4c09982672554e414f83/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:25:16.632028 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c46d2-ef08-4bcf-a140-96e8578b3052 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:16.637252 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c46d2-ef08-4bcf-a140-96e8578b3052 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:16.637252 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c46d2-ef08-4bcf-a140-96e8578b3052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:16.660305 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-f54c46d2-ef08-4bcf-a140-96e8578b3052 None None] MFA Rules not processed for user `df4458f2cd2f4c09982672554e414f83`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:25:16.661503 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-f54c46d2-ef08-4bcf-a140-96e8578b3052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:16.730614 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1229/2472] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:25:16 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:25:16.734860 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa48fe-c5df-441d-9050-e4e767b30150 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:16.755354 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd48689-f5ab-4d80-91fb-e054888d2962 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:16.755878 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd48689-f5ab-4d80-91fb-e054888d2962 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:16.756235 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd48689-f5ab-4d80-91fb-e054888d2962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:16.775018 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-bcd48689-f5ab-4d80-91fb-e054888d2962 None None] MFA Rules not processed for user `6ebfab3ff0b24f4aaabb8c6bb0ad10c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:25:16.776337 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-bcd48689-f5ab-4d80-91fb-e054888d2962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:16.804210 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa48fe-c5df-441d-9050-e4e767b30150 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:16.809128 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723f0e79-7185-45b3-a1fc-367c43dc407c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:16.810095 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f0e79-7185-45b3-a1fc-367c43dc407c admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:16.810252 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f0e79-7185-45b3-a1fc-367c43dc407c admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:16.810523 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f0e79-7185-45b3-a1fc-367c43dc407c admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:16.811229 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723f0e79-7185-45b3-a1fc-367c43dc407c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:16.813189 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723f0e79-7185-45b3-a1fc-367c43dc407c admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:16.834463 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1230/2473] 10.222.0.65 () {58 vars in 967 bytes} [Tue May 10 03:25:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:25:16.847440 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd48689-f5ab-4d80-91fb-e054888d2962 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:16.849230 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-bcd48689-f5ab-4d80-91fb-e054888d2962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:16.903883 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1244/2474] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:25:16 2022] POST /identity/v3/projects => generated 365 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:25:16.913119 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723f0e79-7185-45b3-a1fc-367c43dc407c admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:16.937570 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd48689-f5ab-4d80-91fb-e054888d2962 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:16.977159 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723f0e79-7185-45b3-a1fc-367c43dc407c admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:16.982943 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ee43f-02b0-4dd4-af28-32508215915b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:16.983774 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ee43f-02b0-4dd4-af28-32508215915b admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:16.984106 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ee43f-02b0-4dd4-af28-32508215915b admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:16.984385 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ee43f-02b0-4dd4-af28-32508215915b admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:16.985094 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43ee43f-02b0-4dd4-af28-32508215915b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:16.987148 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43ee43f-02b0-4dd4-af28-32508215915b admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:17.043857 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c9f05d-9e42-4c6f-9d51-a169a82cdc5d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1cb8ad43a234233ad602f451f0f8ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:17.044688 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9f05d-9e42-4c6f-9d51-a169a82cdc5d service swift] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:17.045006 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9f05d-9e42-4c6f-9d51-a169a82cdc5d service swift] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:17.045434 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9f05d-9e42-4c6f-9d51-a169a82cdc5d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:17.056669 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1245/2475] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:25:16 2022] POST /identity/v3/users => generated 289 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:25:17.060941 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ee43f-02b0-4dd4-af28-32508215915b admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:17.074580 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ee43f-02b0-4dd4-af28-32508215915b admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:17.079251 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a81f3be-d7ed-4c82-aa2c-a07e0dcb8d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:17.079912 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81f3be-d7ed-4c82-aa2c-a07e0dcb8d6c admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:17.080227 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81f3be-d7ed-4c82-aa2c-a07e0dcb8d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:17.080500 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81f3be-d7ed-4c82-aa2c-a07e0dcb8d6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:17.081259 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a81f3be-d7ed-4c82-aa2c-a07e0dcb8d6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:17.082940 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a81f3be-d7ed-4c82-aa2c-a07e0dcb8d6c admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:17.096078 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1246/2476] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:25:17.099366 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a81f3be-d7ed-4c82-aa2c-a07e0dcb8d6c admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:17.110798 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a81f3be-d7ed-4c82-aa2c-a07e0dcb8d6c admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:17.116296 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28378990-b2d7-40f2-996e-15ce26d91d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:17.117183 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28378990-b2d7-40f2-996e-15ce26d91d42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:17.117464 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28378990-b2d7-40f2-996e-15ce26d91d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:17.118665 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28378990-b2d7-40f2-996e-15ce26d91d42 admin admin] PATH_INFO: `/v3/projects/52c222cccc0a4753b00b20572e4cd3c7/users/97672d12d0b847ccb4b376dab19bb28b/roles/43105000610f402ca2486e7648018cca` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:17.118818 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c9f05d-9e42-4c6f-9d51-a169a82cdc5d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:17.119713 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c9f05d-9e42-4c6f-9d51-a169a82cdc5d service swift] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:17.128570 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1231/2477] 10.222.0.65 () {60 vars in 1384 bytes} [Tue May 10 03:25:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 10 03:25:17.134696 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28378990-b2d7-40f2-996e-15ce26d91d42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52c222cccc0a4753b00b20572e4cd3c7, user_id=97672d12d0b847ccb4b376dab19bb28b, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:17.137498 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28378990-b2d7-40f2-996e-15ce26d91d42 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:17.221364 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1247/2478] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:25:17 2022] PUT /identity/v3/projects/52c222cccc0a4753b00b20572e4cd3c7/users/97672d12d0b847ccb4b376dab19bb28b/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:25:17.225447 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c9f05d-9e42-4c6f-9d51-a169a82cdc5d service swift] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:17.235572 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c9f05d-9e42-4c6f-9d51-a169a82cdc5d service swift] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:17.298618 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2e4cfe-54ad-4de1-a2a2-d2d56d820cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:17.299370 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e4cfe-54ad-4de1-a2a2-d2d56d820cd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:17.299711 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e4cfe-54ad-4de1-a2a2-d2d56d820cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:17.299995 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e4cfe-54ad-4de1-a2a2-d2d56d820cd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:17.300827 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2e4cfe-54ad-4de1-a2a2-d2d56d820cd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:17.302428 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2e4cfe-54ad-4de1-a2a2-d2d56d820cd4 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:17.315582 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1232/2479] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:25:17.317837 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28378990-b2d7-40f2-996e-15ce26d91d42 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:17.328437 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28378990-b2d7-40f2-996e-15ce26d91d42 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:17.333836 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f3dd5-85aa-4a3b-8c0d-13353fcaeddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:17.334719 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f3dd5-85aa-4a3b-8c0d-13353fcaeddb admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:17.335000 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f3dd5-85aa-4a3b-8c0d-13353fcaeddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:17.335307 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f3dd5-85aa-4a3b-8c0d-13353fcaeddb admin admin] PATH_INFO: `/v3/projects/52c222cccc0a4753b00b20572e4cd3c7/users/97672d12d0b847ccb4b376dab19bb28b/roles/43105000610f402ca2486e7648018cca` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:17.337753 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81f3dd5-85aa-4a3b-8c0d-13353fcaeddb admin admin] RBAC: Authorizing `identity:create_grant(project_id=52c222cccc0a4753b00b20572e4cd3c7, user_id=97672d12d0b847ccb4b376dab19bb28b, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:17.340587 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81f3dd5-85aa-4a3b-8c0d-13353fcaeddb admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:17.351565 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1248/2480] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:25:17 2022] PUT /identity/v3/projects/52c222cccc0a4753b00b20572e4cd3c7/users/97672d12d0b847ccb4b376dab19bb28b/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:25:17.363442 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3c053-da1f-4182-a49f-4bc9942f8f6d None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:17.363739 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3c053-da1f-4182-a49f-4bc9942f8f6d None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:17.364045 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3c053-da1f-4182-a49f-4bc9942f8f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:17.393632 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-b5a3c053-da1f-4182-a49f-4bc9942f8f6d None None] MFA Rules not processed for user `97672d12d0b847ccb4b376dab19bb28b`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:25:17.394219 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-b5a3c053-da1f-4182-a49f-4bc9942f8f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:17.471780 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1233/2481] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:25:17 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:25:17.485131 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f3dd5-85aa-4a3b-8c0d-13353fcaeddb admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:17.486865 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-b81f3dd5-85aa-4a3b-8c0d-13353fcaeddb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:17.551108 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f3dd5-85aa-4a3b-8c0d-13353fcaeddb admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:17.555869 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1514803-eee9-4cc6-b2ce-ce6d3ec43606 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:17.556612 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1514803-eee9-4cc6-b2ce-ce6d3ec43606 service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:17.557529 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1514803-eee9-4cc6-b2ce-ce6d3ec43606 service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:17.557529 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1514803-eee9-4cc6-b2ce-ce6d3ec43606 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:17.569169 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1514803-eee9-4cc6-b2ce-ce6d3ec43606 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:17.570678 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1514803-eee9-4cc6-b2ce-ce6d3ec43606 service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:17.581029 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1249/2482] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:25:17 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:25:17.843285 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a3c053-da1f-4182-a49f-4bc9942f8f6d None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:17.853805 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a3c053-da1f-4182-a49f-4bc9942f8f6d None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:17.859829 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac62389-39b9-4819-b727-78f4d79babfc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:17.860546 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac62389-39b9-4819-b727-78f4d79babfc service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:17.860837 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac62389-39b9-4819-b727-78f4d79babfc service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:17.861111 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac62389-39b9-4819-b727-78f4d79babfc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:17.919184 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac62389-39b9-4819-b727-78f4d79babfc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:17.920599 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac62389-39b9-4819-b727-78f4d79babfc service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:17.931528 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1234/2483] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:25:17 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:25:24.247303 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1514803-eee9-4cc6-b2ce-ce6d3ec43606 service cinder] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:24.309202 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1514803-eee9-4cc6-b2ce-ce6d3ec43606 service cinder] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:24.313916 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7130fe-bcd7-4a4e-9fab-d95b7b98cdd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:24.314784 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7130fe-bcd7-4a4e-9fab-d95b7b98cdd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:24.315164 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7130fe-bcd7-4a4e-9fab-d95b7b98cdd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:24.315441 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7130fe-bcd7-4a4e-9fab-d95b7b98cdd9 admin admin] PATH_INFO: `/v3/users/df4458f2cd2f4c09982672554e414f83` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:24.316717 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7130fe-bcd7-4a4e-9fab-d95b7b98cdd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df4458f2cd2f4c09982672554e414f83)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:24.319573 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7130fe-bcd7-4a4e-9fab-d95b7b98cdd9 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:24.498030 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-cd7130fe-bcd7-4a4e-9fab-d95b7b98cdd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df4458f2cd2f4c09982672554e414f83'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:24.504978 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-cd7130fe-bcd7-4a4e-9fab-d95b7b98cdd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df4458f2cd2f4c09982672554e414f83'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:24.516791 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-cd7130fe-bcd7-4a4e-9fab-d95b7b98cdd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df4458f2cd2f4c09982672554e414f83'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:24.517527 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-cd7130fe-bcd7-4a4e-9fab-d95b7b98cdd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df4458f2cd2f4c09982672554e414f83'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:24.518160 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-cd7130fe-bcd7-4a4e-9fab-d95b7b98cdd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df4458f2cd2f4c09982672554e414f83'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:24.592698 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1250/2484] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:25:24 2022] DELETE /identity/v3/users/df4458f2cd2f4c09982672554e414f83 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:25:24.597774 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e33cca-70ae-498b-9e97-77a8b78f2fa4 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:24.598272 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e33cca-70ae-498b-9e97-77a8b78f2fa4 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:24.598389 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e33cca-70ae-498b-9e97-77a8b78f2fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:24.616049 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-66e33cca-70ae-498b-9e97-77a8b78f2fa4 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:25:24.617267 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-66e33cca-70ae-498b-9e97-77a8b78f2fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:24.679187 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1235/2485] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:25:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:25:24.689023 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7130fe-bcd7-4a4e-9fab-d95b7b98cdd9 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:24.690574 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-cd7130fe-bcd7-4a4e-9fab-d95b7b98cdd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:24.748328 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7130fe-bcd7-4a4e-9fab-d95b7b98cdd9 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:24.751999 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b7317-3bc1-432a-bc9a-596b671fab3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:24.752673 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b7317-3bc1-432a-bc9a-596b671fab3d service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:24.752960 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b7317-3bc1-432a-bc9a-596b671fab3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:24.753239 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b7317-3bc1-432a-bc9a-596b671fab3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:24.762708 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73b7317-3bc1-432a-bc9a-596b671fab3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:24.764163 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73b7317-3bc1-432a-bc9a-596b671fab3d service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:24.774450 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1251/2486] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:25:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:25:25.217387 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e33cca-70ae-498b-9e97-77a8b78f2fa4 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:25.218904 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-66e33cca-70ae-498b-9e97-77a8b78f2fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:25.232359 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e33cca-70ae-498b-9e97-77a8b78f2fa4 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:25.237909 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10c6e2-7e62-4bcf-99d4-7ffe73781eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:25.238827 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10c6e2-7e62-4bcf-99d4-7ffe73781eaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:25.239116 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10c6e2-7e62-4bcf-99d4-7ffe73781eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:25.239397 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10c6e2-7e62-4bcf-99d4-7ffe73781eaf admin admin] PATH_INFO: `/v3/projects/5e4bd5f160eb4fad9d3d48fb0e63e1de` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:25.240615 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca10c6e2-7e62-4bcf-99d4-7ffe73781eaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e4bd5f160eb4fad9d3d48fb0e63e1de)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:25.243332 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca10c6e2-7e62-4bcf-99d4-7ffe73781eaf admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:25.342186 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-ca10c6e2-7e62-4bcf-99d4-7ffe73781eaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e4bd5f160eb4fad9d3d48fb0e63e1de', 'request_id': 'req-ca10c6e2-7e62-4bcf-99d4-7ffe73781eaf'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:25.347931 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-ca10c6e2-7e62-4bcf-99d4-7ffe73781eaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e4bd5f160eb4fad9d3d48fb0e63e1de', 'request_id': 'req-ca10c6e2-7e62-4bcf-99d4-7ffe73781eaf'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:25.354934 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-ca10c6e2-7e62-4bcf-99d4-7ffe73781eaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e4bd5f160eb4fad9d3d48fb0e63e1de', 'request_id': 'req-ca10c6e2-7e62-4bcf-99d4-7ffe73781eaf'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:25.431916 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-ca10c6e2-7e62-4bcf-99d4-7ffe73781eaf admin admin] The token cache is being invalidate because project 5e4bd5f160eb4fad9d3d48fb0e63e1de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:25:25.432281 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-ca10c6e2-7e62-4bcf-99d4-7ffe73781eaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:25.432850 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-ca10c6e2-7e62-4bcf-99d4-7ffe73781eaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:25.434633 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1236/2487] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:25:25 2022] DELETE /identity/v3/projects/5e4bd5f160eb4fad9d3d48fb0e63e1de => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:25:25.438571 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b7317-3bc1-432a-bc9a-596b671fab3d service neutron] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:25.448916 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b7317-3bc1-432a-bc9a-596b671fab3d service neutron] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:25.504509 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c71dc93-9ee9-4dad-9dc8-d2020d690cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:25.505380 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71dc93-9ee9-4dad-9dc8-d2020d690cc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:25.505665 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71dc93-9ee9-4dad-9dc8-d2020d690cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:25.505945 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71dc93-9ee9-4dad-9dc8-d2020d690cc6 admin admin] PATH_INFO: `/v3/users/97672d12d0b847ccb4b376dab19bb28b` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:25.507668 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c71dc93-9ee9-4dad-9dc8-d2020d690cc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97672d12d0b847ccb4b376dab19bb28b)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:25.509611 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c71dc93-9ee9-4dad-9dc8-d2020d690cc6 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:25.725153 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-3c71dc93-9ee9-4dad-9dc8-d2020d690cc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97672d12d0b847ccb4b376dab19bb28b'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:25.731872 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-3c71dc93-9ee9-4dad-9dc8-d2020d690cc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97672d12d0b847ccb4b376dab19bb28b'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:25.744489 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-3c71dc93-9ee9-4dad-9dc8-d2020d690cc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97672d12d0b847ccb4b376dab19bb28b'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:25.745309 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-3c71dc93-9ee9-4dad-9dc8-d2020d690cc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97672d12d0b847ccb4b376dab19bb28b'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:25.745919 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-3c71dc93-9ee9-4dad-9dc8-d2020d690cc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97672d12d0b847ccb4b376dab19bb28b'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:25.814172 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1252/2488] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:25:25 2022] DELETE /identity/v3/users/97672d12d0b847ccb4b376dab19bb28b => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:25:26.201805 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10c6e2-7e62-4bcf-99d4-7ffe73781eaf admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:26.203311 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-ca10c6e2-7e62-4bcf-99d4-7ffe73781eaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:26.216835 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10c6e2-7e62-4bcf-99d4-7ffe73781eaf admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:26.280939 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b30e082-7321-4b9f-9943-53774b7f3e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:26.281731 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b30e082-7321-4b9f-9943-53774b7f3e02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:26.282020 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b30e082-7321-4b9f-9943-53774b7f3e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:26.282305 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b30e082-7321-4b9f-9943-53774b7f3e02 admin admin] PATH_INFO: `/v3/projects/52c222cccc0a4753b00b20572e4cd3c7` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:26.283476 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b30e082-7321-4b9f-9943-53774b7f3e02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52c222cccc0a4753b00b20572e4cd3c7)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:26.285430 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b30e082-7321-4b9f-9943-53774b7f3e02 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:26.381864 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2b30e082-7321-4b9f-9943-53774b7f3e02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52c222cccc0a4753b00b20572e4cd3c7', 'request_id': 'req-2b30e082-7321-4b9f-9943-53774b7f3e02'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:26.387329 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2b30e082-7321-4b9f-9943-53774b7f3e02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52c222cccc0a4753b00b20572e4cd3c7', 'request_id': 'req-2b30e082-7321-4b9f-9943-53774b7f3e02'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:26.393443 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2b30e082-7321-4b9f-9943-53774b7f3e02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52c222cccc0a4753b00b20572e4cd3c7', 'request_id': 'req-2b30e082-7321-4b9f-9943-53774b7f3e02'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:26.472447 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2b30e082-7321-4b9f-9943-53774b7f3e02 admin admin] The token cache is being invalidate because project 52c222cccc0a4753b00b20572e4cd3c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:25:26.474670 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2b30e082-7321-4b9f-9943-53774b7f3e02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:26.474670 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2b30e082-7321-4b9f-9943-53774b7f3e02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:26.474999 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1237/2489] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:25:26 2022] DELETE /identity/v3/projects/52c222cccc0a4753b00b20572e4cd3c7 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:25:26.485602 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30ccbb-12e4-4e68-9918-f771bc8a889c None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:26.486132 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30ccbb-12e4-4e68-9918-f771bc8a889c None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:26.486378 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30ccbb-12e4-4e68-9918-f771bc8a889c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:26.504954 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-9f30ccbb-12e4-4e68-9918-f771bc8a889c None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:25:26.506163 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-9f30ccbb-12e4-4e68-9918-f771bc8a889c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:26.566081 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1253/2490] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:25:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:25:26.573806 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b25ad-a7de-4213-a03c-1fc9a3f98f5b None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:26.574078 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b25ad-a7de-4213-a03c-1fc9a3f98f5b None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:26.574352 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b25ad-a7de-4213-a03c-1fc9a3f98f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:26.593208 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-866b25ad-a7de-4213-a03c-1fc9a3f98f5b None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:25:26.594420 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-866b25ad-a7de-4213-a03c-1fc9a3f98f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:26.603895 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1238/2491] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:25:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:25:26.607987 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f30ccbb-12e4-4e68-9918-f771bc8a889c None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:26.617653 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f30ccbb-12e4-4e68-9918-f771bc8a889c None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:26.622276 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b314ad4-6cde-4410-9379-33bcdf3ba154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:26.622925 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b314ad4-6cde-4410-9379-33bcdf3ba154 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:26.623208 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b314ad4-6cde-4410-9379-33bcdf3ba154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:26.623483 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b314ad4-6cde-4410-9379-33bcdf3ba154 admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:26.624328 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b314ad4-6cde-4410-9379-33bcdf3ba154 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:25:26.624636 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b314ad4-6cde-4410-9379-33bcdf3ba154 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:26.626234 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b314ad4-6cde-4410-9379-33bcdf3ba154 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:26.637546 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1254/2492] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 10 03:25:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:25:26.641827 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b25ad-a7de-4213-a03c-1fc9a3f98f5b None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:26.651747 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b25ad-a7de-4213-a03c-1fc9a3f98f5b None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:26.656868 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1385d3de-8576-4eac-9c47-e6f65b74af5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:26.657531 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1385d3de-8576-4eac-9c47-e6f65b74af5f admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:26.657817 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1385d3de-8576-4eac-9c47-e6f65b74af5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:26.658149 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1385d3de-8576-4eac-9c47-e6f65b74af5f admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:26.658917 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1385d3de-8576-4eac-9c47-e6f65b74af5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:26.660850 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1385d3de-8576-4eac-9c47-e6f65b74af5f admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:26.765153 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1239/2493] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:25:26 2022] POST /identity/v3/projects => generated 387 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:25:26.769474 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b314ad4-6cde-4410-9379-33bcdf3ba154 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:26.779947 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b314ad4-6cde-4410-9379-33bcdf3ba154 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:26.842551 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9079d-0074-4f17-beae-8715a24b3ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:26.843136 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9079d-0074-4f17-beae-8715a24b3ec3 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:26.843428 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9079d-0074-4f17-beae-8715a24b3ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:26.843706 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9079d-0074-4f17-beae-8715a24b3ec3 admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:26.844444 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f9079d-0074-4f17-beae-8715a24b3ec3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:26.846351 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f9079d-0074-4f17-beae-8715a24b3ec3 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:26.946652 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1255/2494] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:25:26 2022] POST /identity/v3/users => generated 294 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:25:26.966557 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1385d3de-8576-4eac-9c47-e6f65b74af5f admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:26.977400 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1385d3de-8576-4eac-9c47-e6f65b74af5f admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:26.982901 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79378b3-db67-44ff-9abb-6e8300e8ac46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:26.983532 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79378b3-db67-44ff-9abb-6e8300e8ac46 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:26.983818 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79378b3-db67-44ff-9abb-6e8300e8ac46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:26.984240 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79378b3-db67-44ff-9abb-6e8300e8ac46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:26.984975 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79378b3-db67-44ff-9abb-6e8300e8ac46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:26.986626 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79378b3-db67-44ff-9abb-6e8300e8ac46 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:26.998189 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1240/2495] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:25:27.014712 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9079d-0074-4f17-beae-8715a24b3ec3 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:27.025431 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9079d-0074-4f17-beae-8715a24b3ec3 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:27.030622 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c778e-948f-4308-9da0-4a752eb69bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:27.032514 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c778e-948f-4308-9da0-4a752eb69bb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:27.032514 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c778e-948f-4308-9da0-4a752eb69bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:27.032514 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c778e-948f-4308-9da0-4a752eb69bb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:27.032766 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276c778e-948f-4308-9da0-4a752eb69bb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:27.034172 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276c778e-948f-4308-9da0-4a752eb69bb5 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:27.044014 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1256/2496] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:25:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:25:27.048418 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79378b3-db67-44ff-9abb-6e8300e8ac46 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:27.058473 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79378b3-db67-44ff-9abb-6e8300e8ac46 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:27.063219 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb6066-ba4f-4aec-9f67-63bd5645e314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:27.066962 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb6066-ba4f-4aec-9f67-63bd5645e314 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:27.066962 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb6066-ba4f-4aec-9f67-63bd5645e314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:27.066962 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb6066-ba4f-4aec-9f67-63bd5645e314 admin admin] PATH_INFO: `/v3/projects/507e73805f934398978e7c51c441fcf2/users/fee611e1863a42e4bdff6b6c467a5350/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:27.080217 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbb6066-ba4f-4aec-9f67-63bd5645e314 admin admin] RBAC: Authorizing `identity:create_grant(project_id=507e73805f934398978e7c51c441fcf2, user_id=fee611e1863a42e4bdff6b6c467a5350, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:27.082845 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbb6066-ba4f-4aec-9f67-63bd5645e314 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:27.175054 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1241/2497] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:25:27 2022] PUT /identity/v3/projects/507e73805f934398978e7c51c441fcf2/users/fee611e1863a42e4bdff6b6c467a5350/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:25:27.186442 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4951f2f-c7a5-4363-9441-876f407100fe None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:27.186730 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4951f2f-c7a5-4363-9441-876f407100fe None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:27.187008 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4951f2f-c7a5-4363-9441-876f407100fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:27.214055 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-b4951f2f-c7a5-4363-9441-876f407100fe None None] MFA Rules not processed for user `fee611e1863a42e4bdff6b6c467a5350`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:25:27.215263 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-b4951f2f-c7a5-4363-9441-876f407100fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:27.276836 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1257/2498] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:25:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:25:27.281345 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb6066-ba4f-4aec-9f67-63bd5645e314 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:27.340650 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb6066-ba4f-4aec-9f67-63bd5645e314 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:27.345306 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb02f944-7c14-4084-afdd-77f83c7f4fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:27.345957 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb02f944-7c14-4084-afdd-77f83c7f4fd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:27.346240 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb02f944-7c14-4084-afdd-77f83c7f4fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:27.346518 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb02f944-7c14-4084-afdd-77f83c7f4fd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:27.347207 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb02f944-7c14-4084-afdd-77f83c7f4fd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:27.349141 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb02f944-7c14-4084-afdd-77f83c7f4fd6 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:27.433288 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1242/2499] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:25:27 2022] POST /identity/v3/projects => generated 385 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:25:27.437417 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4951f2f-c7a5-4363-9441-876f407100fe None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:27.448533 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4951f2f-c7a5-4363-9441-876f407100fe None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:27.502973 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98288eaf-57ae-4963-9b24-c3e8d3ab2fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:27.503660 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98288eaf-57ae-4963-9b24-c3e8d3ab2fb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:27.503915 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98288eaf-57ae-4963-9b24-c3e8d3ab2fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:27.504222 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98288eaf-57ae-4963-9b24-c3e8d3ab2fb0 admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:27.504925 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98288eaf-57ae-4963-9b24-c3e8d3ab2fb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:27.507497 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98288eaf-57ae-4963-9b24-c3e8d3ab2fb0 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:27.604815 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1258/2500] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:25:27 2022] POST /identity/v3/users => generated 299 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:25:27.608742 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb02f944-7c14-4084-afdd-77f83c7f4fd6 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:27.619300 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb02f944-7c14-4084-afdd-77f83c7f4fd6 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:27.624035 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dd6e46-d40a-4054-9397-de11efc09f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:27.624695 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd6e46-d40a-4054-9397-de11efc09f52 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:27.624974 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd6e46-d40a-4054-9397-de11efc09f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:27.625423 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd6e46-d40a-4054-9397-de11efc09f52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:27.626066 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dd6e46-d40a-4054-9397-de11efc09f52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:27.627654 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dd6e46-d40a-4054-9397-de11efc09f52 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:27.637929 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1243/2501] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:25:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:25:27.642135 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98288eaf-57ae-4963-9b24-c3e8d3ab2fb0 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:27.651918 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98288eaf-57ae-4963-9b24-c3e8d3ab2fb0 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:27.657024 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bec5df-c4cd-4218-b42b-104c44384b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:27.657895 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bec5df-c4cd-4218-b42b-104c44384b1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:27.658180 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bec5df-c4cd-4218-b42b-104c44384b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:27.658486 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bec5df-c4cd-4218-b42b-104c44384b1c admin admin] PATH_INFO: `/v3/projects/af82328433e6408fadcfb4eb2ae08043/users/08c70599410d44499839e5dcb533a807/roles/43105000610f402ca2486e7648018cca` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:27.673905 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bec5df-c4cd-4218-b42b-104c44384b1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=af82328433e6408fadcfb4eb2ae08043, user_id=08c70599410d44499839e5dcb533a807, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:27.676759 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bec5df-c4cd-4218-b42b-104c44384b1c admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:27.747115 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1259/2502] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:25:27 2022] PUT /identity/v3/projects/af82328433e6408fadcfb4eb2ae08043/users/08c70599410d44499839e5dcb533a807/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:25:27.751125 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dd6e46-d40a-4054-9397-de11efc09f52 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:27.760928 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dd6e46-d40a-4054-9397-de11efc09f52 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:27.816051 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c4b7c-00f6-4c1b-818f-02c6b5d60f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:27.816717 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c4b7c-00f6-4c1b-818f-02c6b5d60f3f admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:27.817003 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c4b7c-00f6-4c1b-818f-02c6b5d60f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:27.817284 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c4b7c-00f6-4c1b-818f-02c6b5d60f3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:27.818001 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37c4b7c-00f6-4c1b-818f-02c6b5d60f3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:27.823138 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37c4b7c-00f6-4c1b-818f-02c6b5d60f3f admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:27.834984 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1244/2503] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:25:27 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:25:27.839185 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bec5df-c4cd-4218-b42b-104c44384b1c admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:27.850034 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bec5df-c4cd-4218-b42b-104c44384b1c admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:27.855443 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23213c2b-334a-42c8-9c55-7e2c742dcb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:27.856701 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23213c2b-334a-42c8-9c55-7e2c742dcb2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:27.856985 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23213c2b-334a-42c8-9c55-7e2c742dcb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:27.857257 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23213c2b-334a-42c8-9c55-7e2c742dcb2b admin admin] PATH_INFO: `/v3/projects/af82328433e6408fadcfb4eb2ae08043/users/08c70599410d44499839e5dcb533a807/roles/43105000610f402ca2486e7648018cca` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:27.859615 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23213c2b-334a-42c8-9c55-7e2c742dcb2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=af82328433e6408fadcfb4eb2ae08043, user_id=08c70599410d44499839e5dcb533a807, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:27.862799 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23213c2b-334a-42c8-9c55-7e2c742dcb2b admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:27.873938 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1260/2504] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:25:27 2022] PUT /identity/v3/projects/af82328433e6408fadcfb4eb2ae08043/users/08c70599410d44499839e5dcb533a807/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:25:27.884602 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c3c3e-633c-4957-b949-139b7aa8685f None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:27.884997 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c3c3e-633c-4957-b949-139b7aa8685f None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:27.885391 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c3c3e-633c-4957-b949-139b7aa8685f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:27.911965 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-5a8c3c3e-633c-4957-b949-139b7aa8685f None None] MFA Rules not processed for user `08c70599410d44499839e5dcb533a807`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:25:27.913750 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-5a8c3c3e-633c-4957-b949-139b7aa8685f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:27.990658 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1245/2505] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:25:27 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:25:28.002913 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23213c2b-334a-42c8-9c55-7e2c742dcb2b admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:28.004723 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-23213c2b-334a-42c8-9c55-7e2c742dcb2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:28.070708 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23213c2b-334a-42c8-9c55-7e2c742dcb2b admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:28.074392 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2602d99f-c539-4a8e-9f9c-478008a16803 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:28.075178 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602d99f-c539-4a8e-9f9c-478008a16803 service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:28.075773 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602d99f-c539-4a8e-9f9c-478008a16803 service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:28.075773 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602d99f-c539-4a8e-9f9c-478008a16803 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:28.085612 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2602d99f-c539-4a8e-9f9c-478008a16803 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:28.087077 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2602d99f-c539-4a8e-9f9c-478008a16803 service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:28.097328 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1261/2506] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:25:28 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:25:29.209290 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8c3c3e-633c-4957-b949-139b7aa8685f None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:29.281446 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8c3c3e-633c-4957-b949-139b7aa8685f None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:29.286754 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60097d93-69cc-4e24-b7f8-5c78c003ab54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:29.287685 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60097d93-69cc-4e24-b7f8-5c78c003ab54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:29.288023 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60097d93-69cc-4e24-b7f8-5c78c003ab54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:29.288329 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60097d93-69cc-4e24-b7f8-5c78c003ab54 admin admin] PATH_INFO: `/v3/users/fee611e1863a42e4bdff6b6c467a5350` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:29.289727 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60097d93-69cc-4e24-b7f8-5c78c003ab54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fee611e1863a42e4bdff6b6c467a5350)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:29.291833 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60097d93-69cc-4e24-b7f8-5c78c003ab54 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:29.531541 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-60097d93-69cc-4e24-b7f8-5c78c003ab54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fee611e1863a42e4bdff6b6c467a5350'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:29.532237 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-60097d93-69cc-4e24-b7f8-5c78c003ab54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fee611e1863a42e4bdff6b6c467a5350'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:29.539437 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-60097d93-69cc-4e24-b7f8-5c78c003ab54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fee611e1863a42e4bdff6b6c467a5350'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:29.667191 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-60097d93-69cc-4e24-b7f8-5c78c003ab54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fee611e1863a42e4bdff6b6c467a5350'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:29.668126 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-60097d93-69cc-4e24-b7f8-5c78c003ab54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fee611e1863a42e4bdff6b6c467a5350'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:29.702851 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1246/2507] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:25:29 2022] DELETE /identity/v3/users/fee611e1863a42e4bdff6b6c467a5350 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:25:29.706628 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3dab22-4d97-43e3-9cf0-62db1eca80ac None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:29.707151 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3dab22-4d97-43e3-9cf0-62db1eca80ac None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:29.707247 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3dab22-4d97-43e3-9cf0-62db1eca80ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:29.725657 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-ea3dab22-4d97-43e3-9cf0-62db1eca80ac None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:25:29.727039 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-ea3dab22-4d97-43e3-9cf0-62db1eca80ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:29.795961 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1262/2508] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:25:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:25:29.806849 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60097d93-69cc-4e24-b7f8-5c78c003ab54 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:29.808494 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-60097d93-69cc-4e24-b7f8-5c78c003ab54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:29.899507 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60097d93-69cc-4e24-b7f8-5c78c003ab54 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:29.903035 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3254da67-d714-45a2-a3bd-80506a518580 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:29.903686 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3254da67-d714-45a2-a3bd-80506a518580 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:29.903965 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3254da67-d714-45a2-a3bd-80506a518580 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:29.904266 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3254da67-d714-45a2-a3bd-80506a518580 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:29.923146 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3254da67-d714-45a2-a3bd-80506a518580 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:29.925054 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3254da67-d714-45a2-a3bd-80506a518580 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:29.937265 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1247/2509] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:25:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:25:30.405747 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3dab22-4d97-43e3-9cf0-62db1eca80ac None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:30.407329 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-ea3dab22-4d97-43e3-9cf0-62db1eca80ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:30.419089 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3dab22-4d97-43e3-9cf0-62db1eca80ac None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:30.424251 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce6eee-c4a2-4792-b171-982e7e48e012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:30.427625 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce6eee-c4a2-4792-b171-982e7e48e012 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:30.427966 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce6eee-c4a2-4792-b171-982e7e48e012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:30.428328 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce6eee-c4a2-4792-b171-982e7e48e012 admin admin] PATH_INFO: `/v3/projects/507e73805f934398978e7c51c441fcf2` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:30.430108 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ce6eee-c4a2-4792-b171-982e7e48e012 admin admin] RBAC: Authorizing `identity:delete_project(project_id=507e73805f934398978e7c51c441fcf2)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:30.436343 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ce6eee-c4a2-4792-b171-982e7e48e012 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:30.537525 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3254da67-d714-45a2-a3bd-80506a518580 service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:30.540766 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-3254da67-d714-45a2-a3bd-80506a518580 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:30.554747 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3254da67-d714-45a2-a3bd-80506a518580 service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:30.563544 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaec8e9-17f2-4e73-8f15-d9f5881c1fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:30.564435 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaec8e9-17f2-4e73-8f15-d9f5881c1fa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:30.564710 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaec8e9-17f2-4e73-8f15-d9f5881c1fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:30.564980 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaec8e9-17f2-4e73-8f15-d9f5881c1fa8 admin admin] PATH_INFO: `/v3/users/8c14a8e67f9f426b89cac58d98a1e684` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:30.566148 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaec8e9-17f2-4e73-8f15-d9f5881c1fa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c14a8e67f9f426b89cac58d98a1e684)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:30.568123 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaec8e9-17f2-4e73-8f15-d9f5881c1fa8 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:30.580542 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-f0ce6eee-c4a2-4792-b171-982e7e48e012 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '507e73805f934398978e7c51c441fcf2', 'request_id': 'req-f0ce6eee-c4a2-4792-b171-982e7e48e012'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:30.587263 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-f0ce6eee-c4a2-4792-b171-982e7e48e012 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '507e73805f934398978e7c51c441fcf2', 'request_id': 'req-f0ce6eee-c4a2-4792-b171-982e7e48e012'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:30.596676 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-f0ce6eee-c4a2-4792-b171-982e7e48e012 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '507e73805f934398978e7c51c441fcf2', 'request_id': 'req-f0ce6eee-c4a2-4792-b171-982e7e48e012'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:30.677206 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-f0ce6eee-c4a2-4792-b171-982e7e48e012 admin admin] The token cache is being invalidate because project 507e73805f934398978e7c51c441fcf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:25:30.677496 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-f0ce6eee-c4a2-4792-b171-982e7e48e012 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:30.678170 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-f0ce6eee-c4a2-4792-b171-982e7e48e012 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:30.680507 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1263/2510] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:25:30 2022] DELETE /identity/v3/projects/507e73805f934398978e7c51c441fcf2 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:25:30.684399 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce6eee-c4a2-4792-b171-982e7e48e012 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:30.685891 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-f0ce6eee-c4a2-4792-b171-982e7e48e012 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:30.736866 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3eaec8e9-17f2-4e73-8f15-d9f5881c1fa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c14a8e67f9f426b89cac58d98a1e684'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:30.737530 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3eaec8e9-17f2-4e73-8f15-d9f5881c1fa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c14a8e67f9f426b89cac58d98a1e684'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:30.744890 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3eaec8e9-17f2-4e73-8f15-d9f5881c1fa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c14a8e67f9f426b89cac58d98a1e684'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:30.747579 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce6eee-c4a2-4792-b171-982e7e48e012 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:30.752261 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249fd31-538e-4a46-be10-be00de07055f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:30.753151 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249fd31-538e-4a46-be10-be00de07055f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:30.753432 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249fd31-538e-4a46-be10-be00de07055f admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:30.753704 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249fd31-538e-4a46-be10-be00de07055f admin admin] PATH_INFO: `/v3/users/08c70599410d44499839e5dcb533a807` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:30.754885 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2249fd31-538e-4a46-be10-be00de07055f admin admin] RBAC: Authorizing `identity:delete_user(user_id=08c70599410d44499839e5dcb533a807)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:30.756824 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2249fd31-538e-4a46-be10-be00de07055f admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:30.804424 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3eaec8e9-17f2-4e73-8f15-d9f5881c1fa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c14a8e67f9f426b89cac58d98a1e684'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:30.805062 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3eaec8e9-17f2-4e73-8f15-d9f5881c1fa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c14a8e67f9f426b89cac58d98a1e684'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:30.823202 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1248/2511] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:25:30 2022] DELETE /identity/v3/users/8c14a8e67f9f426b89cac58d98a1e684 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:25:30.827781 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2401ce-bdf1-4451-abc9-5d2a05e79562 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:30.828298 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2401ce-bdf1-4451-abc9-5d2a05e79562 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:30.828601 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2401ce-bdf1-4451-abc9-5d2a05e79562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:30.844988 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-cd2401ce-bdf1-4451-abc9-5d2a05e79562 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:25:30.846205 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-cd2401ce-bdf1-4451-abc9-5d2a05e79562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:30.904270 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1249/2512] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:25:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:25:30.914360 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2401ce-bdf1-4451-abc9-5d2a05e79562 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:30.915754 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-cd2401ce-bdf1-4451-abc9-5d2a05e79562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:30.978656 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2401ce-bdf1-4451-abc9-5d2a05e79562 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:30.982509 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc171fd4-fd1f-41bd-885d-54a3281f66cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:30.983168 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc171fd4-fd1f-41bd-885d-54a3281f66cf service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:30.983451 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc171fd4-fd1f-41bd-885d-54a3281f66cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:30.983731 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc171fd4-fd1f-41bd-885d-54a3281f66cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:30.993985 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc171fd4-fd1f-41bd-885d-54a3281f66cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:30.996708 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc171fd4-fd1f-41bd-885d-54a3281f66cf service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:31.003442 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-2249fd31-538e-4a46-be10-be00de07055f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08c70599410d44499839e5dcb533a807'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:31.005621 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1250/2513] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:25:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:25:31.010768 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-2249fd31-538e-4a46-be10-be00de07055f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08c70599410d44499839e5dcb533a807'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:31.023005 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-2249fd31-538e-4a46-be10-be00de07055f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08c70599410d44499839e5dcb533a807'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:31.023765 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-2249fd31-538e-4a46-be10-be00de07055f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08c70599410d44499839e5dcb533a807'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:31.025365 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-2249fd31-538e-4a46-be10-be00de07055f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08c70599410d44499839e5dcb533a807'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:31.108257 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1264/2514] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:25:30 2022] DELETE /identity/v3/users/08c70599410d44499839e5dcb533a807 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:25:31.503384 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc171fd4-fd1f-41bd-885d-54a3281f66cf service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:31.505125 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-fc171fd4-fd1f-41bd-885d-54a3281f66cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:31.521892 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc171fd4-fd1f-41bd-885d-54a3281f66cf service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:31.582628 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249fd31-538e-4a46-be10-be00de07055f admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:31.584483 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-2249fd31-538e-4a46-be10-be00de07055f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:31.606867 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bb01e7-d740-4d7f-b8a2-b871490ecb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:31.608528 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb01e7-d740-4d7f-b8a2-b871490ecb61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:31.608890 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb01e7-d740-4d7f-b8a2-b871490ecb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:31.609242 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb01e7-d740-4d7f-b8a2-b871490ecb61 admin admin] PATH_INFO: `/v3/projects/08dc4e7cbf524d38827fd40fc2c5e59d` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:31.610926 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bb01e7-d740-4d7f-b8a2-b871490ecb61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08dc4e7cbf524d38827fd40fc2c5e59d)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:31.613432 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bb01e7-d740-4d7f-b8a2-b871490ecb61 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:31.669093 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249fd31-538e-4a46-be10-be00de07055f admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:31.674495 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf02c1c-586b-4c83-b42f-638f5906fe24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:31.675397 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf02c1c-586b-4c83-b42f-638f5906fe24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:31.675676 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf02c1c-586b-4c83-b42f-638f5906fe24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:31.676366 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf02c1c-586b-4c83-b42f-638f5906fe24 admin admin] PATH_INFO: `/v3/projects/af82328433e6408fadcfb4eb2ae08043` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:31.677788 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf02c1c-586b-4c83-b42f-638f5906fe24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af82328433e6408fadcfb4eb2ae08043)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:31.679920 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf02c1c-586b-4c83-b42f-638f5906fe24 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:31.730732 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-16bb01e7-d740-4d7f-b8a2-b871490ecb61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08dc4e7cbf524d38827fd40fc2c5e59d', 'request_id': 'req-16bb01e7-d740-4d7f-b8a2-b871490ecb61'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:31.736231 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-16bb01e7-d740-4d7f-b8a2-b871490ecb61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08dc4e7cbf524d38827fd40fc2c5e59d', 'request_id': 'req-16bb01e7-d740-4d7f-b8a2-b871490ecb61'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:31.742927 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-16bb01e7-d740-4d7f-b8a2-b871490ecb61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08dc4e7cbf524d38827fd40fc2c5e59d', 'request_id': 'req-16bb01e7-d740-4d7f-b8a2-b871490ecb61'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:31.806615 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-6cf02c1c-586b-4c83-b42f-638f5906fe24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af82328433e6408fadcfb4eb2ae08043', 'request_id': 'req-6cf02c1c-586b-4c83-b42f-638f5906fe24'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:31.816033 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-6cf02c1c-586b-4c83-b42f-638f5906fe24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af82328433e6408fadcfb4eb2ae08043', 'request_id': 'req-6cf02c1c-586b-4c83-b42f-638f5906fe24'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:31.823249 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-6cf02c1c-586b-4c83-b42f-638f5906fe24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af82328433e6408fadcfb4eb2ae08043', 'request_id': 'req-6cf02c1c-586b-4c83-b42f-638f5906fe24'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:31.827972 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-16bb01e7-d740-4d7f-b8a2-b871490ecb61 admin admin] The token cache is being invalidate because project 08dc4e7cbf524d38827fd40fc2c5e59d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:25:31.828270 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-16bb01e7-d740-4d7f-b8a2-b871490ecb61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:31.828976 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-16bb01e7-d740-4d7f-b8a2-b871490ecb61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:31.830595 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1251/2515] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:25:31 2022] DELETE /identity/v3/projects/08dc4e7cbf524d38827fd40fc2c5e59d => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:25:31.835084 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84305e25-1334-41db-b985-92a583d68b33 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:31.835376 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84305e25-1334-41db-b985-92a583d68b33 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:31.835660 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84305e25-1334-41db-b985-92a583d68b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:31.853829 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-84305e25-1334-41db-b985-92a583d68b33 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:25:31.855298 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-84305e25-1334-41db-b985-92a583d68b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:31.903837 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-6cf02c1c-586b-4c83-b42f-638f5906fe24 admin admin] The token cache is being invalidate because project af82328433e6408fadcfb4eb2ae08043 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:25:31.904167 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-6cf02c1c-586b-4c83-b42f-638f5906fe24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:31.904978 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-6cf02c1c-586b-4c83-b42f-638f5906fe24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:31.907449 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1265/2516] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:25:31 2022] DELETE /identity/v3/projects/af82328433e6408fadcfb4eb2ae08043 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:25:31.911668 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aeae8e-3f87-41f5-9e7f-cc39bbb9436f None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:31.912859 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aeae8e-3f87-41f5-9e7f-cc39bbb9436f None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:31.913207 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aeae8e-3f87-41f5-9e7f-cc39bbb9436f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:31.922838 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1252/2517] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:25:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:25:31.930849 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a483e6-f127-43b3-809c-991cb727cd36 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:31.931891 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a483e6-f127-43b3-809c-991cb727cd36 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:31.931891 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a483e6-f127-43b3-809c-991cb727cd36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:31.935121 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-19aeae8e-3f87-41f5-9e7f-cc39bbb9436f None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:25:31.936407 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-19aeae8e-3f87-41f5-9e7f-cc39bbb9436f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:31.945332 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1266/2518] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:25:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:25:31.953482 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef1475-f866-4015-af8b-9a2736d581e2 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:31.953781 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef1475-f866-4015-af8b-9a2736d581e2 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:31.954061 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef1475-f866-4015-af8b-9a2736d581e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:31.955890 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-61a483e6-f127-43b3-809c-991cb727cd36 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:25:31.957330 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-61a483e6-f127-43b3-809c-991cb727cd36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:31.973949 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1253/2519] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:25:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:25:31.975320 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a483e6-f127-43b3-809c-991cb727cd36 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:31.981936 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-38ef1475-f866-4015-af8b-9a2736d581e2 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:25:31.983787 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-38ef1475-f866-4015-af8b-9a2736d581e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:31.987398 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a483e6-f127-43b3-809c-991cb727cd36 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:31.993709 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1267/2520] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:25:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:25:31.994485 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419194d0-96c8-464f-85e5-50d24c00422e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:31.995343 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419194d0-96c8-464f-85e5-50d24c00422e admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:31.995777 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419194d0-96c8-464f-85e5-50d24c00422e admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:31.996107 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419194d0-96c8-464f-85e5-50d24c00422e admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:31.996861 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419194d0-96c8-464f-85e5-50d24c00422e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:25:31.997170 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419194d0-96c8-464f-85e5-50d24c00422e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:31.998412 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef1475-f866-4015-af8b-9a2736d581e2 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:31.999187 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419194d0-96c8-464f-85e5-50d24c00422e admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:32.019448 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1254/2521] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 10 03:25:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:25:32.019733 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef1475-f866-4015-af8b-9a2736d581e2 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:32.023486 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419194d0-96c8-464f-85e5-50d24c00422e admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:32.025788 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88e2e24-f21c-4fa7-b9a3-6388263a8cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:32.026858 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e2e24-f21c-4fa7-b9a3-6388263a8cea admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:32.027352 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e2e24-f21c-4fa7-b9a3-6388263a8cea admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:32.027822 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e2e24-f21c-4fa7-b9a3-6388263a8cea admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:32.028669 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88e2e24-f21c-4fa7-b9a3-6388263a8cea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:25:32.029040 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88e2e24-f21c-4fa7-b9a3-6388263a8cea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:32.030745 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88e2e24-f21c-4fa7-b9a3-6388263a8cea admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:32.038131 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419194d0-96c8-464f-85e5-50d24c00422e admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:32.047904 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1268/2522] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 10 03:25:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:25:32.049285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88e2e24-f21c-4fa7-b9a3-6388263a8cea admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:32.049766 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70002ba-4676-42d5-bb30-800a33661402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:32.050644 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70002ba-4676-42d5-bb30-800a33661402 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:32.050924 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70002ba-4676-42d5-bb30-800a33661402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:32.051203 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70002ba-4676-42d5-bb30-800a33661402 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:32.051901 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70002ba-4676-42d5-bb30-800a33661402 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:32.054590 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70002ba-4676-42d5-bb30-800a33661402 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:32.061075 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88e2e24-f21c-4fa7-b9a3-6388263a8cea admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:32.066395 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dede30b-5d0a-4b68-b6e7-db1d81fb202d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:32.067060 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dede30b-5d0a-4b68-b6e7-db1d81fb202d admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:32.067343 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dede30b-5d0a-4b68-b6e7-db1d81fb202d admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:32.067629 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dede30b-5d0a-4b68-b6e7-db1d81fb202d admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:32.068487 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dede30b-5d0a-4b68-b6e7-db1d81fb202d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:32.070953 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dede30b-5d0a-4b68-b6e7-db1d81fb202d admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:32.148432 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1255/2523] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:25:32 2022] POST /identity/v3/projects => generated 377 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:25:32.152550 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70002ba-4676-42d5-bb30-800a33661402 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:32.206375 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1269/2524] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:25:32 2022] POST /identity/v3/projects => generated 371 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:25:32.210960 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dede30b-5d0a-4b68-b6e7-db1d81fb202d admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:32.212823 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70002ba-4676-42d5-bb30-800a33661402 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:32.276061 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dede30b-5d0a-4b68-b6e7-db1d81fb202d admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:32.277637 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f10b50e-e8e8-4fb0-923b-b4cdd24c0742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:32.278420 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10b50e-e8e8-4fb0-923b-b4cdd24c0742 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:32.278701 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10b50e-e8e8-4fb0-923b-b4cdd24c0742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:32.278971 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10b50e-e8e8-4fb0-923b-b4cdd24c0742 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:32.279656 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f10b50e-e8e8-4fb0-923b-b4cdd24c0742 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:32.281561 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ffa7c8-4352-4962-a0dc-8098230439cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:32.281715 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f10b50e-e8e8-4fb0-923b-b4cdd24c0742 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:32.282274 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ffa7c8-4352-4962-a0dc-8098230439cf admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:32.282566 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ffa7c8-4352-4962-a0dc-8098230439cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:32.284510 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ffa7c8-4352-4962-a0dc-8098230439cf admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:32.284510 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ffa7c8-4352-4962-a0dc-8098230439cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:32.285483 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ffa7c8-4352-4962-a0dc-8098230439cf admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:32.384772 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1270/2525] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:25:32 2022] POST /identity/v3/users => generated 286 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:25:32.384974 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1256/2526] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:25:32 2022] POST /identity/v3/users => generated 289 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:25:32.386203 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ffa7c8-4352-4962-a0dc-8098230439cf admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:32.386758 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f10b50e-e8e8-4fb0-923b-b4cdd24c0742 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:32.396343 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ffa7c8-4352-4962-a0dc-8098230439cf admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:32.396908 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f10b50e-e8e8-4fb0-923b-b4cdd24c0742 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:32.404922 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3347339e-499d-4132-b8e6-879371ead9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:32.404922 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347339e-499d-4132-b8e6-879371ead9bc admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:32.405206 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226cf57a-91a7-4218-a432-903b0753d1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:32.405315 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347339e-499d-4132-b8e6-879371ead9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:32.405315 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347339e-499d-4132-b8e6-879371ead9bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:32.405501 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226cf57a-91a7-4218-a432-903b0753d1f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:32.405501 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226cf57a-91a7-4218-a432-903b0753d1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:32.405682 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3347339e-499d-4132-b8e6-879371ead9bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:32.405768 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226cf57a-91a7-4218-a432-903b0753d1f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:32.405768 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226cf57a-91a7-4218-a432-903b0753d1f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:32.405924 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3347339e-499d-4132-b8e6-879371ead9bc admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:32.406188 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226cf57a-91a7-4218-a432-903b0753d1f0 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:32.415578 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1271/2527] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:25:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:25:32.419629 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3347339e-499d-4132-b8e6-879371ead9bc admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:32.420255 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1257/2528] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:25:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:25:32.423844 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226cf57a-91a7-4218-a432-903b0753d1f0 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:32.430511 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3347339e-499d-4132-b8e6-879371ead9bc admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:32.434817 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226cf57a-91a7-4218-a432-903b0753d1f0 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:32.435421 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6fc694-e0b3-49d7-83a5-f8531c2af97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:32.436099 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fc694-e0b3-49d7-83a5-f8531c2af97d admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:32.436386 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fc694-e0b3-49d7-83a5-f8531c2af97d admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:32.436659 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fc694-e0b3-49d7-83a5-f8531c2af97d admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:32.437391 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6fc694-e0b3-49d7-83a5-f8531c2af97d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:32.438951 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6fc694-e0b3-49d7-83a5-f8531c2af97d admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:32.439060 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2587c-a83b-43c2-9360-b8c468d5217d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:32.439672 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2587c-a83b-43c2-9360-b8c468d5217d admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:32.439956 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2587c-a83b-43c2-9360-b8c468d5217d admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:32.440273 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2587c-a83b-43c2-9360-b8c468d5217d admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:32.440988 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b2587c-a83b-43c2-9360-b8c468d5217d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:32.442592 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b2587c-a83b-43c2-9360-b8c468d5217d admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:32.452050 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1272/2529] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:25:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:25:32.457262 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6fc694-e0b3-49d7-83a5-f8531c2af97d admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:32.461745 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1258/2530] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:25:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:25:32.462490 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2587c-a83b-43c2-9360-b8c468d5217d admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:32.471239 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6fc694-e0b3-49d7-83a5-f8531c2af97d admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:32.473115 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2587c-a83b-43c2-9360-b8c468d5217d admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:32.476546 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991531c2-67b8-4908-94e1-3b56ba5f3919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:32.477426 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991531c2-67b8-4908-94e1-3b56ba5f3919 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:32.477711 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991531c2-67b8-4908-94e1-3b56ba5f3919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:32.477987 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991531c2-67b8-4908-94e1-3b56ba5f3919 admin admin] PATH_INFO: `/v3/projects/dfdd3106ad0d445fb9866648596f811e/users/285cbf50fac34905b72f620030429585/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:32.478241 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f764d2b1-c19c-422b-9556-6c25be960ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:32.479116 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764d2b1-c19c-422b-9556-6c25be960ba6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:32.479399 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764d2b1-c19c-422b-9556-6c25be960ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:32.479673 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764d2b1-c19c-422b-9556-6c25be960ba6 admin admin] PATH_INFO: `/v3/projects/7e6cd03f96804841a163744f10cd6c3d/users/27871c6559fe4fe58d8622cc2ceb0f53/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:32.493530 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991531c2-67b8-4908-94e1-3b56ba5f3919 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfdd3106ad0d445fb9866648596f811e, user_id=285cbf50fac34905b72f620030429585, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:32.494643 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f764d2b1-c19c-422b-9556-6c25be960ba6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e6cd03f96804841a163744f10cd6c3d, user_id=27871c6559fe4fe58d8622cc2ceb0f53, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:32.496202 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991531c2-67b8-4908-94e1-3b56ba5f3919 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:32.497295 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f764d2b1-c19c-422b-9556-6c25be960ba6 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:32.610076 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1273/2531] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:25:32 2022] PUT /identity/v3/projects/dfdd3106ad0d445fb9866648596f811e/users/285cbf50fac34905b72f620030429585/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:25:32.610324 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1259/2532] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:25:32 2022] PUT /identity/v3/projects/7e6cd03f96804841a163744f10cd6c3d/users/27871c6559fe4fe58d8622cc2ceb0f53/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:25:32.618392 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ef310-35e0-41d6-bcd9-c010436e5002 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:32.618727 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ef310-35e0-41d6-bcd9-c010436e5002 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:32.619006 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ef310-35e0-41d6-bcd9-c010436e5002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:32.621603 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e98c7-122c-4bda-8422-72683c805c45 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:32.621894 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e98c7-122c-4bda-8422-72683c805c45 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:32.622177 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e98c7-122c-4bda-8422-72683c805c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:32.636648 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-361ef310-35e0-41d6-bcd9-c010436e5002 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:25:32.638011 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-361ef310-35e0-41d6-bcd9-c010436e5002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:32.650761 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-b70e98c7-122c-4bda-8422-72683c805c45 None None] MFA Rules not processed for user `27871c6559fe4fe58d8622cc2ceb0f53`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:25:32.652024 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-b70e98c7-122c-4bda-8422-72683c805c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:32.698697 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1274/2533] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:25:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:25:32.708789 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ef310-35e0-41d6-bcd9-c010436e5002 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:32.710826 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-361ef310-35e0-41d6-bcd9-c010436e5002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:32.717606 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1260/2534] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:25:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:25:32.721842 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70e98c7-122c-4bda-8422-72683c805c45 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:32.733022 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70e98c7-122c-4bda-8422-72683c805c45 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:32.737610 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647b5774-25e9-4ab0-9603-9ac4850dfbe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:32.738272 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b5774-25e9-4ab0-9603-9ac4850dfbe5 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:32.738559 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b5774-25e9-4ab0-9603-9ac4850dfbe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:32.738884 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b5774-25e9-4ab0-9603-9ac4850dfbe5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:32.739736 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647b5774-25e9-4ab0-9603-9ac4850dfbe5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:32.742028 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647b5774-25e9-4ab0-9603-9ac4850dfbe5 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:32.770533 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ef310-35e0-41d6-bcd9-c010436e5002 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:32.774749 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146f101-2a63-4ab7-bf4d-386515d968c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:32.775401 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146f101-2a63-4ab7-bf4d-386515d968c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:32.775688 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146f101-2a63-4ab7-bf4d-386515d968c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:32.776034 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146f101-2a63-4ab7-bf4d-386515d968c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:32.784808 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a146f101-2a63-4ab7-bf4d-386515d968c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:32.786297 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a146f101-2a63-4ab7-bf4d-386515d968c7 service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:32.796178 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1275/2535] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:25:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:25:32.834134 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1261/2536] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:25:32 2022] POST /identity/v3/projects => generated 377 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:25:32.838727 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146f101-2a63-4ab7-bf4d-386515d968c7 service neutron] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:32.849411 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146f101-2a63-4ab7-bf4d-386515d968c7 service neutron] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:32.905477 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89730d9-d167-4916-9dd8-5c8702e8bf7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:32.906320 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89730d9-d167-4916-9dd8-5c8702e8bf7d admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:32.906746 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89730d9-d167-4916-9dd8-5c8702e8bf7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:32.907027 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89730d9-d167-4916-9dd8-5c8702e8bf7d admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:32.907736 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89730d9-d167-4916-9dd8-5c8702e8bf7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:32.909734 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89730d9-d167-4916-9dd8-5c8702e8bf7d admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:33.022063 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1276/2537] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:25:32 2022] POST /identity/v3/users => generated 289 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:25:33.030452 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647b5774-25e9-4ab0-9603-9ac4850dfbe5 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:33.037007 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647b5774-25e9-4ab0-9603-9ac4850dfbe5 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:33.041738 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bfbaa9-a7af-4866-85f1-f216b2a4fa3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:33.042430 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bfbaa9-a7af-4866-85f1-f216b2a4fa3e admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:33.042718 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bfbaa9-a7af-4866-85f1-f216b2a4fa3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:33.042997 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bfbaa9-a7af-4866-85f1-f216b2a4fa3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:33.043718 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bfbaa9-a7af-4866-85f1-f216b2a4fa3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:33.045348 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bfbaa9-a7af-4866-85f1-f216b2a4fa3e admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:33.057126 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1262/2538] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:25:33.061678 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89730d9-d167-4916-9dd8-5c8702e8bf7d admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:33.072642 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89730d9-d167-4916-9dd8-5c8702e8bf7d admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:33.077443 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c9707c-167c-4fc1-8ced-ba8365527e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:33.082374 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c9707c-167c-4fc1-8ced-ba8365527e6f admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:33.082374 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c9707c-167c-4fc1-8ced-ba8365527e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:33.082374 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c9707c-167c-4fc1-8ced-ba8365527e6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:33.082374 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c9707c-167c-4fc1-8ced-ba8365527e6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:33.082374 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c9707c-167c-4fc1-8ced-ba8365527e6f admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:33.092058 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1277/2539] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:25:33.096219 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bfbaa9-a7af-4866-85f1-f216b2a4fa3e admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:33.107025 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bfbaa9-a7af-4866-85f1-f216b2a4fa3e admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:33.111716 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c374f7f-dcb5-4556-a473-723501593638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:33.112681 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c374f7f-dcb5-4556-a473-723501593638 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:33.112970 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c374f7f-dcb5-4556-a473-723501593638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:33.116912 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c374f7f-dcb5-4556-a473-723501593638 admin admin] PATH_INFO: `/v3/projects/4f1970fda3ac4eb2b2234bbdfd2e432b/users/3967ede210ef40d691fe6e19dd747690/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:33.129150 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c374f7f-dcb5-4556-a473-723501593638 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f1970fda3ac4eb2b2234bbdfd2e432b, user_id=3967ede210ef40d691fe6e19dd747690, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:33.132762 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c374f7f-dcb5-4556-a473-723501593638 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:33.262076 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1263/2540] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:25:33 2022] PUT /identity/v3/projects/4f1970fda3ac4eb2b2234bbdfd2e432b/users/3967ede210ef40d691fe6e19dd747690/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:25:33.271987 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57246a4-44f0-4f06-a015-5631f29ce3b2 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:33.272347 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57246a4-44f0-4f06-a015-5631f29ce3b2 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:33.272628 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57246a4-44f0-4f06-a015-5631f29ce3b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:33.300077 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-b57246a4-44f0-4f06-a015-5631f29ce3b2 None None] MFA Rules not processed for user `3967ede210ef40d691fe6e19dd747690`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:25:33.301317 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-b57246a4-44f0-4f06-a015-5631f29ce3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:33.370857 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1278/2541] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:25:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:25:33.375380 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c374f7f-dcb5-4556-a473-723501593638 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:33.453477 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c374f7f-dcb5-4556-a473-723501593638 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:33.461032 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe381af3-35a7-48d6-af52-eedd8e6b09c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:33.461974 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe381af3-35a7-48d6-af52-eedd8e6b09c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:33.462500 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe381af3-35a7-48d6-af52-eedd8e6b09c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:33.462951 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe381af3-35a7-48d6-af52-eedd8e6b09c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:33.463683 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe381af3-35a7-48d6-af52-eedd8e6b09c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:33.466094 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe381af3-35a7-48d6-af52-eedd8e6b09c2 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:33.509805 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57246a4-44f0-4f06-a015-5631f29ce3b2 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:33.512123 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-b57246a4-44f0-4f06-a015-5631f29ce3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:33.587941 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57246a4-44f0-4f06-a015-5631f29ce3b2 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:33.593673 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b7644-7e23-4a16-bf5f-4f277ac8224f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b7ccdccba0b4f9e86817946f22dbe28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:33.594322 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b7644-7e23-4a16-bf5f-4f277ac8224f service nova] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:33.594820 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1264/2542] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:25:33 2022] POST /identity/v3/projects => generated 375 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:25:33.597541 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b7644-7e23-4a16-bf5f-4f277ac8224f service nova] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:33.597961 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b7644-7e23-4a16-bf5f-4f277ac8224f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:33.598596 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe381af3-35a7-48d6-af52-eedd8e6b09c2 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:33.599804 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-997b7644-7e23-4a16-bf5f-4f277ac8224f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:33.659762 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997b7644-7e23-4a16-bf5f-4f277ac8224f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:33.661423 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997b7644-7e23-4a16-bf5f-4f277ac8224f service nova] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:33.671512 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1279/2543] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:25:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:25:33.678195 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe381af3-35a7-48d6-af52-eedd8e6b09c2 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:33.684969 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f703e9-6575-4902-aea4-fdb7819f9d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:33.689168 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f703e9-6575-4902-aea4-fdb7819f9d38 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:33.689168 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f703e9-6575-4902-aea4-fdb7819f9d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:33.689168 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f703e9-6575-4902-aea4-fdb7819f9d38 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:33.689168 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f703e9-6575-4902-aea4-fdb7819f9d38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:33.689168 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f703e9-6575-4902-aea4-fdb7819f9d38 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:33.796857 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b7644-7e23-4a16-bf5f-4f277ac8224f service nova] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:33.798504 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-997b7644-7e23-4a16-bf5f-4f277ac8224f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:33.810257 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1265/2544] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:25:33 2022] POST /identity/v3/users => generated 294 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:25:33.814270 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f703e9-6575-4902-aea4-fdb7819f9d38 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:33.824066 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f703e9-6575-4902-aea4-fdb7819f9d38 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:33.828884 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc57c9-3dbf-49ab-b436-85ef93378c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:33.829538 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc57c9-3dbf-49ab-b436-85ef93378c98 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:33.829826 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc57c9-3dbf-49ab-b436-85ef93378c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:33.830106 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc57c9-3dbf-49ab-b436-85ef93378c98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:33.830843 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabc57c9-3dbf-49ab-b436-85ef93378c98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:33.832540 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabc57c9-3dbf-49ab-b436-85ef93378c98 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:33.842350 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1266/2545] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:25:33.846332 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc57c9-3dbf-49ab-b436-85ef93378c98 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:33.854843 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b7644-7e23-4a16-bf5f-4f277ac8224f service nova] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:33.856280 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc57c9-3dbf-49ab-b436-85ef93378c98 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:33.861147 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf4e6ee-39b4-43eb-9c9a-7cd3e6569a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:33.862125 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf4e6ee-39b4-43eb-9c9a-7cd3e6569a05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:33.862409 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf4e6ee-39b4-43eb-9c9a-7cd3e6569a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:33.862699 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf4e6ee-39b4-43eb-9c9a-7cd3e6569a05 admin admin] PATH_INFO: `/v3/projects/2683800a62924ba9962f27c03b6b2902/users/64f8c223132149c783f330334ee25418/roles/43105000610f402ca2486e7648018cca` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:33.879994 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf4e6ee-39b4-43eb-9c9a-7cd3e6569a05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2683800a62924ba9962f27c03b6b2902, user_id=64f8c223132149c783f330334ee25418, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:33.883271 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf4e6ee-39b4-43eb-9c9a-7cd3e6569a05 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:33.903227 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58af317e-61ee-47e1-9c3a-59cb53d2e932 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:33.903882 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af317e-61ee-47e1-9c3a-59cb53d2e932 service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:33.904214 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af317e-61ee-47e1-9c3a-59cb53d2e932 service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:33.904496 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af317e-61ee-47e1-9c3a-59cb53d2e932 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:33.906328 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-58af317e-61ee-47e1-9c3a-59cb53d2e932 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:33.918836 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58af317e-61ee-47e1-9c3a-59cb53d2e932 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:33.920292 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58af317e-61ee-47e1-9c3a-59cb53d2e932 service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:33.932415 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1280/2546] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:25:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:25:33.958210 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1267/2547] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:25:33 2022] PUT /identity/v3/projects/2683800a62924ba9962f27c03b6b2902/users/64f8c223132149c783f330334ee25418/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:25:33.962745 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58af317e-61ee-47e1-9c3a-59cb53d2e932 service neutron] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:33.972493 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58af317e-61ee-47e1-9c3a-59cb53d2e932 service neutron] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:34.034196 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3196cac-4c42-4ba5-a31a-cae125e7aa50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:34.034820 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3196cac-4c42-4ba5-a31a-cae125e7aa50 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:34.035103 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3196cac-4c42-4ba5-a31a-cae125e7aa50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:34.035375 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3196cac-4c42-4ba5-a31a-cae125e7aa50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:34.036136 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3196cac-4c42-4ba5-a31a-cae125e7aa50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:34.041673 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3196cac-4c42-4ba5-a31a-cae125e7aa50 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:34.051916 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1281/2548] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:25:34.053309 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf4e6ee-39b4-43eb-9c9a-7cd3e6569a05 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:34.063624 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf4e6ee-39b4-43eb-9c9a-7cd3e6569a05 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:34.068254 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22084196-05af-4e0a-97b6-972e1747d1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:34.069135 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22084196-05af-4e0a-97b6-972e1747d1f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:34.069417 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22084196-05af-4e0a-97b6-972e1747d1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:34.069690 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22084196-05af-4e0a-97b6-972e1747d1f2 admin admin] PATH_INFO: `/v3/projects/2683800a62924ba9962f27c03b6b2902/users/64f8c223132149c783f330334ee25418/roles/43105000610f402ca2486e7648018cca` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:34.071654 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22084196-05af-4e0a-97b6-972e1747d1f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2683800a62924ba9962f27c03b6b2902, user_id=64f8c223132149c783f330334ee25418, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:34.074297 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22084196-05af-4e0a-97b6-972e1747d1f2 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:34.085435 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1268/2549] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:25:34 2022] PUT /identity/v3/projects/2683800a62924ba9962f27c03b6b2902/users/64f8c223132149c783f330334ee25418/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:25:34.101893 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c957e8-0d2f-44ba-96a2-9487640b1d50 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:34.102185 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c957e8-0d2f-44ba-96a2-9487640b1d50 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:34.102673 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c957e8-0d2f-44ba-96a2-9487640b1d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:34.130116 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-42c957e8-0d2f-44ba-96a2-9487640b1d50 None None] MFA Rules not processed for user `64f8c223132149c783f330334ee25418`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:25:34.131330 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-42c957e8-0d2f-44ba-96a2-9487640b1d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:34.206969 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1282/2550] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:25:34 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:25:34.219939 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22084196-05af-4e0a-97b6-972e1747d1f2 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:34.221980 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-22084196-05af-4e0a-97b6-972e1747d1f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:34.299207 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c525420-a79d-49f0-ae9b-ec80ee2f4472 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:34.299771 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c525420-a79d-49f0-ae9b-ec80ee2f4472 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:34.300094 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c525420-a79d-49f0-ae9b-ec80ee2f4472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:34.310282 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22084196-05af-4e0a-97b6-972e1747d1f2 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:34.318639 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5f7828-4a53-4678-9295-741d33086555 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:34.319326 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f7828-4a53-4678-9295-741d33086555 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:34.319607 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f7828-4a53-4678-9295-741d33086555 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:34.319882 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f7828-4a53-4678-9295-741d33086555 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:34.336759 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-3c525420-a79d-49f0-ae9b-ec80ee2f4472 None None] MFA Rules not processed for user `285cbf50fac34905b72f620030429585`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:25:34.343275 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-3c525420-a79d-49f0-ae9b-ec80ee2f4472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:34.395756 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5f7828-4a53-4678-9295-741d33086555 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:34.398520 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5f7828-4a53-4678-9295-741d33086555 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:34.413140 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1269/2551] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:25:34 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:25:34.437884 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1283/2552] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:25:34 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:25:34.442479 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5f7828-4a53-4678-9295-741d33086555 service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:34.529672 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5f7828-4a53-4678-9295-741d33086555 service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:34.537053 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e1b22-d969-488e-8864-9b81b6485611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:34.537656 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e1b22-d969-488e-8864-9b81b6485611 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:34.538478 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e1b22-d969-488e-8864-9b81b6485611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:34.538758 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e1b22-d969-488e-8864-9b81b6485611 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:34.539480 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0e1b22-d969-488e-8864-9b81b6485611 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:34.541619 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0e1b22-d969-488e-8864-9b81b6485611 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:34.646336 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1270/2553] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:25:34 2022] POST /identity/v3/projects => generated 371 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:25:34.651073 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c525420-a79d-49f0-ae9b-ec80ee2f4472 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:34.661904 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c525420-a79d-49f0-ae9b-ec80ee2f4472 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:34.719923 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf296858-777b-44aa-aa86-e7120339c32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:34.721157 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf296858-777b-44aa-aa86-e7120339c32c admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:34.721157 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf296858-777b-44aa-aa86-e7120339c32c admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:34.721584 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf296858-777b-44aa-aa86-e7120339c32c admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:34.722319 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf296858-777b-44aa-aa86-e7120339c32c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:34.724377 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf296858-777b-44aa-aa86-e7120339c32c admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:34.841884 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1284/2554] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:25:34 2022] POST /identity/v3/users => generated 292 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:25:34.843087 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e1b22-d969-488e-8864-9b81b6485611 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:34.853543 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e1b22-d969-488e-8864-9b81b6485611 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:34.858060 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdba500-2812-4935-ab89-d4ef100a81f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:34.858746 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdba500-2812-4935-ab89-d4ef100a81f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:34.859036 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdba500-2812-4935-ab89-d4ef100a81f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:34.859368 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdba500-2812-4935-ab89-d4ef100a81f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:34.860288 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdba500-2812-4935-ab89-d4ef100a81f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:34.861884 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdba500-2812-4935-ab89-d4ef100a81f6 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:34.873266 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1271/2555] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:25:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:25:34.877582 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf296858-777b-44aa-aa86-e7120339c32c admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:34.888363 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf296858-777b-44aa-aa86-e7120339c32c admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:34.893072 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa29971-0066-40fa-b824-1b40fefd29a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:34.893913 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa29971-0066-40fa-b824-1b40fefd29a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:34.894180 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa29971-0066-40fa-b824-1b40fefd29a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:34.894455 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa29971-0066-40fa-b824-1b40fefd29a1 admin admin] PATH_INFO: `/v3/projects/16afaff995094343b880950c9362060d/users/4ddac7b9c0ea424fbd05a14ba9a561ac/roles/43105000610f402ca2486e7648018cca` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:34.909956 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa29971-0066-40fa-b824-1b40fefd29a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16afaff995094343b880950c9362060d, user_id=4ddac7b9c0ea424fbd05a14ba9a561ac, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:34.912714 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa29971-0066-40fa-b824-1b40fefd29a1 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:34.991581 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1285/2556] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:25:34 2022] PUT /identity/v3/projects/16afaff995094343b880950c9362060d/users/4ddac7b9c0ea424fbd05a14ba9a561ac/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:25:34.995387 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdba500-2812-4935-ab89-d4ef100a81f6 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:35.006535 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdba500-2812-4935-ab89-d4ef100a81f6 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:35.091365 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1f119c-94c7-4c91-81fe-4a8b6d5d28db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:35.092393 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f119c-94c7-4c91-81fe-4a8b6d5d28db admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:35.092828 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f119c-94c7-4c91-81fe-4a8b6d5d28db admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:35.093258 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f119c-94c7-4c91-81fe-4a8b6d5d28db admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:35.094247 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1f119c-94c7-4c91-81fe-4a8b6d5d28db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:35.096398 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1f119c-94c7-4c91-81fe-4a8b6d5d28db admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:35.113040 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1272/2557] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:25:34 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:25:35.113184 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa29971-0066-40fa-b824-1b40fefd29a1 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:35.124949 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa29971-0066-40fa-b824-1b40fefd29a1 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:35.130443 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6bd49f-1940-46a8-bbff-4d000d39a081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:35.131441 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6bd49f-1940-46a8-bbff-4d000d39a081 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:35.132375 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6bd49f-1940-46a8-bbff-4d000d39a081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:35.132773 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6bd49f-1940-46a8-bbff-4d000d39a081 admin admin] PATH_INFO: `/v3/projects/16afaff995094343b880950c9362060d/users/4ddac7b9c0ea424fbd05a14ba9a561ac/roles/43105000610f402ca2486e7648018cca` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:35.134888 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6bd49f-1940-46a8-bbff-4d000d39a081 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16afaff995094343b880950c9362060d, user_id=4ddac7b9c0ea424fbd05a14ba9a561ac, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:35.137760 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6bd49f-1940-46a8-bbff-4d000d39a081 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:35.168957 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1286/2558] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:25:35 2022] PUT /identity/v3/projects/16afaff995094343b880950c9362060d/users/4ddac7b9c0ea424fbd05a14ba9a561ac/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:25:36.454313 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1f119c-94c7-4c91-81fe-4a8b6d5d28db admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:36.508477 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1f119c-94c7-4c91-81fe-4a8b6d5d28db admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:36.589422 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593962c9-06e5-4e71-9d4e-6b9fbb9115d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:36.590168 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593962c9-06e5-4e71-9d4e-6b9fbb9115d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:36.590557 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593962c9-06e5-4e71-9d4e-6b9fbb9115d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:36.591132 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593962c9-06e5-4e71-9d4e-6b9fbb9115d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:36.667443 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536feec8-9f84-4463-8427-7eee0b86d3c5 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:36.668409 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536feec8-9f84-4463-8427-7eee0b86d3c5 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:36.668864 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536feec8-9f84-4463-8427-7eee0b86d3c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:36.718580 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593962c9-06e5-4e71-9d4e-6b9fbb9115d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:36.720700 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593962c9-06e5-4e71-9d4e-6b9fbb9115d6 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:36.722609 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-536feec8-9f84-4463-8427-7eee0b86d3c5 None None] MFA Rules not processed for user `4ddac7b9c0ea424fbd05a14ba9a561ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:25:36.725576 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-536feec8-9f84-4463-8427-7eee0b86d3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:36.753558 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1273/2559] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:25:36 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:25:36.858868 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1287/2560] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:25:36 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:25:36.871589 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3d6f1-1b40-4239-a456-59b874812596 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:36.871927 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3d6f1-1b40-4239-a456-59b874812596 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:36.872273 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3d6f1-1b40-4239-a456-59b874812596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:36.891064 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-3da3d6f1-1b40-4239-a456-59b874812596 None None] MFA Rules not processed for user `285cbf50fac34905b72f620030429585`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:25:36.892330 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-3da3d6f1-1b40-4239-a456-59b874812596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:36.963180 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1274/2561] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:25:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:25:36.982833 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536feec8-9f84-4463-8427-7eee0b86d3c5 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:36.985245 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-536feec8-9f84-4463-8427-7eee0b86d3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:37.115167 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536feec8-9f84-4463-8427-7eee0b86d3c5 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:37.123915 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429e74a9-d9f2-4974-89f6-51c688d1fcab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b7ccdccba0b4f9e86817946f22dbe28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:37.124850 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e74a9-d9f2-4974-89f6-51c688d1fcab service nova] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:37.125256 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e74a9-d9f2-4974-89f6-51c688d1fcab service nova] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:37.125633 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e74a9-d9f2-4974-89f6-51c688d1fcab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:37.140697 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429e74a9-d9f2-4974-89f6-51c688d1fcab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:37.143132 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429e74a9-d9f2-4974-89f6-51c688d1fcab service nova] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:37.163507 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1288/2562] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:25:36 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:25:37.463695 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da3d6f1-1b40-4239-a456-59b874812596 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:37.553072 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da3d6f1-1b40-4239-a456-59b874812596 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:37.557516 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe858a4-f6e5-447b-89ae-1bfe6a1c2342 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:37.558459 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe858a4-f6e5-447b-89ae-1bfe6a1c2342 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:37.558893 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe858a4-f6e5-447b-89ae-1bfe6a1c2342 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:37.559440 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe858a4-f6e5-447b-89ae-1bfe6a1c2342 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:37.562449 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-5fe858a4-f6e5-447b-89ae-1bfe6a1c2342 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:37.578222 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe858a4-f6e5-447b-89ae-1bfe6a1c2342 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:37.579986 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe858a4-f6e5-447b-89ae-1bfe6a1c2342 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:37.590952 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1275/2563] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:25:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:25:38.635194 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429e74a9-d9f2-4974-89f6-51c688d1fcab service nova] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:38.653031 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429e74a9-d9f2-4974-89f6-51c688d1fcab service nova] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:38.657806 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f761c81-f2f9-49b7-8db4-6fe7678f16a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:38.658465 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f761c81-f2f9-49b7-8db4-6fe7678f16a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:38.658754 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f761c81-f2f9-49b7-8db4-6fe7678f16a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:38.659034 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f761c81-f2f9-49b7-8db4-6fe7678f16a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:38.731878 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f761c81-f2f9-49b7-8db4-6fe7678f16a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:38.733284 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f761c81-f2f9-49b7-8db4-6fe7678f16a6 service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:38.744335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1289/2564] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:25:38 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:25:42.838565 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe858a4-f6e5-447b-89ae-1bfe6a1c2342 service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:42.840031 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-5fe858a4-f6e5-447b-89ae-1bfe6a1c2342 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:42.925494 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe858a4-f6e5-447b-89ae-1bfe6a1c2342 service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:42.930734 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5872c2-7a90-4c9b-a407-83e9d7c6ea49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:42.932239 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5872c2-7a90-4c9b-a407-83e9d7c6ea49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:42.932651 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5872c2-7a90-4c9b-a407-83e9d7c6ea49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:42.933004 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5872c2-7a90-4c9b-a407-83e9d7c6ea49 admin admin] PATH_INFO: `/v3/users/a49b27f57e9049518e157d39f6901bd7` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:42.934140 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5872c2-7a90-4c9b-a407-83e9d7c6ea49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a49b27f57e9049518e157d39f6901bd7)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:42.936107 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5872c2-7a90-4c9b-a407-83e9d7c6ea49 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:43.120593 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2f5872c2-7a90-4c9b-a407-83e9d7c6ea49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a49b27f57e9049518e157d39f6901bd7'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:43.121351 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2f5872c2-7a90-4c9b-a407-83e9d7c6ea49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a49b27f57e9049518e157d39f6901bd7'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:43.128063 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2f5872c2-7a90-4c9b-a407-83e9d7c6ea49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a49b27f57e9049518e157d39f6901bd7'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:43.198367 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2f5872c2-7a90-4c9b-a407-83e9d7c6ea49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a49b27f57e9049518e157d39f6901bd7'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:43.199069 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2f5872c2-7a90-4c9b-a407-83e9d7c6ea49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a49b27f57e9049518e157d39f6901bd7'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:43.217250 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1276/2565] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:25:42 2022] DELETE /identity/v3/users/a49b27f57e9049518e157d39f6901bd7 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:25:43.554621 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f761c81-f2f9-49b7-8db4-6fe7678f16a6 service cinder] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:43.571831 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f761c81-f2f9-49b7-8db4-6fe7678f16a6 service cinder] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:43.627829 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad028e-4707-4098-8707-ea5546eaf100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:43.628713 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad028e-4707-4098-8707-ea5546eaf100 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:43.629012 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad028e-4707-4098-8707-ea5546eaf100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:43.629280 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad028e-4707-4098-8707-ea5546eaf100 admin admin] PATH_INFO: `/v3/projects/4524e2de8e8e4dbfa1cb85515dbeb90a` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:43.630467 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bad028e-4707-4098-8707-ea5546eaf100 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4524e2de8e8e4dbfa1cb85515dbeb90a)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:43.633388 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bad028e-4707-4098-8707-ea5546eaf100 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:43.730515 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5872c2-7a90-4c9b-a407-83e9d7c6ea49 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:43.731940 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-2f5872c2-7a90-4c9b-a407-83e9d7c6ea49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:43.732271 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-0bad028e-4707-4098-8707-ea5546eaf100 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4524e2de8e8e4dbfa1cb85515dbeb90a', 'request_id': 'req-0bad028e-4707-4098-8707-ea5546eaf100'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:43.737748 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-0bad028e-4707-4098-8707-ea5546eaf100 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4524e2de8e8e4dbfa1cb85515dbeb90a', 'request_id': 'req-0bad028e-4707-4098-8707-ea5546eaf100'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:43.745477 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-0bad028e-4707-4098-8707-ea5546eaf100 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4524e2de8e8e4dbfa1cb85515dbeb90a', 'request_id': 'req-0bad028e-4707-4098-8707-ea5546eaf100'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:43.745622 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5872c2-7a90-4c9b-a407-83e9d7c6ea49 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:43.801819 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3985590-b847-4882-b8b3-4e9b7e5c9061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:43.802771 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3985590-b847-4882-b8b3-4e9b7e5c9061 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:43.803057 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3985590-b847-4882-b8b3-4e9b7e5c9061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:43.803341 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3985590-b847-4882-b8b3-4e9b7e5c9061 admin admin] PATH_INFO: `/v3/users/27871c6559fe4fe58d8622cc2ceb0f53` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:43.805110 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3985590-b847-4882-b8b3-4e9b7e5c9061 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27871c6559fe4fe58d8622cc2ceb0f53)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:43.807031 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3985590-b847-4882-b8b3-4e9b7e5c9061 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:43.816349 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-0bad028e-4707-4098-8707-ea5546eaf100 admin admin] The token cache is being invalidate because project 4524e2de8e8e4dbfa1cb85515dbeb90a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:25:43.817054 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-0bad028e-4707-4098-8707-ea5546eaf100 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:43.820485 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-0bad028e-4707-4098-8707-ea5546eaf100 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:43.826341 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1290/2566] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:25:43 2022] DELETE /identity/v3/projects/4524e2de8e8e4dbfa1cb85515dbeb90a => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:25:43.829322 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad028e-4707-4098-8707-ea5546eaf100 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:43.831148 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-0bad028e-4707-4098-8707-ea5546eaf100 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:43.846349 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad028e-4707-4098-8707-ea5546eaf100 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:43.851628 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02055e4-b1f0-49a2-976b-d68be05ffb9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:43.852559 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02055e4-b1f0-49a2-976b-d68be05ffb9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:43.856865 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02055e4-b1f0-49a2-976b-d68be05ffb9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:43.856865 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02055e4-b1f0-49a2-976b-d68be05ffb9b admin admin] PATH_INFO: `/v3/users/d0a7ce96f7f545319669312c8f4590e3` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:43.856865 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02055e4-b1f0-49a2-976b-d68be05ffb9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0a7ce96f7f545319669312c8f4590e3)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:43.856865 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02055e4-b1f0-49a2-976b-d68be05ffb9b admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:44.006450 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f3985590-b847-4882-b8b3-4e9b7e5c9061 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27871c6559fe4fe58d8622cc2ceb0f53'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:44.007259 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f3985590-b847-4882-b8b3-4e9b7e5c9061 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27871c6559fe4fe58d8622cc2ceb0f53'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:44.015203 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f3985590-b847-4882-b8b3-4e9b7e5c9061 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27871c6559fe4fe58d8622cc2ceb0f53'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:44.078771 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f3985590-b847-4882-b8b3-4e9b7e5c9061 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27871c6559fe4fe58d8622cc2ceb0f53'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:44.080269 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f3985590-b847-4882-b8b3-4e9b7e5c9061 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27871c6559fe4fe58d8622cc2ceb0f53'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:44.098998 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-b02055e4-b1f0-49a2-976b-d68be05ffb9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0a7ce96f7f545319669312c8f4590e3'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:44.105403 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1277/2567] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:25:43 2022] DELETE /identity/v3/users/27871c6559fe4fe58d8622cc2ceb0f53 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:25:44.106827 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-b02055e4-b1f0-49a2-976b-d68be05ffb9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0a7ce96f7f545319669312c8f4590e3'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:44.111061 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180137a9-6e6e-4da2-916b-7f65c948edee None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:44.111357 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180137a9-6e6e-4da2-916b-7f65c948edee None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:44.111641 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180137a9-6e6e-4da2-916b-7f65c948edee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:44.118707 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-b02055e4-b1f0-49a2-976b-d68be05ffb9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0a7ce96f7f545319669312c8f4590e3'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:44.119403 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-b02055e4-b1f0-49a2-976b-d68be05ffb9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0a7ce96f7f545319669312c8f4590e3'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:44.120041 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-b02055e4-b1f0-49a2-976b-d68be05ffb9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0a7ce96f7f545319669312c8f4590e3'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:44.128590 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-180137a9-6e6e-4da2-916b-7f65c948edee None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:25:44.129794 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-180137a9-6e6e-4da2-916b-7f65c948edee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:44.188393 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1278/2568] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:25:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:25:44.198680 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180137a9-6e6e-4da2-916b-7f65c948edee None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:44.200079 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-180137a9-6e6e-4da2-916b-7f65c948edee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:44.237693 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1291/2569] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:25:43 2022] DELETE /identity/v3/users/d0a7ce96f7f545319669312c8f4590e3 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:25:44.257362 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180137a9-6e6e-4da2-916b-7f65c948edee None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:44.305607 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084c7d8-c333-4af2-a9b4-67e55080fceb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:44.306315 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084c7d8-c333-4af2-a9b4-67e55080fceb service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:44.306606 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084c7d8-c333-4af2-a9b4-67e55080fceb service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:44.306880 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084c7d8-c333-4af2-a9b4-67e55080fceb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:44.367720 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c084c7d8-c333-4af2-a9b4-67e55080fceb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:44.369571 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c084c7d8-c333-4af2-a9b4-67e55080fceb service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:44.387117 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1279/2570] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:25:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:25:44.497151 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02055e4-b1f0-49a2-976b-d68be05ffb9b admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:44.498633 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-b02055e4-b1f0-49a2-976b-d68be05ffb9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:44.514331 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02055e4-b1f0-49a2-976b-d68be05ffb9b admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:44.522948 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5440f60-f1c9-41d4-a9c9-e66e40708719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:44.522948 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5440f60-f1c9-41d4-a9c9-e66e40708719 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:44.524169 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5440f60-f1c9-41d4-a9c9-e66e40708719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:44.524593 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5440f60-f1c9-41d4-a9c9-e66e40708719 admin admin] PATH_INFO: `/v3/projects/42abd48bea644edbb8241cc544fa58a9` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:44.525790 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5440f60-f1c9-41d4-a9c9-e66e40708719 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42abd48bea644edbb8241cc544fa58a9)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:44.527909 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5440f60-f1c9-41d4-a9c9-e66e40708719 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:44.635801 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-e5440f60-f1c9-41d4-a9c9-e66e40708719 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42abd48bea644edbb8241cc544fa58a9', 'request_id': 'req-e5440f60-f1c9-41d4-a9c9-e66e40708719'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:44.640839 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-e5440f60-f1c9-41d4-a9c9-e66e40708719 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42abd48bea644edbb8241cc544fa58a9', 'request_id': 'req-e5440f60-f1c9-41d4-a9c9-e66e40708719'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:44.648120 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-e5440f60-f1c9-41d4-a9c9-e66e40708719 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42abd48bea644edbb8241cc544fa58a9', 'request_id': 'req-e5440f60-f1c9-41d4-a9c9-e66e40708719'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:44.723558 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-e5440f60-f1c9-41d4-a9c9-e66e40708719 admin admin] The token cache is being invalidate because project 42abd48bea644edbb8241cc544fa58a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:25:44.724017 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-e5440f60-f1c9-41d4-a9c9-e66e40708719 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:44.724653 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-e5440f60-f1c9-41d4-a9c9-e66e40708719 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:44.726793 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1292/2571] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:25:44 2022] DELETE /identity/v3/projects/42abd48bea644edbb8241cc544fa58a9 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:25:44.823417 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084c7d8-c333-4af2-a9b4-67e55080fceb service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:44.825033 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-c084c7d8-c333-4af2-a9b4-67e55080fceb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:44.841597 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084c7d8-c333-4af2-a9b4-67e55080fceb service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:44.904478 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50772927-cb33-48e0-af84-29948fe8bf8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:44.905370 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50772927-cb33-48e0-af84-29948fe8bf8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:44.905658 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50772927-cb33-48e0-af84-29948fe8bf8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:44.905936 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50772927-cb33-48e0-af84-29948fe8bf8b admin admin] PATH_INFO: `/v3/projects/7e6cd03f96804841a163744f10cd6c3d` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:44.907197 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50772927-cb33-48e0-af84-29948fe8bf8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e6cd03f96804841a163744f10cd6c3d)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:44.909205 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50772927-cb33-48e0-af84-29948fe8bf8b admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:45.016208 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-50772927-cb33-48e0-af84-29948fe8bf8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e6cd03f96804841a163744f10cd6c3d', 'request_id': 'req-50772927-cb33-48e0-af84-29948fe8bf8b'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:45.021739 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-50772927-cb33-48e0-af84-29948fe8bf8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e6cd03f96804841a163744f10cd6c3d', 'request_id': 'req-50772927-cb33-48e0-af84-29948fe8bf8b'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:45.028957 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-50772927-cb33-48e0-af84-29948fe8bf8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e6cd03f96804841a163744f10cd6c3d', 'request_id': 'req-50772927-cb33-48e0-af84-29948fe8bf8b'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:45.129392 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-50772927-cb33-48e0-af84-29948fe8bf8b admin admin] The token cache is being invalidate because project 7e6cd03f96804841a163744f10cd6c3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:25:45.129684 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-50772927-cb33-48e0-af84-29948fe8bf8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:45.130305 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-50772927-cb33-48e0-af84-29948fe8bf8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:45.131915 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1280/2572] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:25:44 2022] DELETE /identity/v3/projects/7e6cd03f96804841a163744f10cd6c3d => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:25:45.136062 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5440f60-f1c9-41d4-a9c9-e66e40708719 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:45.137434 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-e5440f60-f1c9-41d4-a9c9-e66e40708719 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:45.150180 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5440f60-f1c9-41d4-a9c9-e66e40708719 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:45.206129 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b051dee6-61c8-441f-92e9-cb6d35823198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:45.206998 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051dee6-61c8-441f-92e9-cb6d35823198 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:45.207281 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051dee6-61c8-441f-92e9-cb6d35823198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:45.207557 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051dee6-61c8-441f-92e9-cb6d35823198 admin admin] PATH_INFO: `/v3/users/3967ede210ef40d691fe6e19dd747690` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:45.208796 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b051dee6-61c8-441f-92e9-cb6d35823198 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3967ede210ef40d691fe6e19dd747690)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:45.211349 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b051dee6-61c8-441f-92e9-cb6d35823198 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:45.376713 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-b051dee6-61c8-441f-92e9-cb6d35823198 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3967ede210ef40d691fe6e19dd747690'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:45.383981 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-b051dee6-61c8-441f-92e9-cb6d35823198 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3967ede210ef40d691fe6e19dd747690'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:45.395318 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-b051dee6-61c8-441f-92e9-cb6d35823198 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3967ede210ef40d691fe6e19dd747690'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:45.395985 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-b051dee6-61c8-441f-92e9-cb6d35823198 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3967ede210ef40d691fe6e19dd747690'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:45.396620 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-b051dee6-61c8-441f-92e9-cb6d35823198 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3967ede210ef40d691fe6e19dd747690'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:45.483484 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1293/2573] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:25:45 2022] DELETE /identity/v3/users/3967ede210ef40d691fe6e19dd747690 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:25:45.908316 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50772927-cb33-48e0-af84-29948fe8bf8b admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:45.909738 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-50772927-cb33-48e0-af84-29948fe8bf8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:45.925596 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50772927-cb33-48e0-af84-29948fe8bf8b admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:45.982008 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaad562-53de-4a4c-a8c6-6c5d8307bdea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:45.982870 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaad562-53de-4a4c-a8c6-6c5d8307bdea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:45.983150 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaad562-53de-4a4c-a8c6-6c5d8307bdea admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:45.983421 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaad562-53de-4a4c-a8c6-6c5d8307bdea admin admin] PATH_INFO: `/v3/projects/4f1970fda3ac4eb2b2234bbdfd2e432b` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:45.984660 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaad562-53de-4a4c-a8c6-6c5d8307bdea admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f1970fda3ac4eb2b2234bbdfd2e432b)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:45.986565 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaad562-53de-4a4c-a8c6-6c5d8307bdea admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:46.095528 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-ffaad562-53de-4a4c-a8c6-6c5d8307bdea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f1970fda3ac4eb2b2234bbdfd2e432b', 'request_id': 'req-ffaad562-53de-4a4c-a8c6-6c5d8307bdea'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:46.101632 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-ffaad562-53de-4a4c-a8c6-6c5d8307bdea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f1970fda3ac4eb2b2234bbdfd2e432b', 'request_id': 'req-ffaad562-53de-4a4c-a8c6-6c5d8307bdea'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:46.111962 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-ffaad562-53de-4a4c-a8c6-6c5d8307bdea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f1970fda3ac4eb2b2234bbdfd2e432b', 'request_id': 'req-ffaad562-53de-4a4c-a8c6-6c5d8307bdea'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:46.197693 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-ffaad562-53de-4a4c-a8c6-6c5d8307bdea admin admin] The token cache is being invalidate because project 4f1970fda3ac4eb2b2234bbdfd2e432b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:25:46.203682 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-ffaad562-53de-4a4c-a8c6-6c5d8307bdea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:46.203682 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-ffaad562-53de-4a4c-a8c6-6c5d8307bdea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:46.203682 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1281/2574] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:25:45 2022] DELETE /identity/v3/projects/4f1970fda3ac4eb2b2234bbdfd2e432b => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:25:46.204932 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b051dee6-61c8-441f-92e9-cb6d35823198 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:46.206408 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-b051dee6-61c8-441f-92e9-cb6d35823198 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:46.236344 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b051dee6-61c8-441f-92e9-cb6d35823198 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:46.302626 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291a0941-0747-49a3-b957-cc52500e5886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:46.303564 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a0941-0747-49a3-b957-cc52500e5886 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:46.303853 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a0941-0747-49a3-b957-cc52500e5886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:46.304176 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a0941-0747-49a3-b957-cc52500e5886 admin admin] PATH_INFO: `/v3/users/64f8c223132149c783f330334ee25418` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:46.305708 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291a0941-0747-49a3-b957-cc52500e5886 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64f8c223132149c783f330334ee25418)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:46.307852 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291a0941-0747-49a3-b957-cc52500e5886 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:46.459514 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-291a0941-0747-49a3-b957-cc52500e5886 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64f8c223132149c783f330334ee25418'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:46.468392 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-291a0941-0747-49a3-b957-cc52500e5886 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64f8c223132149c783f330334ee25418'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:46.479718 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-291a0941-0747-49a3-b957-cc52500e5886 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64f8c223132149c783f330334ee25418'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:46.480426 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-291a0941-0747-49a3-b957-cc52500e5886 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64f8c223132149c783f330334ee25418'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:46.481034 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-291a0941-0747-49a3-b957-cc52500e5886 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64f8c223132149c783f330334ee25418'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:46.563218 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1294/2575] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:25:46 2022] DELETE /identity/v3/users/64f8c223132149c783f330334ee25418 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:25:46.941823 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaad562-53de-4a4c-a8c6-6c5d8307bdea admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:46.943838 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-ffaad562-53de-4a4c-a8c6-6c5d8307bdea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:46.957257 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaad562-53de-4a4c-a8c6-6c5d8307bdea admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:47.014258 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf589c-a2d2-4919-a0d4-e2c91d21daf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:47.015157 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf589c-a2d2-4919-a0d4-e2c91d21daf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:47.015440 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf589c-a2d2-4919-a0d4-e2c91d21daf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:47.015716 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf589c-a2d2-4919-a0d4-e2c91d21daf5 admin admin] PATH_INFO: `/v3/projects/2683800a62924ba9962f27c03b6b2902` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:47.016996 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdf589c-a2d2-4919-a0d4-e2c91d21daf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2683800a62924ba9962f27c03b6b2902)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:47.018935 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdf589c-a2d2-4919-a0d4-e2c91d21daf5 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:47.123837 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8cdf589c-a2d2-4919-a0d4-e2c91d21daf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2683800a62924ba9962f27c03b6b2902', 'request_id': 'req-8cdf589c-a2d2-4919-a0d4-e2c91d21daf5'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:47.129173 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8cdf589c-a2d2-4919-a0d4-e2c91d21daf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2683800a62924ba9962f27c03b6b2902', 'request_id': 'req-8cdf589c-a2d2-4919-a0d4-e2c91d21daf5'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:47.136818 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8cdf589c-a2d2-4919-a0d4-e2c91d21daf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2683800a62924ba9962f27c03b6b2902', 'request_id': 'req-8cdf589c-a2d2-4919-a0d4-e2c91d21daf5'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:47.230427 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8cdf589c-a2d2-4919-a0d4-e2c91d21daf5 admin admin] The token cache is being invalidate because project 2683800a62924ba9962f27c03b6b2902 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:25:47.230427 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8cdf589c-a2d2-4919-a0d4-e2c91d21daf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:47.230427 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8cdf589c-a2d2-4919-a0d4-e2c91d21daf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:47.230427 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1282/2576] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:25:46 2022] DELETE /identity/v3/projects/2683800a62924ba9962f27c03b6b2902 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:25:47.234107 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec66b4e-5f01-47b1-96a7-a96050f80c1a None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:47.234581 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec66b4e-5f01-47b1-96a7-a96050f80c1a None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:47.234710 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec66b4e-5f01-47b1-96a7-a96050f80c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:47.253416 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-7ec66b4e-5f01-47b1-96a7-a96050f80c1a None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:25:47.254617 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-7ec66b4e-5f01-47b1-96a7-a96050f80c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:47.325485 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1295/2577] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:25:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:25:47.395846 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae2dbb-7d12-43ac-a976-80e4136b30ad None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:47.396167 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae2dbb-7d12-43ac-a976-80e4136b30ad None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:47.396449 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae2dbb-7d12-43ac-a976-80e4136b30ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:47.416633 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-e3ae2dbb-7d12-43ac-a976-80e4136b30ad None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:25:47.417829 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-e3ae2dbb-7d12-43ac-a976-80e4136b30ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:47.426745 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1283/2578] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:25:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:25:47.431675 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec66b4e-5f01-47b1-96a7-a96050f80c1a None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:47.441179 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec66b4e-5f01-47b1-96a7-a96050f80c1a None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:47.446012 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0c4e6f-8085-4e90-86c9-1a1a03718d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:47.446673 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c4e6f-8085-4e90-86c9-1a1a03718d5c admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:47.446957 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c4e6f-8085-4e90-86c9-1a1a03718d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:47.447231 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c4e6f-8085-4e90-86c9-1a1a03718d5c admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:47.447956 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0c4e6f-8085-4e90-86c9-1a1a03718d5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:25:47.448297 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0c4e6f-8085-4e90-86c9-1a1a03718d5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:47.449876 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0c4e6f-8085-4e90-86c9-1a1a03718d5c admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:47.462541 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1296/2579] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 10 03:25:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:25:47.466942 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae2dbb-7d12-43ac-a976-80e4136b30ad None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:47.477091 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae2dbb-7d12-43ac-a976-80e4136b30ad None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:47.483741 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a5ea5e-161b-4dc6-ad2a-9a0bb4f4bd85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:47.483741 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a5ea5e-161b-4dc6-ad2a-9a0bb4f4bd85 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:47.483741 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a5ea5e-161b-4dc6-ad2a-9a0bb4f4bd85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:47.483741 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a5ea5e-161b-4dc6-ad2a-9a0bb4f4bd85 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:47.484254 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a5ea5e-161b-4dc6-ad2a-9a0bb4f4bd85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:47.485665 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a5ea5e-161b-4dc6-ad2a-9a0bb4f4bd85 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:47.548317 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1284/2580] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:25:47 2022] POST /identity/v3/projects => generated 383 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:25:47.552586 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0c4e6f-8085-4e90-86c9-1a1a03718d5c admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:47.562664 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0c4e6f-8085-4e90-86c9-1a1a03718d5c admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:47.617551 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf75206-6cbc-4215-a70a-af992dafd0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:47.618216 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf75206-6cbc-4215-a70a-af992dafd0a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:47.618508 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf75206-6cbc-4215-a70a-af992dafd0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:47.618784 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf75206-6cbc-4215-a70a-af992dafd0a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:47.619479 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf75206-6cbc-4215-a70a-af992dafd0a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:47.621469 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf75206-6cbc-4215-a70a-af992dafd0a6 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:47.689456 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1297/2581] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:25:47 2022] POST /identity/v3/users => generated 292 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:25:47.693763 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a5ea5e-161b-4dc6-ad2a-9a0bb4f4bd85 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:47.703869 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a5ea5e-161b-4dc6-ad2a-9a0bb4f4bd85 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:47.708545 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e0e94-c7eb-4a74-a195-90a5429bd66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:47.709194 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e0e94-c7eb-4a74-a195-90a5429bd66d admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:47.709473 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e0e94-c7eb-4a74-a195-90a5429bd66d admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:47.710259 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e0e94-c7eb-4a74-a195-90a5429bd66d admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:47.710992 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8e0e94-c7eb-4a74-a195-90a5429bd66d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:47.712641 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8e0e94-c7eb-4a74-a195-90a5429bd66d admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:47.722691 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1285/2582] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:25:47.727081 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf75206-6cbc-4215-a70a-af992dafd0a6 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:47.737892 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf75206-6cbc-4215-a70a-af992dafd0a6 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:47.742229 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f992ae9-7dda-4cce-9388-bf85dbfad492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:47.742914 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f992ae9-7dda-4cce-9388-bf85dbfad492 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:47.743204 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f992ae9-7dda-4cce-9388-bf85dbfad492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:47.743486 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f992ae9-7dda-4cce-9388-bf85dbfad492 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:47.744240 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f992ae9-7dda-4cce-9388-bf85dbfad492 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:47.745908 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f992ae9-7dda-4cce-9388-bf85dbfad492 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:47.756177 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1298/2583] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:25:47.760163 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e0e94-c7eb-4a74-a195-90a5429bd66d admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:47.770058 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e0e94-c7eb-4a74-a195-90a5429bd66d admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:47.775232 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c2cd4-09fc-4059-96eb-6b211fa923bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:47.776305 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c2cd4-09fc-4059-96eb-6b211fa923bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:47.776427 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c2cd4-09fc-4059-96eb-6b211fa923bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:47.776687 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c2cd4-09fc-4059-96eb-6b211fa923bd admin admin] PATH_INFO: `/v3/projects/f3186bec57c94e2f84ae52cae506dbc2/users/f43ec3800caa42ed9a4fcf3405ef3d5e/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:47.791551 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551c2cd4-09fc-4059-96eb-6b211fa923bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3186bec57c94e2f84ae52cae506dbc2, user_id=f43ec3800caa42ed9a4fcf3405ef3d5e, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:47.794209 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551c2cd4-09fc-4059-96eb-6b211fa923bd admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:47.902005 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1286/2584] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:25:47 2022] PUT /identity/v3/projects/f3186bec57c94e2f84ae52cae506dbc2/users/f43ec3800caa42ed9a4fcf3405ef3d5e/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:25:47.907156 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90caee1-8a0d-4342-9c0b-dd44cb595d45 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:47.907523 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90caee1-8a0d-4342-9c0b-dd44cb595d45 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:47.907805 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90caee1-8a0d-4342-9c0b-dd44cb595d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:47.925571 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-f90caee1-8a0d-4342-9c0b-dd44cb595d45 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:25:47.926768 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-f90caee1-8a0d-4342-9c0b-dd44cb595d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:47.982776 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1299/2585] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:25:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:25:47.997591 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c2cd4-09fc-4059-96eb-6b211fa923bd admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:47.997591 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-551c2cd4-09fc-4059-96eb-6b211fa923bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:48.049517 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c2cd4-09fc-4059-96eb-6b211fa923bd admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:48.053172 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db697f0-9523-4790-baf8-1e8d1fd55ca4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:48.053859 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db697f0-9523-4790-baf8-1e8d1fd55ca4 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:48.054204 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db697f0-9523-4790-baf8-1e8d1fd55ca4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:48.054484 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db697f0-9523-4790-baf8-1e8d1fd55ca4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:48.063663 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db697f0-9523-4790-baf8-1e8d1fd55ca4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:48.066391 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db697f0-9523-4790-baf8-1e8d1fd55ca4 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:48.075128 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1287/2586] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:25:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:25:49.211178 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4169643-7c4a-4e4e-973d-e64c5122c58b None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:49.211676 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4169643-7c4a-4e4e-973d-e64c5122c58b None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:49.211768 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4169643-7c4a-4e4e-973d-e64c5122c58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:49.243550 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-b4169643-7c4a-4e4e-973d-e64c5122c58b None None] MFA Rules not processed for user `f43ec3800caa42ed9a4fcf3405ef3d5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:25:49.245031 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-b4169643-7c4a-4e4e-973d-e64c5122c58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:49.352070 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1300/2587] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:25:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:25:49.362786 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db697f0-9523-4790-baf8-1e8d1fd55ca4 service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:49.364337 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-6db697f0-9523-4790-baf8-1e8d1fd55ca4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:49.432914 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db697f0-9523-4790-baf8-1e8d1fd55ca4 service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:49.436605 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d71af5-ab65-49b3-8f9b-6d84fe6eeb42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:49.437264 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d71af5-ab65-49b3-8f9b-6d84fe6eeb42 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:49.437552 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d71af5-ab65-49b3-8f9b-6d84fe6eeb42 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:49.437835 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d71af5-ab65-49b3-8f9b-6d84fe6eeb42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:49.446781 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d71af5-ab65-49b3-8f9b-6d84fe6eeb42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:49.448281 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d71af5-ab65-49b3-8f9b-6d84fe6eeb42 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:49.458216 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1288/2588] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:25:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:25:51.232026 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84400a30-d656-4f85-8eaa-be23ef5d3fc3 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:51.232559 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84400a30-d656-4f85-8eaa-be23ef5d3fc3 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:51.232677 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84400a30-d656-4f85-8eaa-be23ef5d3fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:51.250224 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-84400a30-d656-4f85-8eaa-be23ef5d3fc3 None None] MFA Rules not processed for user `f43ec3800caa42ed9a4fcf3405ef3d5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:25:51.251415 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-84400a30-d656-4f85-8eaa-be23ef5d3fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:51.258236 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1301/2589] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:25:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:25:51.497201 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d71af5-ab65-49b3-8f9b-6d84fe6eeb42 service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:51.506658 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d71af5-ab65-49b3-8f9b-6d84fe6eeb42 service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:51.511124 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df0c6b-d0a4-4a9e-9692-f4eaa2316c5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:51.511740 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df0c6b-d0a4-4a9e-9692-f4eaa2316c5f service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:51.512081 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df0c6b-d0a4-4a9e-9692-f4eaa2316c5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:51.512359 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df0c6b-d0a4-4a9e-9692-f4eaa2316c5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:51.514138 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-f6df0c6b-d0a4-4a9e-9692-f4eaa2316c5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:51.524140 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6df0c6b-d0a4-4a9e-9692-f4eaa2316c5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:51.525586 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6df0c6b-d0a4-4a9e-9692-f4eaa2316c5f service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:51.534548 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1289/2590] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:25:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:25:52.422617 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84400a30-d656-4f85-8eaa-be23ef5d3fc3 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:52.425317 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-84400a30-d656-4f85-8eaa-be23ef5d3fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:52.439493 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84400a30-d656-4f85-8eaa-be23ef5d3fc3 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:52.444185 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d8f122-9aff-4c14-a43e-0bf5718f6149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:52.445050 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8f122-9aff-4c14-a43e-0bf5718f6149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:52.445451 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8f122-9aff-4c14-a43e-0bf5718f6149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:52.445597 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8f122-9aff-4c14-a43e-0bf5718f6149 admin admin] PATH_INFO: `/v3/users/e95373add6a64bc6aa2225f3b7956fc6` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:52.446794 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d8f122-9aff-4c14-a43e-0bf5718f6149 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e95373add6a64bc6aa2225f3b7956fc6)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:52.449782 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d8f122-9aff-4c14-a43e-0bf5718f6149 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:52.595672 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-c1d8f122-9aff-4c14-a43e-0bf5718f6149 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e95373add6a64bc6aa2225f3b7956fc6'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:52.603200 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-c1d8f122-9aff-4c14-a43e-0bf5718f6149 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e95373add6a64bc6aa2225f3b7956fc6'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:52.616132 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-c1d8f122-9aff-4c14-a43e-0bf5718f6149 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e95373add6a64bc6aa2225f3b7956fc6'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:52.616870 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-c1d8f122-9aff-4c14-a43e-0bf5718f6149 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e95373add6a64bc6aa2225f3b7956fc6'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:52.617482 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-c1d8f122-9aff-4c14-a43e-0bf5718f6149 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e95373add6a64bc6aa2225f3b7956fc6'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:52.666440 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1302/2591] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:25:52 2022] DELETE /identity/v3/users/e95373add6a64bc6aa2225f3b7956fc6 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:25:52.671278 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9bba8-c1c4-40fa-972f-2a144181a9b6 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:52.671743 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9bba8-c1c4-40fa-972f-2a144181a9b6 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:52.671854 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9bba8-c1c4-40fa-972f-2a144181a9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:52.689422 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-78f9bba8-c1c4-40fa-972f-2a144181a9b6 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:25:52.690632 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-78f9bba8-c1c4-40fa-972f-2a144181a9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:52.748019 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1290/2592] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:25:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:25:52.758653 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d8f122-9aff-4c14-a43e-0bf5718f6149 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:52.760185 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-c1d8f122-9aff-4c14-a43e-0bf5718f6149 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:52.818064 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d8f122-9aff-4c14-a43e-0bf5718f6149 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:52.821757 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0486bb0-e8a5-423a-b9e2-88ca5748276f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:52.822428 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0486bb0-e8a5-423a-b9e2-88ca5748276f service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:52.822708 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0486bb0-e8a5-423a-b9e2-88ca5748276f service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:52.823544 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0486bb0-e8a5-423a-b9e2-88ca5748276f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:52.832481 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0486bb0-e8a5-423a-b9e2-88ca5748276f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:52.833913 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0486bb0-e8a5-423a-b9e2-88ca5748276f service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:52.843061 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1303/2593] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:25:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:25:53.181734 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f9bba8-c1c4-40fa-972f-2a144181a9b6 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:53.183360 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-78f9bba8-c1c4-40fa-972f-2a144181a9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:53.234458 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0486bb0-e8a5-423a-b9e2-88ca5748276f service neutron] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:53.235848 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-d0486bb0-e8a5-423a-b9e2-88ca5748276f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:53.242897 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f9bba8-c1c4-40fa-972f-2a144181a9b6 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:53.248817 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6940525-84bd-40ab-9869-278185adb0a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:53.249487 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6940525-84bd-40ab-9869-278185adb0a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:53.249776 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6940525-84bd-40ab-9869-278185adb0a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:53.250186 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6940525-84bd-40ab-9869-278185adb0a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:53.255573 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0486bb0-e8a5-423a-b9e2-88ca5748276f service neutron] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:53.256051 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-a6940525-84bd-40ab-9869-278185adb0a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:53.256170 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4d56d8-8f4b-4ca6-bd6c-51ccd6f0c580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:53.257193 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d56d8-8f4b-4ca6-bd6c-51ccd6f0c580 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:53.257680 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d56d8-8f4b-4ca6-bd6c-51ccd6f0c580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:53.258113 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d56d8-8f4b-4ca6-bd6c-51ccd6f0c580 admin admin] PATH_INFO: `/v3/projects/bd721ccc0d1849f98ff8a5e0bcfa6df1` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:53.259601 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4d56d8-8f4b-4ca6-bd6c-51ccd6f0c580 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd721ccc0d1849f98ff8a5e0bcfa6df1)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:53.261808 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4d56d8-8f4b-4ca6-bd6c-51ccd6f0c580 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:53.319755 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6940525-84bd-40ab-9869-278185adb0a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:53.321245 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6940525-84bd-40ab-9869-278185adb0a1 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:53.330737 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1291/2594] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:25:53 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:25:53.415687 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-ae4d56d8-8f4b-4ca6-bd6c-51ccd6f0c580 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd721ccc0d1849f98ff8a5e0bcfa6df1', 'request_id': 'req-ae4d56d8-8f4b-4ca6-bd6c-51ccd6f0c580'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:53.421573 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-ae4d56d8-8f4b-4ca6-bd6c-51ccd6f0c580 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd721ccc0d1849f98ff8a5e0bcfa6df1', 'request_id': 'req-ae4d56d8-8f4b-4ca6-bd6c-51ccd6f0c580'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:53.427844 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-ae4d56d8-8f4b-4ca6-bd6c-51ccd6f0c580 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd721ccc0d1849f98ff8a5e0bcfa6df1', 'request_id': 'req-ae4d56d8-8f4b-4ca6-bd6c-51ccd6f0c580'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:53.569163 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-ae4d56d8-8f4b-4ca6-bd6c-51ccd6f0c580 admin admin] The token cache is being invalidate because project bd721ccc0d1849f98ff8a5e0bcfa6df1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:25:53.570575 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-ae4d56d8-8f4b-4ca6-bd6c-51ccd6f0c580 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:53.571206 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-ae4d56d8-8f4b-4ca6-bd6c-51ccd6f0c580 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:53.572818 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1304/2595] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:25:53 2022] DELETE /identity/v3/projects/bd721ccc0d1849f98ff8a5e0bcfa6df1 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:25:53.576813 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6940525-84bd-40ab-9869-278185adb0a1 service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:53.587194 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6940525-84bd-40ab-9869-278185adb0a1 service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:53.650594 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693851f1-db63-4807-a5b6-44fd4f3b0262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:53.651993 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693851f1-db63-4807-a5b6-44fd4f3b0262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:53.652306 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693851f1-db63-4807-a5b6-44fd4f3b0262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:53.652584 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693851f1-db63-4807-a5b6-44fd4f3b0262 admin admin] PATH_INFO: `/v3/users/0fcedbd0d4ed4bbaa3aaaa3050ab115e` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:53.653827 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693851f1-db63-4807-a5b6-44fd4f3b0262 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fcedbd0d4ed4bbaa3aaaa3050ab115e)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:53.655804 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693851f1-db63-4807-a5b6-44fd4f3b0262 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:53.857817 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-693851f1-db63-4807-a5b6-44fd4f3b0262 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fcedbd0d4ed4bbaa3aaaa3050ab115e'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:53.858923 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-693851f1-db63-4807-a5b6-44fd4f3b0262 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fcedbd0d4ed4bbaa3aaaa3050ab115e'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:53.866087 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-693851f1-db63-4807-a5b6-44fd4f3b0262 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fcedbd0d4ed4bbaa3aaaa3050ab115e'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:53.945990 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-693851f1-db63-4807-a5b6-44fd4f3b0262 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fcedbd0d4ed4bbaa3aaaa3050ab115e'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:53.946802 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-693851f1-db63-4807-a5b6-44fd4f3b0262 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fcedbd0d4ed4bbaa3aaaa3050ab115e'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:53.969234 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1292/2596] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:25:53 2022] DELETE /identity/v3/users/0fcedbd0d4ed4bbaa3aaaa3050ab115e => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:25:54.365163 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4d56d8-8f4b-4ca6-bd6c-51ccd6f0c580 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:54.366723 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-ae4d56d8-8f4b-4ca6-bd6c-51ccd6f0c580 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:54.386577 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4d56d8-8f4b-4ca6-bd6c-51ccd6f0c580 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:54.464172 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc37f81-03ef-47c1-af9e-6ced5d903cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:54.464172 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc37f81-03ef-47c1-af9e-6ced5d903cc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:54.464172 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc37f81-03ef-47c1-af9e-6ced5d903cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:54.464172 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc37f81-03ef-47c1-af9e-6ced5d903cc1 admin admin] PATH_INFO: `/v3/projects/14fc128dbfae42a4b62fb6421fc9a9d9` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:54.465082 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc37f81-03ef-47c1-af9e-6ced5d903cc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14fc128dbfae42a4b62fb6421fc9a9d9)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:54.465523 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc37f81-03ef-47c1-af9e-6ced5d903cc1 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:54.611878 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-bbc37f81-03ef-47c1-af9e-6ced5d903cc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14fc128dbfae42a4b62fb6421fc9a9d9', 'request_id': 'req-bbc37f81-03ef-47c1-af9e-6ced5d903cc1'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:54.617469 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-bbc37f81-03ef-47c1-af9e-6ced5d903cc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14fc128dbfae42a4b62fb6421fc9a9d9', 'request_id': 'req-bbc37f81-03ef-47c1-af9e-6ced5d903cc1'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:54.623629 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-bbc37f81-03ef-47c1-af9e-6ced5d903cc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14fc128dbfae42a4b62fb6421fc9a9d9', 'request_id': 'req-bbc37f81-03ef-47c1-af9e-6ced5d903cc1'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:54.711986 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-bbc37f81-03ef-47c1-af9e-6ced5d903cc1 admin admin] The token cache is being invalidate because project 14fc128dbfae42a4b62fb6421fc9a9d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:25:54.712321 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-bbc37f81-03ef-47c1-af9e-6ced5d903cc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:54.712948 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-bbc37f81-03ef-47c1-af9e-6ced5d903cc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:25:54.715187 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1305/2597] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:25:54 2022] DELETE /identity/v3/projects/14fc128dbfae42a4b62fb6421fc9a9d9 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:25:54.720746 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed61836-940f-4321-8079-d0fee151eca3 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:54.721038 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed61836-940f-4321-8079-d0fee151eca3 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:54.721316 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed61836-940f-4321-8079-d0fee151eca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:54.738759 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-4ed61836-940f-4321-8079-d0fee151eca3 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:25:54.740275 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-4ed61836-940f-4321-8079-d0fee151eca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:54.805316 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1293/2598] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:25:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:25:54.813250 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125044d3-9000-4826-80c3-d64330a43e82 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:54.813548 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125044d3-9000-4826-80c3-d64330a43e82 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:54.813823 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125044d3-9000-4826-80c3-d64330a43e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:54.833523 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-125044d3-9000-4826-80c3-d64330a43e82 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:25:54.834926 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-125044d3-9000-4826-80c3-d64330a43e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:54.844291 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1306/2599] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:25:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:25:54.848550 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed61836-940f-4321-8079-d0fee151eca3 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:54.859169 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed61836-940f-4321-8079-d0fee151eca3 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:54.865331 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4c963-ebe7-4a0b-815d-b6cb0629dee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:54.866267 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4c963-ebe7-4a0b-815d-b6cb0629dee9 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:54.866711 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4c963-ebe7-4a0b-815d-b6cb0629dee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:54.867143 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4c963-ebe7-4a0b-815d-b6cb0629dee9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:54.868152 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf4c963-ebe7-4a0b-815d-b6cb0629dee9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:25:54.868868 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf4c963-ebe7-4a0b-815d-b6cb0629dee9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:54.871348 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf4c963-ebe7-4a0b-815d-b6cb0629dee9 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:54.885004 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1294/2600] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 10 03:25:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:25:54.890256 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125044d3-9000-4826-80c3-d64330a43e82 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:54.900070 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125044d3-9000-4826-80c3-d64330a43e82 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:54.905994 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d6c19-e16a-464f-811d-7a558c6150a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:54.906589 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d6c19-e16a-464f-811d-7a558c6150a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:54.906938 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d6c19-e16a-464f-811d-7a558c6150a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:54.907278 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d6c19-e16a-464f-811d-7a558c6150a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:54.908102 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1d6c19-e16a-464f-811d-7a558c6150a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:54.910262 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1d6c19-e16a-464f-811d-7a558c6150a3 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:55.004234 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1307/2601] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:25:54 2022] POST /identity/v3/projects => generated 381 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:25:55.005668 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4c963-ebe7-4a0b-815d-b6cb0629dee9 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:55.017350 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4c963-ebe7-4a0b-815d-b6cb0629dee9 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:55.081162 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1168613b-f657-4983-a850-64ab3c5aa8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:55.081852 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168613b-f657-4983-a850-64ab3c5aa8c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:55.082138 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168613b-f657-4983-a850-64ab3c5aa8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:55.082410 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168613b-f657-4983-a850-64ab3c5aa8c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:55.083103 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1168613b-f657-4983-a850-64ab3c5aa8c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:55.085060 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1168613b-f657-4983-a850-64ab3c5aa8c1 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:55.159372 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1295/2602] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:25:55 2022] POST /identity/v3/users => generated 291 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:25:55.163407 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d6c19-e16a-464f-811d-7a558c6150a3 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:55.174752 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d6c19-e16a-464f-811d-7a558c6150a3 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:55.179810 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac543c75-8cd2-4a68-8cb6-b436360d95be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:55.191288 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac543c75-8cd2-4a68-8cb6-b436360d95be admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:55.191288 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac543c75-8cd2-4a68-8cb6-b436360d95be admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:55.191288 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac543c75-8cd2-4a68-8cb6-b436360d95be admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:55.191288 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac543c75-8cd2-4a68-8cb6-b436360d95be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:55.191288 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac543c75-8cd2-4a68-8cb6-b436360d95be admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:55.196035 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1308/2603] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:25:55.199430 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1168613b-f657-4983-a850-64ab3c5aa8c1 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:55.210290 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1168613b-f657-4983-a850-64ab3c5aa8c1 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:55.215769 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d47f7c-27ce-4e9e-965e-d43056870de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:55.216669 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d47f7c-27ce-4e9e-965e-d43056870de6 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:55.217109 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d47f7c-27ce-4e9e-965e-d43056870de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:55.217548 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d47f7c-27ce-4e9e-965e-d43056870de6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:55.218490 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d47f7c-27ce-4e9e-965e-d43056870de6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:55.220459 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d47f7c-27ce-4e9e-965e-d43056870de6 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:55.233550 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1296/2604] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:25:55.239090 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac543c75-8cd2-4a68-8cb6-b436360d95be admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:55.250568 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac543c75-8cd2-4a68-8cb6-b436360d95be admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:55.255449 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42889ad9-edd0-4a1a-a68e-b26f7c8d0c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:55.256371 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42889ad9-edd0-4a1a-a68e-b26f7c8d0c65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:55.256657 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42889ad9-edd0-4a1a-a68e-b26f7c8d0c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:55.256941 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42889ad9-edd0-4a1a-a68e-b26f7c8d0c65 admin admin] PATH_INFO: `/v3/projects/d2ec51c478ac4663b36c16b9f3061c0b/users/a7d793f498f4461a8c6480bce3df2777/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:55.271836 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42889ad9-edd0-4a1a-a68e-b26f7c8d0c65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2ec51c478ac4663b36c16b9f3061c0b, user_id=a7d793f498f4461a8c6480bce3df2777, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:55.274513 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42889ad9-edd0-4a1a-a68e-b26f7c8d0c65 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:55.369957 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1309/2605] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:25:55 2022] PUT /identity/v3/projects/d2ec51c478ac4663b36c16b9f3061c0b/users/a7d793f498f4461a8c6480bce3df2777/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:25:55.380436 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd7f74-7fd1-439d-8a19-39c5152739ed None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:55.380722 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd7f74-7fd1-439d-8a19-39c5152739ed None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:55.380996 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd7f74-7fd1-439d-8a19-39c5152739ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:55.409441 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-28cd7f74-7fd1-439d-8a19-39c5152739ed None None] MFA Rules not processed for user `a7d793f498f4461a8c6480bce3df2777`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:25:55.410843 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-28cd7f74-7fd1-439d-8a19-39c5152739ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:55.481239 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1297/2606] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:25:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:25:55.485884 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42889ad9-edd0-4a1a-a68e-b26f7c8d0c65 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:55.546872 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42889ad9-edd0-4a1a-a68e-b26f7c8d0c65 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:55.552189 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad52c5-6764-4647-8d78-1ff50af17287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:55.552951 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad52c5-6764-4647-8d78-1ff50af17287 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:55.553428 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad52c5-6764-4647-8d78-1ff50af17287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:55.553865 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad52c5-6764-4647-8d78-1ff50af17287 admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:55.554804 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dad52c5-6764-4647-8d78-1ff50af17287 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:55.556966 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dad52c5-6764-4647-8d78-1ff50af17287 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:55.663538 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1310/2607] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:25:55 2022] POST /identity/v3/projects => generated 379 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:25:55.664660 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cd7f74-7fd1-439d-8a19-39c5152739ed None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:55.677700 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cd7f74-7fd1-439d-8a19-39c5152739ed None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:55.742297 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21822b6-874d-4a06-a534-498a2aa698be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:55.742972 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21822b6-874d-4a06-a534-498a2aa698be admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:55.743252 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21822b6-874d-4a06-a534-498a2aa698be admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:55.743527 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21822b6-874d-4a06-a534-498a2aa698be admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:55.744247 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21822b6-874d-4a06-a534-498a2aa698be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:55.746808 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21822b6-874d-4a06-a534-498a2aa698be admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:55.821895 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1298/2608] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:25:55 2022] POST /identity/v3/users => generated 296 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:25:55.826744 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad52c5-6764-4647-8d78-1ff50af17287 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:55.837519 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad52c5-6764-4647-8d78-1ff50af17287 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:55.842398 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e8f9f-b600-4764-bcdd-9e46d528c44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:55.843064 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e8f9f-b600-4764-bcdd-9e46d528c44c admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:55.843346 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e8f9f-b600-4764-bcdd-9e46d528c44c admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:55.847445 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e8f9f-b600-4764-bcdd-9e46d528c44c admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:55.847445 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795e8f9f-b600-4764-bcdd-9e46d528c44c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:55.847445 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795e8f9f-b600-4764-bcdd-9e46d528c44c admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:55.857648 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1311/2609] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:25:55.861493 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21822b6-874d-4a06-a534-498a2aa698be admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:55.873581 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21822b6-874d-4a06-a534-498a2aa698be admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:55.878331 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a29c2-44b1-4647-bb43-170bd665b37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:55.879229 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a29c2-44b1-4647-bb43-170bd665b37b admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:55.879536 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a29c2-44b1-4647-bb43-170bd665b37b admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:55.879808 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a29c2-44b1-4647-bb43-170bd665b37b admin admin] PATH_INFO: `/v3/projects/e039a85645e3443c801322d8b08f41e4/users/e18b390cd50a4a448097f8c49c99313c/roles/43105000610f402ca2486e7648018cca` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:55.896000 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750a29c2-44b1-4647-bb43-170bd665b37b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e039a85645e3443c801322d8b08f41e4, user_id=e18b390cd50a4a448097f8c49c99313c, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:55.898680 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750a29c2-44b1-4647-bb43-170bd665b37b admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:55.976047 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1299/2610] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:25:55 2022] PUT /identity/v3/projects/e039a85645e3443c801322d8b08f41e4/users/e18b390cd50a4a448097f8c49c99313c/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:25:55.980608 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e8f9f-b600-4764-bcdd-9e46d528c44c admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:55.995601 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e8f9f-b600-4764-bcdd-9e46d528c44c admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:56.064327 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6159cf3-dcaf-494c-a755-3c2bb4896eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:56.065775 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6159cf3-dcaf-494c-a755-3c2bb4896eef admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:56.066074 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6159cf3-dcaf-494c-a755-3c2bb4896eef admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:56.066360 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6159cf3-dcaf-494c-a755-3c2bb4896eef admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:56.067422 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6159cf3-dcaf-494c-a755-3c2bb4896eef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:56.069084 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6159cf3-dcaf-494c-a755-3c2bb4896eef admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:56.087983 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1312/2611] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:25:56.092868 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a29c2-44b1-4647-bb43-170bd665b37b admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:56.106123 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a29c2-44b1-4647-bb43-170bd665b37b admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:56.112767 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e3e3b6-45d5-4fdb-bbb8-8053fe34b447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:56.114802 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e3e3b6-45d5-4fdb-bbb8-8053fe34b447 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:56.115098 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e3e3b6-45d5-4fdb-bbb8-8053fe34b447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:56.115399 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e3e3b6-45d5-4fdb-bbb8-8053fe34b447 admin admin] PATH_INFO: `/v3/projects/e039a85645e3443c801322d8b08f41e4/users/e18b390cd50a4a448097f8c49c99313c/roles/43105000610f402ca2486e7648018cca` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:56.117618 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e3e3b6-45d5-4fdb-bbb8-8053fe34b447 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e039a85645e3443c801322d8b08f41e4, user_id=e18b390cd50a4a448097f8c49c99313c, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:56.120955 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e3e3b6-45d5-4fdb-bbb8-8053fe34b447 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:56.132746 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1300/2612] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:25:56 2022] PUT /identity/v3/projects/e039a85645e3443c801322d8b08f41e4/users/e18b390cd50a4a448097f8c49c99313c/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:25:56.148778 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9fc749-77af-4036-b6a5-6c26b80490a1 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:56.149175 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9fc749-77af-4036-b6a5-6c26b80490a1 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:56.149545 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9fc749-77af-4036-b6a5-6c26b80490a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:56.179474 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-3a9fc749-77af-4036-b6a5-6c26b80490a1 None None] MFA Rules not processed for user `e18b390cd50a4a448097f8c49c99313c`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:25:56.181486 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-3a9fc749-77af-4036-b6a5-6c26b80490a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:56.267515 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1313/2613] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:25:56 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:25:56.280201 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e3e3b6-45d5-4fdb-bbb8-8053fe34b447 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:56.282592 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-32e3e3b6-45d5-4fdb-bbb8-8053fe34b447 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:25:56.371937 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e3e3b6-45d5-4fdb-bbb8-8053fe34b447 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:56.375789 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042e74d4-0428-48ee-a84e-0b6b72240083 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:56.376476 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e74d4-0428-48ee-a84e-0b6b72240083 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:56.376763 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e74d4-0428-48ee-a84e-0b6b72240083 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:56.377057 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e74d4-0428-48ee-a84e-0b6b72240083 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:56.386847 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042e74d4-0428-48ee-a84e-0b6b72240083 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:56.388362 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042e74d4-0428-48ee-a84e-0b6b72240083 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:56.398077 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1301/2614] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:25:56 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:25:56.675928 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9fc749-77af-4036-b6a5-6c26b80490a1 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:25:56.686283 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9fc749-77af-4036-b6a5-6c26b80490a1 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:25:56.689925 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962861eb-79c2-4b7c-a628-3b09e5ab3b02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:25:56.692857 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962861eb-79c2-4b7c-a628-3b09e5ab3b02 service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:25:56.692857 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962861eb-79c2-4b7c-a628-3b09e5ab3b02 service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:25:56.692857 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962861eb-79c2-4b7c-a628-3b09e5ab3b02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:25:56.748936 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962861eb-79c2-4b7c-a628-3b09e5ab3b02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:25:56.750876 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962861eb-79c2-4b7c-a628-3b09e5ab3b02 service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:25:56.761220 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1314/2615] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:25:56 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:26:00.782524 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042e74d4-0428-48ee-a84e-0b6b72240083 service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:00.783916 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-042e74d4-0428-48ee-a84e-0b6b72240083 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:00.840594 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042e74d4-0428-48ee-a84e-0b6b72240083 service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:00.844366 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5182d6b4-3692-4a45-ae18-4dc310f016b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:00.845022 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182d6b4-3692-4a45-ae18-4dc310f016b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:00.845308 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182d6b4-3692-4a45-ae18-4dc310f016b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:00.845587 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182d6b4-3692-4a45-ae18-4dc310f016b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:00.848089 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-5182d6b4-3692-4a45-ae18-4dc310f016b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:00.916737 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5182d6b4-3692-4a45-ae18-4dc310f016b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:00.918181 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5182d6b4-3692-4a45-ae18-4dc310f016b6 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:00.931575 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1302/2616] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:26:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:26:05.014753 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962861eb-79c2-4b7c-a628-3b09e5ab3b02 service cinder] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:05.016761 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-962861eb-79c2-4b7c-a628-3b09e5ab3b02 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:05.032472 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962861eb-79c2-4b7c-a628-3b09e5ab3b02 service cinder] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:05.037296 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5311dd43-a217-4e9f-a79c-1221a2bcbe00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:05.038176 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311dd43-a217-4e9f-a79c-1221a2bcbe00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:05.038493 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311dd43-a217-4e9f-a79c-1221a2bcbe00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:05.038881 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311dd43-a217-4e9f-a79c-1221a2bcbe00 admin admin] PATH_INFO: `/v3/users/9dff947a164641e7b32c639bebbffe36` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:05.039979 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5311dd43-a217-4e9f-a79c-1221a2bcbe00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dff947a164641e7b32c639bebbffe36)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:05.042468 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5311dd43-a217-4e9f-a79c-1221a2bcbe00 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:05.214885 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-5311dd43-a217-4e9f-a79c-1221a2bcbe00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dff947a164641e7b32c639bebbffe36'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:05.221990 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-5311dd43-a217-4e9f-a79c-1221a2bcbe00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dff947a164641e7b32c639bebbffe36'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:05.233955 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-5311dd43-a217-4e9f-a79c-1221a2bcbe00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dff947a164641e7b32c639bebbffe36'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:05.234661 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-5311dd43-a217-4e9f-a79c-1221a2bcbe00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dff947a164641e7b32c639bebbffe36'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:05.235263 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-5311dd43-a217-4e9f-a79c-1221a2bcbe00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dff947a164641e7b32c639bebbffe36'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:05.295328 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1315/2617] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:26:05 2022] DELETE /identity/v3/users/9dff947a164641e7b32c639bebbffe36 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:26:05.335545 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5182d6b4-3692-4a45-ae18-4dc310f016b6 service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:05.346326 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5182d6b4-3692-4a45-ae18-4dc310f016b6 service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:05.403021 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ac4482-e19a-472a-8717-ee29a4feeea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:05.404030 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac4482-e19a-472a-8717-ee29a4feeea5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:05.404442 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac4482-e19a-472a-8717-ee29a4feeea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:05.404815 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac4482-e19a-472a-8717-ee29a4feeea5 admin admin] PATH_INFO: `/v3/users/a7d793f498f4461a8c6480bce3df2777` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:05.406090 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ac4482-e19a-472a-8717-ee29a4feeea5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7d793f498f4461a8c6480bce3df2777)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:05.408139 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ac4482-e19a-472a-8717-ee29a4feeea5 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:05.588415 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5311dd43-a217-4e9f-a79c-1221a2bcbe00 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:05.590971 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-5311dd43-a217-4e9f-a79c-1221a2bcbe00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:05.615514 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5311dd43-a217-4e9f-a79c-1221a2bcbe00 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:05.623075 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2cc1b6-e685-4a99-bea7-b44ba0bec608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:05.624066 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2cc1b6-e685-4a99-bea7-b44ba0bec608 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:05.624419 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2cc1b6-e685-4a99-bea7-b44ba0bec608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:05.624769 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2cc1b6-e685-4a99-bea7-b44ba0bec608 admin admin] PATH_INFO: `/v3/projects/4af328ed59384b70b2312c150a124746` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:05.626106 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2cc1b6-e685-4a99-bea7-b44ba0bec608 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4af328ed59384b70b2312c150a124746)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:05.628202 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2cc1b6-e685-4a99-bea7-b44ba0bec608 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:05.646273 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-01ac4482-e19a-472a-8717-ee29a4feeea5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7d793f498f4461a8c6480bce3df2777'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:05.646273 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-01ac4482-e19a-472a-8717-ee29a4feeea5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7d793f498f4461a8c6480bce3df2777'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:05.651108 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-01ac4482-e19a-472a-8717-ee29a4feeea5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7d793f498f4461a8c6480bce3df2777'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:05.750666 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-9b2cc1b6-e685-4a99-bea7-b44ba0bec608 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4af328ed59384b70b2312c150a124746', 'request_id': 'req-9b2cc1b6-e685-4a99-bea7-b44ba0bec608'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:05.755923 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-9b2cc1b6-e685-4a99-bea7-b44ba0bec608 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4af328ed59384b70b2312c150a124746', 'request_id': 'req-9b2cc1b6-e685-4a99-bea7-b44ba0bec608'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:05.762567 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-9b2cc1b6-e685-4a99-bea7-b44ba0bec608 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4af328ed59384b70b2312c150a124746', 'request_id': 'req-9b2cc1b6-e685-4a99-bea7-b44ba0bec608'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:05.763237 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-01ac4482-e19a-472a-8717-ee29a4feeea5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7d793f498f4461a8c6480bce3df2777'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:05.763890 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-01ac4482-e19a-472a-8717-ee29a4feeea5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7d793f498f4461a8c6480bce3df2777'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:05.782539 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1303/2618] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:26:05 2022] DELETE /identity/v3/users/a7d793f498f4461a8c6480bce3df2777 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:26:05.788169 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05457a8-6268-4bf8-9a3f-ba0fb1bc617c None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:05.788465 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05457a8-6268-4bf8-9a3f-ba0fb1bc617c None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:05.788747 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05457a8-6268-4bf8-9a3f-ba0fb1bc617c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:05.806006 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-c05457a8-6268-4bf8-9a3f-ba0fb1bc617c None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:26:05.807198 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-c05457a8-6268-4bf8-9a3f-ba0fb1bc617c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:05.843833 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-9b2cc1b6-e685-4a99-bea7-b44ba0bec608 admin admin] The token cache is being invalidate because project 4af328ed59384b70b2312c150a124746 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:26:05.844222 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-9b2cc1b6-e685-4a99-bea7-b44ba0bec608 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:05.844858 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-9b2cc1b6-e685-4a99-bea7-b44ba0bec608 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:05.846679 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1316/2619] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:26:05 2022] DELETE /identity/v3/projects/4af328ed59384b70b2312c150a124746 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:26:05.853580 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab06c7-4b31-46ab-8918-9a38610ba555 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:05.853983 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab06c7-4b31-46ab-8918-9a38610ba555 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:05.854270 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab06c7-4b31-46ab-8918-9a38610ba555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:05.868370 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1304/2620] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:26:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:26:05.873469 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-b6ab06c7-4b31-46ab-8918-9a38610ba555 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:26:05.874932 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-b6ab06c7-4b31-46ab-8918-9a38610ba555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:05.879373 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05457a8-6268-4bf8-9a3f-ba0fb1bc617c None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:05.880903 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-c05457a8-6268-4bf8-9a3f-ba0fb1bc617c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:05.884895 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1317/2621] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:26:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:26:05.893461 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97854ec5-ed73-4b61-8224-ef9178606507 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:05.893461 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97854ec5-ed73-4b61-8224-ef9178606507 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:05.893461 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97854ec5-ed73-4b61-8224-ef9178606507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:05.912184 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-97854ec5-ed73-4b61-8224-ef9178606507 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:26:05.913323 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-97854ec5-ed73-4b61-8224-ef9178606507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:05.922662 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1318/2622] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:26:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:26:05.928279 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97854ec5-ed73-4b61-8224-ef9178606507 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:05.938517 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97854ec5-ed73-4b61-8224-ef9178606507 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:05.943918 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a26b8c-4a0e-4446-bf93-c38a92742129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:05.944082 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05457a8-6268-4bf8-9a3f-ba0fb1bc617c None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:05.944784 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a26b8c-4a0e-4446-bf93-c38a92742129 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:05.945105 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a26b8c-4a0e-4446-bf93-c38a92742129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:05.945345 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a26b8c-4a0e-4446-bf93-c38a92742129 admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:05.946078 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a26b8c-4a0e-4446-bf93-c38a92742129 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:26:05.946384 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a26b8c-4a0e-4446-bf93-c38a92742129 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:05.947995 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a26b8c-4a0e-4446-bf93-c38a92742129 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:05.954091 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583be9b6-7f4d-4efa-a4bc-bcc5feba01ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:05.954764 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583be9b6-7f4d-4efa-a4bc-bcc5feba01ee service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:05.955046 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583be9b6-7f4d-4efa-a4bc-bcc5feba01ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:05.955927 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583be9b6-7f4d-4efa-a4bc-bcc5feba01ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:05.962408 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1319/2623] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 10 03:26:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:26:05.966438 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a26b8c-4a0e-4446-bf93-c38a92742129 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:05.968310 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583be9b6-7f4d-4efa-a4bc-bcc5feba01ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:05.969777 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583be9b6-7f4d-4efa-a4bc-bcc5feba01ee service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:05.982968 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a26b8c-4a0e-4446-bf93-c38a92742129 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:05.984511 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1305/2624] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:26:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:26:05.989104 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5e2910-583b-4a6d-a530-90eb5a4f25d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:05.989849 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e2910-583b-4a6d-a530-90eb5a4f25d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:05.990263 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e2910-583b-4a6d-a530-90eb5a4f25d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:05.990617 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e2910-583b-4a6d-a530-90eb5a4f25d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:05.991400 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5e2910-583b-4a6d-a530-90eb5a4f25d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:05.993472 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5e2910-583b-4a6d-a530-90eb5a4f25d0 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:06.114259 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1320/2625] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:26:05 2022] POST /identity/v3/projects => generated 375 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:26:06.118506 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583be9b6-7f4d-4efa-a4bc-bcc5feba01ee service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:06.129248 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583be9b6-7f4d-4efa-a4bc-bcc5feba01ee service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:06.199148 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6d33c-2ae4-43de-8f4d-32815a7f13e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:06.199911 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6d33c-2ae4-43de-8f4d-32815a7f13e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:06.200474 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6d33c-2ae4-43de-8f4d-32815a7f13e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:06.200851 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6d33c-2ae4-43de-8f4d-32815a7f13e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:06.201641 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc6d33c-2ae4-43de-8f4d-32815a7f13e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:06.203902 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc6d33c-2ae4-43de-8f4d-32815a7f13e1 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:06.279141 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1306/2626] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:26:06 2022] POST /identity/v3/users => generated 288 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:26:06.283418 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5e2910-583b-4a6d-a530-90eb5a4f25d0 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:06.294538 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5e2910-583b-4a6d-a530-90eb5a4f25d0 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:06.301499 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c24e93-0c94-455a-a694-bc8c400d9209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:06.301499 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c24e93-0c94-455a-a694-bc8c400d9209 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:06.301499 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c24e93-0c94-455a-a694-bc8c400d9209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:06.301499 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c24e93-0c94-455a-a694-bc8c400d9209 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:06.302547 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c24e93-0c94-455a-a694-bc8c400d9209 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:06.303146 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c24e93-0c94-455a-a694-bc8c400d9209 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:06.320973 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1321/2627] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:26:06.322184 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6d33c-2ae4-43de-8f4d-32815a7f13e1 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:06.334461 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6d33c-2ae4-43de-8f4d-32815a7f13e1 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:06.339493 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47974c55-5616-4abb-b6e4-4964e024a66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:06.341164 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47974c55-5616-4abb-b6e4-4964e024a66c admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:06.341164 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47974c55-5616-4abb-b6e4-4964e024a66c admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:06.341164 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47974c55-5616-4abb-b6e4-4964e024a66c admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:06.341713 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47974c55-5616-4abb-b6e4-4964e024a66c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:06.343505 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47974c55-5616-4abb-b6e4-4964e024a66c admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:06.354108 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1307/2628] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:26:06.358395 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c24e93-0c94-455a-a694-bc8c400d9209 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:06.368288 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c24e93-0c94-455a-a694-bc8c400d9209 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:06.373497 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e0e378-00f5-461c-9447-6c4e01201e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:06.374373 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e0e378-00f5-461c-9447-6c4e01201e4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:06.374654 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e0e378-00f5-461c-9447-6c4e01201e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:06.374932 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e0e378-00f5-461c-9447-6c4e01201e4c admin admin] PATH_INFO: `/v3/projects/e0a8f97bcc70417e9609daad2c2d0ddf/users/485728644b07453cac7bc38d2debc4c9/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:06.389851 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e0e378-00f5-461c-9447-6c4e01201e4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0a8f97bcc70417e9609daad2c2d0ddf, user_id=485728644b07453cac7bc38d2debc4c9, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:06.392523 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e0e378-00f5-461c-9447-6c4e01201e4c admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:06.400301 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47974c55-5616-4abb-b6e4-4964e024a66c admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:06.402155 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-47974c55-5616-4abb-b6e4-4964e024a66c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:06.417486 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47974c55-5616-4abb-b6e4-4964e024a66c admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:06.422978 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0fe8ab-57bb-47cb-9a21-1fb30ea7a51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:06.424313 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0fe8ab-57bb-47cb-9a21-1fb30ea7a51e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:06.424789 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0fe8ab-57bb-47cb-9a21-1fb30ea7a51e admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:06.425125 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0fe8ab-57bb-47cb-9a21-1fb30ea7a51e admin admin] PATH_INFO: `/v3/projects/d2ec51c478ac4663b36c16b9f3061c0b` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:06.428306 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0fe8ab-57bb-47cb-9a21-1fb30ea7a51e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2ec51c478ac4663b36c16b9f3061c0b)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:06.430251 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0fe8ab-57bb-47cb-9a21-1fb30ea7a51e admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:06.472309 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1322/2629] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:26:06 2022] PUT /identity/v3/projects/e0a8f97bcc70417e9609daad2c2d0ddf/users/485728644b07453cac7bc38d2debc4c9/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:26:06.483579 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0a8d2-24b9-4a21-99dc-b9faaa6d73f2 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:06.483871 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0a8d2-24b9-4a21-99dc-b9faaa6d73f2 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:06.484180 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0a8d2-24b9-4a21-99dc-b9faaa6d73f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:06.510219 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-6dd0a8d2-24b9-4a21-99dc-b9faaa6d73f2 None None] MFA Rules not processed for user `485728644b07453cac7bc38d2debc4c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:26:06.511435 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-6dd0a8d2-24b9-4a21-99dc-b9faaa6d73f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:06.574114 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1323/2630] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:26:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:26:06.593055 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd0a8d2-24b9-4a21-99dc-b9faaa6d73f2 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:06.594606 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-6dd0a8d2-24b9-4a21-99dc-b9faaa6d73f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:06.604354 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-de0fe8ab-57bb-47cb-9a21-1fb30ea7a51e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2ec51c478ac4663b36c16b9f3061c0b', 'request_id': 'req-de0fe8ab-57bb-47cb-9a21-1fb30ea7a51e'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:06.610893 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-de0fe8ab-57bb-47cb-9a21-1fb30ea7a51e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2ec51c478ac4663b36c16b9f3061c0b', 'request_id': 'req-de0fe8ab-57bb-47cb-9a21-1fb30ea7a51e'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:06.617602 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-de0fe8ab-57bb-47cb-9a21-1fb30ea7a51e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2ec51c478ac4663b36c16b9f3061c0b', 'request_id': 'req-de0fe8ab-57bb-47cb-9a21-1fb30ea7a51e'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:06.665409 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd0a8d2-24b9-4a21-99dc-b9faaa6d73f2 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:06.718436 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-de0fe8ab-57bb-47cb-9a21-1fb30ea7a51e admin admin] The token cache is being invalidate because project d2ec51c478ac4663b36c16b9f3061c0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:26:06.718720 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-de0fe8ab-57bb-47cb-9a21-1fb30ea7a51e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:06.719395 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-de0fe8ab-57bb-47cb-9a21-1fb30ea7a51e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:06.721062 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1308/2631] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:26:06 2022] DELETE /identity/v3/projects/d2ec51c478ac4663b36c16b9f3061c0b => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:26:06.724919 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0fe8ab-57bb-47cb-9a21-1fb30ea7a51e admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:06.726118 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a05bd9-2066-4ab0-92f4-73d21bf29ba3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b7ccdccba0b4f9e86817946f22dbe28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:06.726276 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-de0fe8ab-57bb-47cb-9a21-1fb30ea7a51e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:06.726767 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a05bd9-2066-4ab0-92f4-73d21bf29ba3 service nova] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:06.727059 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a05bd9-2066-4ab0-92f4-73d21bf29ba3 service nova] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:06.727343 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a05bd9-2066-4ab0-92f4-73d21bf29ba3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:06.729114 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-a9a05bd9-2066-4ab0-92f4-73d21bf29ba3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:06.785523 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a05bd9-2066-4ab0-92f4-73d21bf29ba3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:06.787117 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a05bd9-2066-4ab0-92f4-73d21bf29ba3 service nova] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:06.787384 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0fe8ab-57bb-47cb-9a21-1fb30ea7a51e admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:06.792060 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e5ae5-2e8a-4776-940f-6e8192e7be33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:06.793465 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e5ae5-2e8a-4776-940f-6e8192e7be33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:06.793796 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e5ae5-2e8a-4776-940f-6e8192e7be33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:06.794192 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e5ae5-2e8a-4776-940f-6e8192e7be33 admin admin] PATH_INFO: `/v3/users/e18b390cd50a4a448097f8c49c99313c` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:06.795395 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617e5ae5-2e8a-4776-940f-6e8192e7be33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e18b390cd50a4a448097f8c49c99313c)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:06.796627 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1324/2632] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:26:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:26:06.797647 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617e5ae5-2e8a-4776-940f-6e8192e7be33 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:06.993979 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-617e5ae5-2e8a-4776-940f-6e8192e7be33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e18b390cd50a4a448097f8c49c99313c'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:06.993979 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-617e5ae5-2e8a-4776-940f-6e8192e7be33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e18b390cd50a4a448097f8c49c99313c'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:07.003369 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a05bd9-2066-4ab0-92f4-73d21bf29ba3 service nova] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:07.005043 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-a9a05bd9-2066-4ab0-92f4-73d21bf29ba3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:07.007618 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-617e5ae5-2e8a-4776-940f-6e8192e7be33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e18b390cd50a4a448097f8c49c99313c'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:07.018309 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a05bd9-2066-4ab0-92f4-73d21bf29ba3 service nova] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:07.022871 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b977b16a-d0a0-4b7d-8208-1c2a7d3526a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:07.023721 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977b16a-d0a0-4b7d-8208-1c2a7d3526a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:07.024026 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977b16a-d0a0-4b7d-8208-1c2a7d3526a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:07.024300 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977b16a-d0a0-4b7d-8208-1c2a7d3526a1 admin admin] PATH_INFO: `/v3/users/485728644b07453cac7bc38d2debc4c9` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:07.025587 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b977b16a-d0a0-4b7d-8208-1c2a7d3526a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=485728644b07453cac7bc38d2debc4c9)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:07.028196 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b977b16a-d0a0-4b7d-8208-1c2a7d3526a1 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:07.078579 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-617e5ae5-2e8a-4776-940f-6e8192e7be33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e18b390cd50a4a448097f8c49c99313c'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:07.079255 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-617e5ae5-2e8a-4776-940f-6e8192e7be33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e18b390cd50a4a448097f8c49c99313c'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:07.097698 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1309/2633] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:26:06 2022] DELETE /identity/v3/users/e18b390cd50a4a448097f8c49c99313c => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:26:07.220490 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-b977b16a-d0a0-4b7d-8208-1c2a7d3526a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '485728644b07453cac7bc38d2debc4c9'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:07.228550 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-b977b16a-d0a0-4b7d-8208-1c2a7d3526a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '485728644b07453cac7bc38d2debc4c9'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:07.243190 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-b977b16a-d0a0-4b7d-8208-1c2a7d3526a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '485728644b07453cac7bc38d2debc4c9'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:07.243918 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-b977b16a-d0a0-4b7d-8208-1c2a7d3526a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '485728644b07453cac7bc38d2debc4c9'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:07.244570 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-b977b16a-d0a0-4b7d-8208-1c2a7d3526a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '485728644b07453cac7bc38d2debc4c9'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:07.326106 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1325/2634] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:26:07 2022] DELETE /identity/v3/users/485728644b07453cac7bc38d2debc4c9 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:26:07.330372 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b640c3c-e751-408e-b1a0-b8ef1e7c7f72 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:07.330665 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b640c3c-e751-408e-b1a0-b8ef1e7c7f72 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:07.330948 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b640c3c-e751-408e-b1a0-b8ef1e7c7f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:07.349512 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-4b640c3c-e751-408e-b1a0-b8ef1e7c7f72 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:26:07.350762 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-4b640c3c-e751-408e-b1a0-b8ef1e7c7f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:07.417004 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1310/2635] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:26:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:26:07.428653 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b977b16a-d0a0-4b7d-8208-1c2a7d3526a1 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:07.430361 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-b977b16a-d0a0-4b7d-8208-1c2a7d3526a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:07.494030 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b977b16a-d0a0-4b7d-8208-1c2a7d3526a1 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:07.497159 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83115ab2-7dfc-4ab8-86e8-908667d84c5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:07.498036 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83115ab2-7dfc-4ab8-86e8-908667d84c5b service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:07.498390 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83115ab2-7dfc-4ab8-86e8-908667d84c5b service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:07.498898 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83115ab2-7dfc-4ab8-86e8-908667d84c5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:07.508778 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83115ab2-7dfc-4ab8-86e8-908667d84c5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:07.510550 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83115ab2-7dfc-4ab8-86e8-908667d84c5b service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:07.522824 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1326/2636] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:26:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:26:07.635305 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b640c3c-e751-408e-b1a0-b8ef1e7c7f72 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:07.637687 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-4b640c3c-e751-408e-b1a0-b8ef1e7c7f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:07.662682 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b640c3c-e751-408e-b1a0-b8ef1e7c7f72 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:07.671737 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea823013-94f8-4315-ae9e-c626bf22f591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:07.671737 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea823013-94f8-4315-ae9e-c626bf22f591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:07.672395 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea823013-94f8-4315-ae9e-c626bf22f591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:07.672943 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea823013-94f8-4315-ae9e-c626bf22f591 admin admin] PATH_INFO: `/v3/projects/e039a85645e3443c801322d8b08f41e4` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:07.674494 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea823013-94f8-4315-ae9e-c626bf22f591 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e039a85645e3443c801322d8b08f41e4)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:07.676575 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea823013-94f8-4315-ae9e-c626bf22f591 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:07.817259 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-ea823013-94f8-4315-ae9e-c626bf22f591 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e039a85645e3443c801322d8b08f41e4', 'request_id': 'req-ea823013-94f8-4315-ae9e-c626bf22f591'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:07.825600 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-ea823013-94f8-4315-ae9e-c626bf22f591 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e039a85645e3443c801322d8b08f41e4', 'request_id': 'req-ea823013-94f8-4315-ae9e-c626bf22f591'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:07.831935 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-ea823013-94f8-4315-ae9e-c626bf22f591 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e039a85645e3443c801322d8b08f41e4', 'request_id': 'req-ea823013-94f8-4315-ae9e-c626bf22f591'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:07.905550 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-ea823013-94f8-4315-ae9e-c626bf22f591 admin admin] The token cache is being invalidate because project e039a85645e3443c801322d8b08f41e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:26:07.905836 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-ea823013-94f8-4315-ae9e-c626bf22f591 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:07.906459 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-ea823013-94f8-4315-ae9e-c626bf22f591 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:07.908296 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1311/2637] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:26:07 2022] DELETE /identity/v3/projects/e039a85645e3443c801322d8b08f41e4 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:26:07.914787 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657b406-6310-45de-997e-32899d582944 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:07.915290 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657b406-6310-45de-997e-32899d582944 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:07.915539 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657b406-6310-45de-997e-32899d582944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:07.934533 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-0657b406-6310-45de-997e-32899d582944 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:26:07.935736 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-0657b406-6310-45de-997e-32899d582944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:07.993957 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1327/2638] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:26:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:26:08.001785 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11777332-07ea-4156-bffe-0a9e8b52db06 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:08.011051 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0657b406-6310-45de-997e-32899d582944 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:08.011922 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11777332-07ea-4156-bffe-0a9e8b52db06 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:08.012276 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11777332-07ea-4156-bffe-0a9e8b52db06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:08.013111 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-0657b406-6310-45de-997e-32899d582944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:08.025042 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0657b406-6310-45de-997e-32899d582944 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:08.031049 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bc458f-ebd4-44bb-af02-9fe17525caf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:08.031912 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc458f-ebd4-44bb-af02-9fe17525caf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:08.032239 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc458f-ebd4-44bb-af02-9fe17525caf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:08.032514 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc458f-ebd4-44bb-af02-9fe17525caf6 admin admin] PATH_INFO: `/v3/projects/e0a8f97bcc70417e9609daad2c2d0ddf` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:08.033132 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-11777332-07ea-4156-bffe-0a9e8b52db06 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:26:08.033771 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bc458f-ebd4-44bb-af02-9fe17525caf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0a8f97bcc70417e9609daad2c2d0ddf)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:08.034377 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-11777332-07ea-4156-bffe-0a9e8b52db06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:08.035745 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bc458f-ebd4-44bb-af02-9fe17525caf6 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:08.043786 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1312/2639] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:26:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:26:08.050114 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11777332-07ea-4156-bffe-0a9e8b52db06 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:08.068204 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11777332-07ea-4156-bffe-0a9e8b52db06 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:08.073559 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb68b6b2-5967-40f4-a7f0-111a90f2697e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:08.074823 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68b6b2-5967-40f4-a7f0-111a90f2697e admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:08.075102 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68b6b2-5967-40f4-a7f0-111a90f2697e admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:08.075374 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68b6b2-5967-40f4-a7f0-111a90f2697e admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:08.076125 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb68b6b2-5967-40f4-a7f0-111a90f2697e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:26:08.076430 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb68b6b2-5967-40f4-a7f0-111a90f2697e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:08.078020 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb68b6b2-5967-40f4-a7f0-111a90f2697e admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:08.090081 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1313/2640] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 10 03:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:26:08.094401 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb68b6b2-5967-40f4-a7f0-111a90f2697e admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:08.104754 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb68b6b2-5967-40f4-a7f0-111a90f2697e admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:08.109473 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16e5965-85f3-4713-a9bb-8dfe8d68ffbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:08.110132 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e5965-85f3-4713-a9bb-8dfe8d68ffbc admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:08.110420 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e5965-85f3-4713-a9bb-8dfe8d68ffbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:08.110698 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e5965-85f3-4713-a9bb-8dfe8d68ffbc admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:08.111387 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16e5965-85f3-4713-a9bb-8dfe8d68ffbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:08.113317 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16e5965-85f3-4713-a9bb-8dfe8d68ffbc admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:08.177599 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-85bc458f-ebd4-44bb-af02-9fe17525caf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0a8f97bcc70417e9609daad2c2d0ddf', 'request_id': 'req-85bc458f-ebd4-44bb-af02-9fe17525caf6'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:08.182785 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-85bc458f-ebd4-44bb-af02-9fe17525caf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0a8f97bcc70417e9609daad2c2d0ddf', 'request_id': 'req-85bc458f-ebd4-44bb-af02-9fe17525caf6'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:08.188878 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-85bc458f-ebd4-44bb-af02-9fe17525caf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0a8f97bcc70417e9609daad2c2d0ddf', 'request_id': 'req-85bc458f-ebd4-44bb-af02-9fe17525caf6'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:08.229752 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1314/2641] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:26:08 2022] POST /identity/v3/projects => generated 363 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:26:08.233662 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16e5965-85f3-4713-a9bb-8dfe8d68ffbc admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:08.295157 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16e5965-85f3-4713-a9bb-8dfe8d68ffbc admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:08.300026 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c068bb0a-a1a4-48a2-b25a-26a88084adc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:08.300699 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c068bb0a-a1a4-48a2-b25a-26a88084adc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:08.300982 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c068bb0a-a1a4-48a2-b25a-26a88084adc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:08.301257 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c068bb0a-a1a4-48a2-b25a-26a88084adc9 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:08.301965 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c068bb0a-a1a4-48a2-b25a-26a88084adc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:08.303865 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c068bb0a-a1a4-48a2-b25a-26a88084adc9 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:08.317707 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-85bc458f-ebd4-44bb-af02-9fe17525caf6 admin admin] The token cache is being invalidate because project e0a8f97bcc70417e9609daad2c2d0ddf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:26:08.318428 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-85bc458f-ebd4-44bb-af02-9fe17525caf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:08.318985 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-85bc458f-ebd4-44bb-af02-9fe17525caf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:08.320731 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1328/2642] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:26:08 2022] DELETE /identity/v3/projects/e0a8f97bcc70417e9609daad2c2d0ddf => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:26:08.325915 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b622f0ef-6c08-4152-93df-29be7a994867 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:08.326207 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b622f0ef-6c08-4152-93df-29be7a994867 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:08.326490 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b622f0ef-6c08-4152-93df-29be7a994867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:08.352706 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-b622f0ef-6c08-4152-93df-29be7a994867 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:26:08.354065 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-b622f0ef-6c08-4152-93df-29be7a994867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:08.362769 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1329/2643] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:26:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:26:08.370347 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0dfa7e-8f25-4ba3-8883-f3a28d3d7cb5 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:08.371137 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0dfa7e-8f25-4ba3-8883-f3a28d3d7cb5 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:08.371416 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0dfa7e-8f25-4ba3-8883-f3a28d3d7cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:08.389502 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-1b0dfa7e-8f25-4ba3-8883-f3a28d3d7cb5 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:26:08.390767 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-1b0dfa7e-8f25-4ba3-8883-f3a28d3d7cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:08.401667 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1315/2644] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:26:08 2022] POST /identity/v3/users => generated 282 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:26:08.402245 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1330/2645] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:26:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:26:08.406133 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c068bb0a-a1a4-48a2-b25a-26a88084adc9 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:08.406306 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0dfa7e-8f25-4ba3-8883-f3a28d3d7cb5 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:08.406405 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-c068bb0a-a1a4-48a2-b25a-26a88084adc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:08.416230 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0dfa7e-8f25-4ba3-8883-f3a28d3d7cb5 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:08.418521 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c068bb0a-a1a4-48a2-b25a-26a88084adc9 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:08.420986 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083b3e59-0adc-402d-bbb9-a53bca693e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:08.421682 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b3e59-0adc-402d-bbb9-a53bca693e71 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:08.421985 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b3e59-0adc-402d-bbb9-a53bca693e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:08.422266 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b3e59-0adc-402d-bbb9-a53bca693e71 admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:08.422982 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083b3e59-0adc-402d-bbb9-a53bca693e71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:26:08.423293 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083b3e59-0adc-402d-bbb9-a53bca693e71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:08.423658 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f601c91e-d415-4dc2-b83c-6b06c4aa8b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:08.424312 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601c91e-d415-4dc2-b83c-6b06c4aa8b86 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:08.424598 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601c91e-d415-4dc2-b83c-6b06c4aa8b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:08.424875 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601c91e-d415-4dc2-b83c-6b06c4aa8b86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:08.425182 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083b3e59-0adc-402d-bbb9-a53bca693e71 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:08.425595 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f601c91e-d415-4dc2-b83c-6b06c4aa8b86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:08.427312 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f601c91e-d415-4dc2-b83c-6b06c4aa8b86 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:08.437014 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1331/2646] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 10 03:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:26:08.440420 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1316/2647] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:26:08.441546 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083b3e59-0adc-402d-bbb9-a53bca693e71 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:08.441785 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f601c91e-d415-4dc2-b83c-6b06c4aa8b86 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:08.453067 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083b3e59-0adc-402d-bbb9-a53bca693e71 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:08.456476 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f601c91e-d415-4dc2-b83c-6b06c4aa8b86 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:08.458489 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d087c5ca-a6c6-4540-89ca-0f6fd00d2f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:08.459160 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087c5ca-a6c6-4540-89ca-0f6fd00d2f80 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:08.459291 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb077832-55dd-4a1d-b67e-9aedecda771b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:08.459444 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087c5ca-a6c6-4540-89ca-0f6fd00d2f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:08.459743 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087c5ca-a6c6-4540-89ca-0f6fd00d2f80 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:08.460318 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb077832-55dd-4a1d-b67e-9aedecda771b admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:08.460438 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d087c5ca-a6c6-4540-89ca-0f6fd00d2f80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:08.460609 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb077832-55dd-4a1d-b67e-9aedecda771b admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:08.460893 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb077832-55dd-4a1d-b67e-9aedecda771b admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:08.461625 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb077832-55dd-4a1d-b67e-9aedecda771b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:08.462362 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d087c5ca-a6c6-4540-89ca-0f6fd00d2f80 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:08.463210 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb077832-55dd-4a1d-b67e-9aedecda771b admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:08.474786 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1332/2648] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:26:08.478846 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb077832-55dd-4a1d-b67e-9aedecda771b admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:08.489044 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb077832-55dd-4a1d-b67e-9aedecda771b admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:08.494021 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61082de9-5481-4c82-ae50-e443d58d868a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:08.494906 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61082de9-5481-4c82-ae50-e443d58d868a admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:08.495191 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61082de9-5481-4c82-ae50-e443d58d868a admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:08.495469 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61082de9-5481-4c82-ae50-e443d58d868a admin admin] PATH_INFO: `/v3/projects/0cd4495e040a4f9ba76b3b6384701384/users/908a9ee8ac9c45c6a45621d01cb1edd9/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:08.511064 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61082de9-5481-4c82-ae50-e443d58d868a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cd4495e040a4f9ba76b3b6384701384, user_id=908a9ee8ac9c45c6a45621d01cb1edd9, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:08.514430 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61082de9-5481-4c82-ae50-e443d58d868a admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:08.554477 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1317/2649] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:26:08 2022] POST /identity/v3/projects => generated 377 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:26:08.559657 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d087c5ca-a6c6-4540-89ca-0f6fd00d2f80 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:08.569969 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1333/2650] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:26:08 2022] PUT /identity/v3/projects/0cd4495e040a4f9ba76b3b6384701384/users/908a9ee8ac9c45c6a45621d01cb1edd9/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:26:08.592230 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c10155a-d41a-4a61-89fe-953a7cb9d801 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:08.592527 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c10155a-d41a-4a61-89fe-953a7cb9d801 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:08.592814 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c10155a-d41a-4a61-89fe-953a7cb9d801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:08.621556 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-2c10155a-d41a-4a61-89fe-953a7cb9d801 None None] MFA Rules not processed for user `908a9ee8ac9c45c6a45621d01cb1edd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:26:08.622771 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-2c10155a-d41a-4a61-89fe-953a7cb9d801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:08.625621 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d087c5ca-a6c6-4540-89ca-0f6fd00d2f80 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:08.684920 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd154e0-7727-42d9-9062-51fc80b892ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:08.685855 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd154e0-7727-42d9-9062-51fc80b892ea admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:08.686143 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd154e0-7727-42d9-9062-51fc80b892ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:08.686418 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd154e0-7727-42d9-9062-51fc80b892ea admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:08.687109 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd154e0-7727-42d9-9062-51fc80b892ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:08.687744 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1334/2651] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:26:08 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:26:08.689083 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd154e0-7727-42d9-9062-51fc80b892ea admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:08.695017 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c10155a-d41a-4a61-89fe-953a7cb9d801 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:08.706060 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c10155a-d41a-4a61-89fe-953a7cb9d801 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:08.710651 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6368cb10-fdda-44b8-8a9c-27f52ecc4b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:08.711300 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368cb10-fdda-44b8-8a9c-27f52ecc4b6b admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:08.711583 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368cb10-fdda-44b8-8a9c-27f52ecc4b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:08.711857 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368cb10-fdda-44b8-8a9c-27f52ecc4b6b admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:08.712615 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6368cb10-fdda-44b8-8a9c-27f52ecc4b6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:08.714504 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6368cb10-fdda-44b8-8a9c-27f52ecc4b6b admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:08.827604 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1318/2652] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:26:08 2022] POST /identity/v3/users => generated 289 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:26:08.831133 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1335/2653] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:26:08 2022] POST /identity/v3/projects => generated 363 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:26:08.831493 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd154e0-7727-42d9-9062-51fc80b892ea admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:08.834978 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6368cb10-fdda-44b8-8a9c-27f52ecc4b6b admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:08.842646 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd154e0-7727-42d9-9062-51fc80b892ea admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:08.898351 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6368cb10-fdda-44b8-8a9c-27f52ecc4b6b admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:08.905515 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e21dd4-2241-4820-b420-43403b19825c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:08.905659 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a9ac97-d9b9-4b44-afd8-35f531b9d0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:08.906189 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e21dd4-2241-4820-b420-43403b19825c admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:08.906481 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e21dd4-2241-4820-b420-43403b19825c admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:08.906764 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e21dd4-2241-4820-b420-43403b19825c admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:08.906985 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a9ac97-d9b9-4b44-afd8-35f531b9d0f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:08.907338 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a9ac97-d9b9-4b44-afd8-35f531b9d0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:08.907496 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e21dd4-2241-4820-b420-43403b19825c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:08.907674 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a9ac97-d9b9-4b44-afd8-35f531b9d0f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:08.908411 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a9ac97-d9b9-4b44-afd8-35f531b9d0f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:08.909396 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e21dd4-2241-4820-b420-43403b19825c admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:08.910582 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a9ac97-d9b9-4b44-afd8-35f531b9d0f2 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:08.923889 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1319/2654] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:26:08.927822 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e21dd4-2241-4820-b420-43403b19825c admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:08.939058 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e21dd4-2241-4820-b420-43403b19825c admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:08.943775 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ba74c-5bbe-4636-a8e8-0a5db46ceb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:08.944470 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ba74c-5bbe-4636-a8e8-0a5db46ceb57 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:08.944759 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ba74c-5bbe-4636-a8e8-0a5db46ceb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:08.945038 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ba74c-5bbe-4636-a8e8-0a5db46ceb57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:08.945932 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2ba74c-5bbe-4636-a8e8-0a5db46ceb57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:08.947604 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2ba74c-5bbe-4636-a8e8-0a5db46ceb57 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:08.961107 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1320/2655] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:26:08.962043 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ba74c-5bbe-4636-a8e8-0a5db46ceb57 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:08.972453 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ba74c-5bbe-4636-a8e8-0a5db46ceb57 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:08.977471 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a43aa0-9a18-4679-9e0c-72dfb72950e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:08.978361 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a43aa0-9a18-4679-9e0c-72dfb72950e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:08.978774 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a43aa0-9a18-4679-9e0c-72dfb72950e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:08.979116 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a43aa0-9a18-4679-9e0c-72dfb72950e3 admin admin] PATH_INFO: `/v3/projects/d5688118af734a7d9f38816b93736541/users/1536f6f6c8d045a5aeb087df3b25bbd9/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:08.997756 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a43aa0-9a18-4679-9e0c-72dfb72950e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5688118af734a7d9f38816b93736541, user_id=1536f6f6c8d045a5aeb087df3b25bbd9, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:08.998365 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1336/2656] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:26:08 2022] POST /identity/v3/users => generated 288 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:26:09.000517 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a43aa0-9a18-4679-9e0c-72dfb72950e3 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:09.002335 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a9ac97-d9b9-4b44-afd8-35f531b9d0f2 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:09.011944 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a9ac97-d9b9-4b44-afd8-35f531b9d0f2 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:09.016649 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7fce3a-a185-49b5-a136-7da0de1527ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:09.017315 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7fce3a-a185-49b5-a136-7da0de1527ce admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:09.017670 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7fce3a-a185-49b5-a136-7da0de1527ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:09.017977 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7fce3a-a185-49b5-a136-7da0de1527ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:09.018707 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7fce3a-a185-49b5-a136-7da0de1527ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:09.020440 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7fce3a-a185-49b5-a136-7da0de1527ce admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:09.030944 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1337/2657] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:26:09.034956 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7fce3a-a185-49b5-a136-7da0de1527ce admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:09.044876 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7fce3a-a185-49b5-a136-7da0de1527ce admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:09.049817 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d54b6-8d09-4f53-b428-f8dee5cfe51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:09.050671 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d54b6-8d09-4f53-b428-f8dee5cfe51e admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:09.050955 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d54b6-8d09-4f53-b428-f8dee5cfe51e admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:09.051235 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d54b6-8d09-4f53-b428-f8dee5cfe51e admin admin] PATH_INFO: `/v3/projects/c21e6ca6839543adb520a7134db6d25b/users/7d535dc2d85f47df9a4bab3cc3a141ad/roles/43105000610f402ca2486e7648018cca` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:09.068223 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605d54b6-8d09-4f53-b428-f8dee5cfe51e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c21e6ca6839543adb520a7134db6d25b, user_id=7d535dc2d85f47df9a4bab3cc3a141ad, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:09.070908 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605d54b6-8d09-4f53-b428-f8dee5cfe51e admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:09.102390 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1321/2658] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:26:08 2022] PUT /identity/v3/projects/d5688118af734a7d9f38816b93736541/users/1536f6f6c8d045a5aeb087df3b25bbd9/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:26:09.115319 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f44ac-ed18-49cd-b19c-abeabab636f8 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:09.115610 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f44ac-ed18-49cd-b19c-abeabab636f8 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:09.115892 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f44ac-ed18-49cd-b19c-abeabab636f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:09.142996 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-3b8f44ac-ed18-49cd-b19c-abeabab636f8 None None] MFA Rules not processed for user `1536f6f6c8d045a5aeb087df3b25bbd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:26:09.144247 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-3b8f44ac-ed18-49cd-b19c-abeabab636f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:09.181678 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1338/2659] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:26:09 2022] PUT /identity/v3/projects/c21e6ca6839543adb520a7134db6d25b/users/7d535dc2d85f47df9a4bab3cc3a141ad/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:26:09.185878 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d54b6-8d09-4f53-b428-f8dee5cfe51e admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:09.218184 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1322/2660] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:26:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:26:09.222543 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f44ac-ed18-49cd-b19c-abeabab636f8 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:09.257221 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d54b6-8d09-4f53-b428-f8dee5cfe51e admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:09.261991 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5676a6-c19a-4731-93fe-f07299ae17d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:09.262661 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5676a6-c19a-4731-93fe-f07299ae17d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:09.262941 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5676a6-c19a-4731-93fe-f07299ae17d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:09.263217 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5676a6-c19a-4731-93fe-f07299ae17d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:09.263948 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5676a6-c19a-4731-93fe-f07299ae17d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:09.265568 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5676a6-c19a-4731-93fe-f07299ae17d0 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:09.275837 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1339/2661] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:26:09.280480 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5676a6-c19a-4731-93fe-f07299ae17d0 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:09.288840 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f44ac-ed18-49cd-b19c-abeabab636f8 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:09.290372 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5676a6-c19a-4731-93fe-f07299ae17d0 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:09.294453 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f90b9-773a-4835-a317-2b36e3e9e191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:09.295405 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f90b9-773a-4835-a317-2b36e3e9e191 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:09.295694 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f90b9-773a-4835-a317-2b36e3e9e191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:09.295810 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5de44b-caf8-4712-be64-2d0e50b403f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:09.295978 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f90b9-773a-4835-a317-2b36e3e9e191 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:09.296638 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5de44b-caf8-4712-be64-2d0e50b403f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:09.296779 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1f90b9-773a-4835-a317-2b36e3e9e191 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:09.296928 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5de44b-caf8-4712-be64-2d0e50b403f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:09.297206 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5de44b-caf8-4712-be64-2d0e50b403f2 admin admin] PATH_INFO: `/v3/projects/c21e6ca6839543adb520a7134db6d25b/users/7d535dc2d85f47df9a4bab3cc3a141ad/roles/43105000610f402ca2486e7648018cca` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:09.298883 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1f90b9-773a-4835-a317-2b36e3e9e191 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:09.299553 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5de44b-caf8-4712-be64-2d0e50b403f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c21e6ca6839543adb520a7134db6d25b, user_id=7d535dc2d85f47df9a4bab3cc3a141ad, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:09.302640 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5de44b-caf8-4712-be64-2d0e50b403f2 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:09.313501 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1340/2662] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:26:09 2022] PUT /identity/v3/projects/c21e6ca6839543adb520a7134db6d25b/users/7d535dc2d85f47df9a4bab3cc3a141ad/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:26:09.323364 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d8e71-9cfa-49ad-afc8-092121a919bf None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:09.323955 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d8e71-9cfa-49ad-afc8-092121a919bf None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:09.323955 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d8e71-9cfa-49ad-afc8-092121a919bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:09.350887 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-f09d8e71-9cfa-49ad-afc8-092121a919bf None None] MFA Rules not processed for user `7d535dc2d85f47df9a4bab3cc3a141ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:26:09.352076 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-f09d8e71-9cfa-49ad-afc8-092121a919bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:09.406740 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1323/2663] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:26:09 2022] POST /identity/v3/projects => generated 379 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:26:09.410640 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f90b9-773a-4835-a317-2b36e3e9e191 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:09.421504 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1341/2664] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:26:09 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:26:09.435622 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09d8e71-9cfa-49ad-afc8-092121a919bf None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:09.437303 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-f09d8e71-9cfa-49ad-afc8-092121a919bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:09.481224 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f90b9-773a-4835-a317-2b36e3e9e191 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:09.486018 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb9deb-ff05-46b2-8903-643f718557c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:09.486697 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb9deb-ff05-46b2-8903-643f718557c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:09.486978 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb9deb-ff05-46b2-8903-643f718557c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:09.487255 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb9deb-ff05-46b2-8903-643f718557c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:09.488034 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cb9deb-ff05-46b2-8903-643f718557c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:09.489956 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cb9deb-ff05-46b2-8903-643f718557c7 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:09.497256 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09d8e71-9cfa-49ad-afc8-092121a919bf None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:09.546246 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09d101-8cdf-49a1-8a2f-ee5404000c29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:09.546897 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09d101-8cdf-49a1-8a2f-ee5404000c29 service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:09.547185 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09d101-8cdf-49a1-8a2f-ee5404000c29 service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:09.547468 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09d101-8cdf-49a1-8a2f-ee5404000c29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:09.598382 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1324/2665] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:26:09 2022] POST /identity/v3/users => generated 290 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:26:09.602531 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb9deb-ff05-46b2-8903-643f718557c7 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:09.608451 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc09d101-8cdf-49a1-8a2f-ee5404000c29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:09.609927 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc09d101-8cdf-49a1-8a2f-ee5404000c29 service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:09.612253 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb9deb-ff05-46b2-8903-643f718557c7 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:09.617182 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ecc1bc-0081-4c72-947b-3f431c2b6ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:09.617892 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ecc1bc-0081-4c72-947b-3f431c2b6ad4 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:09.618185 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ecc1bc-0081-4c72-947b-3f431c2b6ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:09.618467 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ecc1bc-0081-4c72-947b-3f431c2b6ad4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:09.619205 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ecc1bc-0081-4c72-947b-3f431c2b6ad4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:09.619739 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1342/2666] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:26:09 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:26:09.620940 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ecc1bc-0081-4c72-947b-3f431c2b6ad4 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:09.634431 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1325/2667] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:26:09.635628 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09d101-8cdf-49a1-8a2f-ee5404000c29 service cinder] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:09.647838 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09d101-8cdf-49a1-8a2f-ee5404000c29 service cinder] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:09.653360 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97686c8-3708-4e85-bf10-ba2d2ca1666e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:09.654512 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97686c8-3708-4e85-bf10-ba2d2ca1666e admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:09.655000 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97686c8-3708-4e85-bf10-ba2d2ca1666e admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:09.655289 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97686c8-3708-4e85-bf10-ba2d2ca1666e admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:09.657067 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97686c8-3708-4e85-bf10-ba2d2ca1666e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:09.658339 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97686c8-3708-4e85-bf10-ba2d2ca1666e admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:09.668682 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1343/2668] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:26:09.674932 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ecc1bc-0081-4c72-947b-3f431c2b6ad4 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:09.685285 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ecc1bc-0081-4c72-947b-3f431c2b6ad4 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:09.690103 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede3297d-8cf5-4b56-a87d-18ac80e29393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:09.690987 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede3297d-8cf5-4b56-a87d-18ac80e29393 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:09.691275 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede3297d-8cf5-4b56-a87d-18ac80e29393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:09.691562 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede3297d-8cf5-4b56-a87d-18ac80e29393 admin admin] PATH_INFO: `/v3/projects/5377579f4db046cc973bd45d3b5e915d/users/e624e6e5ab64401d98854d1cc7b1b340/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:09.708123 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede3297d-8cf5-4b56-a87d-18ac80e29393 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5377579f4db046cc973bd45d3b5e915d, user_id=e624e6e5ab64401d98854d1cc7b1b340, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:09.710810 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede3297d-8cf5-4b56-a87d-18ac80e29393 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:09.793232 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1326/2669] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:26:09 2022] PUT /identity/v3/projects/5377579f4db046cc973bd45d3b5e915d/users/e624e6e5ab64401d98854d1cc7b1b340/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:26:09.804170 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf2425-d9a7-4af7-8245-1a902d532469 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:09.804485 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf2425-d9a7-4af7-8245-1a902d532469 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:09.804765 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf2425-d9a7-4af7-8245-1a902d532469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:09.834560 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-6acf2425-d9a7-4af7-8245-1a902d532469 None None] MFA Rules not processed for user `e624e6e5ab64401d98854d1cc7b1b340`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:26:09.835242 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede3297d-8cf5-4b56-a87d-18ac80e29393 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:09.835812 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-6acf2425-d9a7-4af7-8245-1a902d532469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:09.892435 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede3297d-8cf5-4b56-a87d-18ac80e29393 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:09.896163 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e508d305-e66a-414e-b6b1-b9a2f38edcf5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:09.896812 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508d305-e66a-414e-b6b1-b9a2f38edcf5 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:09.897088 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508d305-e66a-414e-b6b1-b9a2f38edcf5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:09.897368 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508d305-e66a-414e-b6b1-b9a2f38edcf5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:09.901557 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1344/2670] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:26:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:26:09.906025 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf2425-d9a7-4af7-8245-1a902d532469 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:09.957179 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e508d305-e66a-414e-b6b1-b9a2f38edcf5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:09.958635 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e508d305-e66a-414e-b6b1-b9a2f38edcf5 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:09.967526 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1327/2671] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:26:09 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:26:09.969588 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf2425-d9a7-4af7-8245-1a902d532469 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:09.974632 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3789566d-fe3c-46c6-bc29-b893bc58634e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:09.975300 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789566d-fe3c-46c6-bc29-b893bc58634e admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:09.975585 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789566d-fe3c-46c6-bc29-b893bc58634e admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:09.975864 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789566d-fe3c-46c6-bc29-b893bc58634e admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:09.976589 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3789566d-fe3c-46c6-bc29-b893bc58634e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:09.978512 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3789566d-fe3c-46c6-bc29-b893bc58634e admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:10.080620 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1345/2672] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:26:09 2022] POST /identity/v3/projects => generated 379 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:26:10.084718 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e508d305-e66a-414e-b6b1-b9a2f38edcf5 service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:10.095881 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e508d305-e66a-414e-b6b1-b9a2f38edcf5 service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:10.153970 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cdb5dc-f95a-4073-a437-5d717128066f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:10.154652 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cdb5dc-f95a-4073-a437-5d717128066f admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:10.154939 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cdb5dc-f95a-4073-a437-5d717128066f admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:10.155216 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cdb5dc-f95a-4073-a437-5d717128066f admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:10.155919 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cdb5dc-f95a-4073-a437-5d717128066f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:10.157917 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cdb5dc-f95a-4073-a437-5d717128066f admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:10.264976 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1328/2673] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:26:10 2022] POST /identity/v3/users => generated 296 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:26:10.267486 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3789566d-fe3c-46c6-bc29-b893bc58634e admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:10.277805 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3789566d-fe3c-46c6-bc29-b893bc58634e admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:10.286765 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1214ad79-4d44-4ebb-a82b-56fbbbcec67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:10.287459 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1214ad79-4d44-4ebb-a82b-56fbbbcec67a admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:10.287747 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1214ad79-4d44-4ebb-a82b-56fbbbcec67a admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:10.288178 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1214ad79-4d44-4ebb-a82b-56fbbbcec67a admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:10.289209 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1214ad79-4d44-4ebb-a82b-56fbbbcec67a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:10.290438 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1214ad79-4d44-4ebb-a82b-56fbbbcec67a admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:10.302665 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1346/2674] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:26:10.307044 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cdb5dc-f95a-4073-a437-5d717128066f admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:10.318467 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cdb5dc-f95a-4073-a437-5d717128066f admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:10.323209 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55af238-e635-4a80-853f-07be2f2ca365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:10.324152 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55af238-e635-4a80-853f-07be2f2ca365 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:10.332243 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55af238-e635-4a80-853f-07be2f2ca365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:10.332243 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55af238-e635-4a80-853f-07be2f2ca365 admin admin] PATH_INFO: `/v3/projects/0a0fd8d8d40d446db33240f651ad8c1f/users/34f8bedf88224228a47171275293d658/roles/43105000610f402ca2486e7648018cca` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:10.340301 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55af238-e635-4a80-853f-07be2f2ca365 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a0fd8d8d40d446db33240f651ad8c1f, user_id=34f8bedf88224228a47171275293d658, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:10.343513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55af238-e635-4a80-853f-07be2f2ca365 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:10.438138 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1329/2675] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:26:10 2022] PUT /identity/v3/projects/0a0fd8d8d40d446db33240f651ad8c1f/users/34f8bedf88224228a47171275293d658/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:26:10.444152 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1214ad79-4d44-4ebb-a82b-56fbbbcec67a admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:10.455085 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1214ad79-4d44-4ebb-a82b-56fbbbcec67a admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:10.515697 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dba0aa-99c6-434d-8938-eb5e4280f2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:10.516458 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dba0aa-99c6-434d-8938-eb5e4280f2a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:10.516742 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dba0aa-99c6-434d-8938-eb5e4280f2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:10.517070 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dba0aa-99c6-434d-8938-eb5e4280f2a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:10.517873 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dba0aa-99c6-434d-8938-eb5e4280f2a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:10.519465 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dba0aa-99c6-434d-8938-eb5e4280f2a7 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:10.529239 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1347/2676] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:26:10.533477 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55af238-e635-4a80-853f-07be2f2ca365 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:10.544570 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55af238-e635-4a80-853f-07be2f2ca365 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:10.549923 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82390370-7608-4a8f-8bad-73f8b3170912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:10.550842 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82390370-7608-4a8f-8bad-73f8b3170912 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:10.551165 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82390370-7608-4a8f-8bad-73f8b3170912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:10.551450 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82390370-7608-4a8f-8bad-73f8b3170912 admin admin] PATH_INFO: `/v3/projects/0a0fd8d8d40d446db33240f651ad8c1f/users/34f8bedf88224228a47171275293d658/roles/43105000610f402ca2486e7648018cca` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:10.553674 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82390370-7608-4a8f-8bad-73f8b3170912 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a0fd8d8d40d446db33240f651ad8c1f, user_id=34f8bedf88224228a47171275293d658, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:10.557030 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82390370-7608-4a8f-8bad-73f8b3170912 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:10.568682 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1330/2677] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:26:10 2022] PUT /identity/v3/projects/0a0fd8d8d40d446db33240f651ad8c1f/users/34f8bedf88224228a47171275293d658/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:26:10.579246 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89591065-182d-4a51-9653-672fe5ff5fe1 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:10.579649 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89591065-182d-4a51-9653-672fe5ff5fe1 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:10.579938 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89591065-182d-4a51-9653-672fe5ff5fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:10.617339 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-89591065-182d-4a51-9653-672fe5ff5fe1 None None] MFA Rules not processed for user `34f8bedf88224228a47171275293d658`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:26:10.618615 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-89591065-182d-4a51-9653-672fe5ff5fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:10.688362 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1348/2678] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:26:10 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:26:10.704723 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82390370-7608-4a8f-8bad-73f8b3170912 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:10.764081 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82390370-7608-4a8f-8bad-73f8b3170912 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:10.767753 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a291257-e02f-4752-9e2f-59482450187c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:10.768429 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a291257-e02f-4752-9e2f-59482450187c service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:10.768710 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a291257-e02f-4752-9e2f-59482450187c service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:10.768984 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a291257-e02f-4752-9e2f-59482450187c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:10.778804 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a291257-e02f-4752-9e2f-59482450187c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:10.780301 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a291257-e02f-4752-9e2f-59482450187c service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:10.791578 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1331/2679] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:26:10 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:26:11.026621 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89591065-182d-4a51-9653-672fe5ff5fe1 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:11.028859 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-89591065-182d-4a51-9653-672fe5ff5fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:11.045000 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89591065-182d-4a51-9653-672fe5ff5fe1 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:11.046744 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f1425-c754-47ae-84a3-76d3ef465883 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:11.047535 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f1425-c754-47ae-84a3-76d3ef465883 service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:11.047872 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f1425-c754-47ae-84a3-76d3ef465883 service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:11.048178 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f1425-c754-47ae-84a3-76d3ef465883 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:11.105449 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558f1425-c754-47ae-84a3-76d3ef465883 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:11.106866 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558f1425-c754-47ae-84a3-76d3ef465883 service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:11.116037 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1349/2680] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:26:11 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:26:13.726142 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a291257-e02f-4752-9e2f-59482450187c service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:13.790880 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a291257-e02f-4752-9e2f-59482450187c service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:13.795450 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5113c7-7852-46c4-9014-124c7b395a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:13.796380 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5113c7-7852-46c4-9014-124c7b395a54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:13.796671 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5113c7-7852-46c4-9014-124c7b395a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:13.796950 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5113c7-7852-46c4-9014-124c7b395a54 admin admin] PATH_INFO: `/v3/users/908a9ee8ac9c45c6a45621d01cb1edd9` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:13.802221 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5113c7-7852-46c4-9014-124c7b395a54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=908a9ee8ac9c45c6a45621d01cb1edd9)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:13.804227 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5113c7-7852-46c4-9014-124c7b395a54 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:14.007952 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-ea5113c7-7852-46c4-9014-124c7b395a54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '908a9ee8ac9c45c6a45621d01cb1edd9'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:14.008868 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-ea5113c7-7852-46c4-9014-124c7b395a54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '908a9ee8ac9c45c6a45621d01cb1edd9'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:14.017132 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-ea5113c7-7852-46c4-9014-124c7b395a54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '908a9ee8ac9c45c6a45621d01cb1edd9'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:14.129494 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-ea5113c7-7852-46c4-9014-124c7b395a54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '908a9ee8ac9c45c6a45621d01cb1edd9'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:14.130203 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-ea5113c7-7852-46c4-9014-124c7b395a54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '908a9ee8ac9c45c6a45621d01cb1edd9'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:14.149092 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1332/2681] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:26:13 2022] DELETE /identity/v3/users/908a9ee8ac9c45c6a45621d01cb1edd9 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:26:14.154471 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c78aa-7809-4b43-b498-55b47bf3ab08 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:14.154950 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c78aa-7809-4b43-b498-55b47bf3ab08 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:14.162593 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c78aa-7809-4b43-b498-55b47bf3ab08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:14.172368 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-704c78aa-7809-4b43-b498-55b47bf3ab08 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:26:14.173826 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-704c78aa-7809-4b43-b498-55b47bf3ab08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:14.236873 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1350/2682] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:26:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:26:14.246782 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5113c7-7852-46c4-9014-124c7b395a54 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:14.248275 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-ea5113c7-7852-46c4-9014-124c7b395a54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:14.310171 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5113c7-7852-46c4-9014-124c7b395a54 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:14.314032 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e33b991-0fd2-460b-bf50-e56294d270ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:14.314600 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33b991-0fd2-460b-bf50-e56294d270ff service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:14.314907 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33b991-0fd2-460b-bf50-e56294d270ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:14.315159 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33b991-0fd2-460b-bf50-e56294d270ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:14.324950 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e33b991-0fd2-460b-bf50-e56294d270ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:14.326484 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e33b991-0fd2-460b-bf50-e56294d270ff service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:14.336645 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1333/2683] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:26:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:26:14.725187 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704c78aa-7809-4b43-b498-55b47bf3ab08 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:14.727057 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-704c78aa-7809-4b43-b498-55b47bf3ab08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:14.740106 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704c78aa-7809-4b43-b498-55b47bf3ab08 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:14.744982 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a203672-3b62-4116-8a9a-654deefafcf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:14.745860 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a203672-3b62-4116-8a9a-654deefafcf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:14.746704 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a203672-3b62-4116-8a9a-654deefafcf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:14.747022 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a203672-3b62-4116-8a9a-654deefafcf9 admin admin] PATH_INFO: `/v3/projects/0cd4495e040a4f9ba76b3b6384701384` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:14.748279 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a203672-3b62-4116-8a9a-654deefafcf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cd4495e040a4f9ba76b3b6384701384)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:14.750322 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a203672-3b62-4116-8a9a-654deefafcf9 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:14.844636 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-9a203672-3b62-4116-8a9a-654deefafcf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cd4495e040a4f9ba76b3b6384701384', 'request_id': 'req-9a203672-3b62-4116-8a9a-654deefafcf9'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:14.850305 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-9a203672-3b62-4116-8a9a-654deefafcf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cd4495e040a4f9ba76b3b6384701384', 'request_id': 'req-9a203672-3b62-4116-8a9a-654deefafcf9'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:14.856943 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-9a203672-3b62-4116-8a9a-654deefafcf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cd4495e040a4f9ba76b3b6384701384', 'request_id': 'req-9a203672-3b62-4116-8a9a-654deefafcf9'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:14.926551 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-9a203672-3b62-4116-8a9a-654deefafcf9 admin admin] The token cache is being invalidate because project 0cd4495e040a4f9ba76b3b6384701384 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:26:14.926888 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-9a203672-3b62-4116-8a9a-654deefafcf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:14.927627 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-9a203672-3b62-4116-8a9a-654deefafcf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:14.929360 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1351/2684] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:26:14 2022] DELETE /identity/v3/projects/0cd4495e040a4f9ba76b3b6384701384 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:26:14.934142 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e33b991-0fd2-460b-bf50-e56294d270ff service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:14.943953 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e33b991-0fd2-460b-bf50-e56294d270ff service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:15.000249 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d9641b-abb9-4aa3-be95-7f0b1fe61e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:15.001056 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9641b-abb9-4aa3-be95-7f0b1fe61e83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:15.001340 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9641b-abb9-4aa3-be95-7f0b1fe61e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:15.001615 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9641b-abb9-4aa3-be95-7f0b1fe61e83 admin admin] PATH_INFO: `/v3/users/7d535dc2d85f47df9a4bab3cc3a141ad` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:15.002828 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d9641b-abb9-4aa3-be95-7f0b1fe61e83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d535dc2d85f47df9a4bab3cc3a141ad)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:15.004803 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d9641b-abb9-4aa3-be95-7f0b1fe61e83 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:15.197521 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a203672-3b62-4116-8a9a-654deefafcf9 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:15.198888 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-9a203672-3b62-4116-8a9a-654deefafcf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:15.200627 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f6d9641b-abb9-4aa3-be95-7f0b1fe61e83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d535dc2d85f47df9a4bab3cc3a141ad'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:15.201288 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f6d9641b-abb9-4aa3-be95-7f0b1fe61e83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d535dc2d85f47df9a4bab3cc3a141ad'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:15.208693 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f6d9641b-abb9-4aa3-be95-7f0b1fe61e83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d535dc2d85f47df9a4bab3cc3a141ad'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:15.211548 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a203672-3b62-4116-8a9a-654deefafcf9 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:15.217448 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b6795f-8078-4bdd-bc0b-5dc802fc417a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:15.223426 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6795f-8078-4bdd-bc0b-5dc802fc417a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:15.223426 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6795f-8078-4bdd-bc0b-5dc802fc417a admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:15.223426 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6795f-8078-4bdd-bc0b-5dc802fc417a admin admin] PATH_INFO: `/v3/users/1536f6f6c8d045a5aeb087df3b25bbd9` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:15.223426 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b6795f-8078-4bdd-bc0b-5dc802fc417a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1536f6f6c8d045a5aeb087df3b25bbd9)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:15.223426 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b6795f-8078-4bdd-bc0b-5dc802fc417a admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:15.289683 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f6d9641b-abb9-4aa3-be95-7f0b1fe61e83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d535dc2d85f47df9a4bab3cc3a141ad'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:15.295166 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f6d9641b-abb9-4aa3-be95-7f0b1fe61e83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d535dc2d85f47df9a4bab3cc3a141ad'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:15.309844 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1334/2685] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:26:14 2022] DELETE /identity/v3/users/7d535dc2d85f47df9a4bab3cc3a141ad => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:26:15.391438 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-52b6795f-8078-4bdd-bc0b-5dc802fc417a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1536f6f6c8d045a5aeb087df3b25bbd9'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:15.398737 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-52b6795f-8078-4bdd-bc0b-5dc802fc417a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1536f6f6c8d045a5aeb087df3b25bbd9'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:15.412300 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-52b6795f-8078-4bdd-bc0b-5dc802fc417a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1536f6f6c8d045a5aeb087df3b25bbd9'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:15.413709 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-52b6795f-8078-4bdd-bc0b-5dc802fc417a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1536f6f6c8d045a5aeb087df3b25bbd9'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:15.414563 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-52b6795f-8078-4bdd-bc0b-5dc802fc417a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1536f6f6c8d045a5aeb087df3b25bbd9'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:15.494854 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1352/2686] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:26:15 2022] DELETE /identity/v3/users/1536f6f6c8d045a5aeb087df3b25bbd9 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:26:15.499761 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72573b2b-19a9-4373-9a49-7f19bd20cee7 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:15.500080 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72573b2b-19a9-4373-9a49-7f19bd20cee7 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:15.500361 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72573b2b-19a9-4373-9a49-7f19bd20cee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:15.518007 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-72573b2b-19a9-4373-9a49-7f19bd20cee7 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:26:15.519311 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-72573b2b-19a9-4373-9a49-7f19bd20cee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:15.588642 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1335/2687] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:26:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:26:15.599379 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b6795f-8078-4bdd-bc0b-5dc802fc417a admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:15.600828 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-52b6795f-8078-4bdd-bc0b-5dc802fc417a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:15.659903 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b6795f-8078-4bdd-bc0b-5dc802fc417a admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:15.665456 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c679bda2-de9c-404b-9fb1-68bd673fc0e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:15.666131 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679bda2-de9c-404b-9fb1-68bd673fc0e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:15.666488 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679bda2-de9c-404b-9fb1-68bd673fc0e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:15.675470 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679bda2-de9c-404b-9fb1-68bd673fc0e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:15.680816 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c679bda2-de9c-404b-9fb1-68bd673fc0e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:15.682270 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c679bda2-de9c-404b-9fb1-68bd673fc0e5 service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:15.694632 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1353/2688] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:26:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:26:15.793384 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72573b2b-19a9-4373-9a49-7f19bd20cee7 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:15.794920 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-72573b2b-19a9-4373-9a49-7f19bd20cee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:15.812646 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72573b2b-19a9-4373-9a49-7f19bd20cee7 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:15.817502 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c65e09-26b5-4359-a9c1-2ae0b9ddc8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:15.819123 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c65e09-26b5-4359-a9c1-2ae0b9ddc8a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:15.819445 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c65e09-26b5-4359-a9c1-2ae0b9ddc8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:15.819878 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c65e09-26b5-4359-a9c1-2ae0b9ddc8a4 admin admin] PATH_INFO: `/v3/projects/c21e6ca6839543adb520a7134db6d25b` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:15.822052 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c65e09-26b5-4359-a9c1-2ae0b9ddc8a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c21e6ca6839543adb520a7134db6d25b)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:15.824273 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c65e09-26b5-4359-a9c1-2ae0b9ddc8a4 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:15.908435 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-37c65e09-26b5-4359-a9c1-2ae0b9ddc8a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c21e6ca6839543adb520a7134db6d25b', 'request_id': 'req-37c65e09-26b5-4359-a9c1-2ae0b9ddc8a4'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:15.913986 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-37c65e09-26b5-4359-a9c1-2ae0b9ddc8a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c21e6ca6839543adb520a7134db6d25b', 'request_id': 'req-37c65e09-26b5-4359-a9c1-2ae0b9ddc8a4'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:15.920778 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-37c65e09-26b5-4359-a9c1-2ae0b9ddc8a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c21e6ca6839543adb520a7134db6d25b', 'request_id': 'req-37c65e09-26b5-4359-a9c1-2ae0b9ddc8a4'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:16.008991 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-37c65e09-26b5-4359-a9c1-2ae0b9ddc8a4 admin admin] The token cache is being invalidate because project c21e6ca6839543adb520a7134db6d25b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:26:16.010660 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-37c65e09-26b5-4359-a9c1-2ae0b9ddc8a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:16.010660 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-37c65e09-26b5-4359-a9c1-2ae0b9ddc8a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:16.012273 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1336/2689] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:26:15 2022] DELETE /identity/v3/projects/c21e6ca6839543adb520a7134db6d25b => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:26:16.017322 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e349243-68bd-4baa-b3a9-9f70d380963b None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:16.017657 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e349243-68bd-4baa-b3a9-9f70d380963b None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:16.017986 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e349243-68bd-4baa-b3a9-9f70d380963b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:16.039109 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-7e349243-68bd-4baa-b3a9-9f70d380963b None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:26:16.040338 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-7e349243-68bd-4baa-b3a9-9f70d380963b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:16.108570 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1354/2690] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:26:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:26:16.121309 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349d3f1-320c-4552-8a51-b89c4bbf46d0 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:16.121633 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349d3f1-320c-4552-8a51-b89c4bbf46d0 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:16.121921 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349d3f1-320c-4552-8a51-b89c4bbf46d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:16.144549 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-1349d3f1-320c-4552-8a51-b89c4bbf46d0 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:26:16.145782 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-1349d3f1-320c-4552-8a51-b89c4bbf46d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:16.159319 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e349243-68bd-4baa-b3a9-9f70d380963b None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:16.159856 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1337/2691] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:26:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:26:16.171416 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e349243-68bd-4baa-b3a9-9f70d380963b None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:16.177050 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee95ce2c-fb73-4078-ada8-7c5abd990989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:16.177833 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95ce2c-fb73-4078-ada8-7c5abd990989 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:16.178170 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95ce2c-fb73-4078-ada8-7c5abd990989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:16.178450 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95ce2c-fb73-4078-ada8-7c5abd990989 admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:16.179231 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee95ce2c-fb73-4078-ada8-7c5abd990989 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:26:16.179690 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee95ce2c-fb73-4078-ada8-7c5abd990989 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:16.181401 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee95ce2c-fb73-4078-ada8-7c5abd990989 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:16.200119 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1349d3f1-320c-4552-8a51-b89c4bbf46d0 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:16.200343 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1355/2692] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 10 03:26:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:26:16.210597 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1349d3f1-320c-4552-8a51-b89c4bbf46d0 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:16.216110 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c693ac4-345b-4b71-9cb9-17f784908bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:16.217068 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c693ac4-345b-4b71-9cb9-17f784908bee admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:16.217428 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c693ac4-345b-4b71-9cb9-17f784908bee admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:16.217785 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c693ac4-345b-4b71-9cb9-17f784908bee admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:16.218554 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c693ac4-345b-4b71-9cb9-17f784908bee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:16.220570 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c693ac4-345b-4b71-9cb9-17f784908bee admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:16.308228 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1338/2693] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:26:16 2022] POST /identity/v3/projects => generated 377 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:26:16.312359 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee95ce2c-fb73-4078-ada8-7c5abd990989 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:16.320715 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c693ac4-345b-4b71-9cb9-17f784908bee admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:16.322564 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-0c693ac4-345b-4b71-9cb9-17f784908bee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:16.323410 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee95ce2c-fb73-4078-ada8-7c5abd990989 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:16.390275 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb7a426-7c75-4e8c-bed1-720c68f302d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:16.390957 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7a426-7c75-4e8c-bed1-720c68f302d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:16.391245 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7a426-7c75-4e8c-bed1-720c68f302d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:16.391521 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7a426-7c75-4e8c-bed1-720c68f302d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:16.392418 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb7a426-7c75-4e8c-bed1-720c68f302d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:16.395677 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb7a426-7c75-4e8c-bed1-720c68f302d9 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:16.395818 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c693ac4-345b-4b71-9cb9-17f784908bee admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:16.399947 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6eb636-c1ed-4a8c-8ddd-fd6b4db4eb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:16.400953 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6eb636-c1ed-4a8c-8ddd-fd6b4db4eb6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:16.401484 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6eb636-c1ed-4a8c-8ddd-fd6b4db4eb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:16.401645 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6eb636-c1ed-4a8c-8ddd-fd6b4db4eb6f admin admin] PATH_INFO: `/v3/projects/d5688118af734a7d9f38816b93736541` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:16.404464 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6eb636-c1ed-4a8c-8ddd-fd6b4db4eb6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5688118af734a7d9f38816b93736541)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:16.406843 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6eb636-c1ed-4a8c-8ddd-fd6b4db4eb6f admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:16.510615 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1356/2694] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:26:16 2022] POST /identity/v3/users => generated 289 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:26:16.512360 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb7a426-7c75-4e8c-bed1-720c68f302d9 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:16.522423 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb7a426-7c75-4e8c-bed1-720c68f302d9 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:16.527326 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe402901-bec6-4b7d-9652-820ee36805b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:16.533210 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe402901-bec6-4b7d-9652-820ee36805b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:16.533210 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe402901-bec6-4b7d-9652-820ee36805b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:16.533210 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe402901-bec6-4b7d-9652-820ee36805b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:16.533210 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe402901-bec6-4b7d-9652-820ee36805b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:16.533210 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe402901-bec6-4b7d-9652-820ee36805b3 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:16.547417 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1357/2695] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:26:16.548528 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe402901-bec6-4b7d-9652-820ee36805b3 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:16.561952 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8d6eb636-c1ed-4a8c-8ddd-fd6b4db4eb6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5688118af734a7d9f38816b93736541', 'request_id': 'req-8d6eb636-c1ed-4a8c-8ddd-fd6b4db4eb6f'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:16.562124 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe402901-bec6-4b7d-9652-820ee36805b3 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:16.564235 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8d6eb636-c1ed-4a8c-8ddd-fd6b4db4eb6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5688118af734a7d9f38816b93736541', 'request_id': 'req-8d6eb636-c1ed-4a8c-8ddd-fd6b4db4eb6f'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:16.570582 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8d6eb636-c1ed-4a8c-8ddd-fd6b4db4eb6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5688118af734a7d9f38816b93736541', 'request_id': 'req-8d6eb636-c1ed-4a8c-8ddd-fd6b4db4eb6f'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:16.618715 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72faf266-54f1-4172-8bed-f236166b1313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:16.620166 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72faf266-54f1-4172-8bed-f236166b1313 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:16.620456 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72faf266-54f1-4172-8bed-f236166b1313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:16.620763 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72faf266-54f1-4172-8bed-f236166b1313 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:16.622549 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72faf266-54f1-4172-8bed-f236166b1313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:16.624803 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72faf266-54f1-4172-8bed-f236166b1313 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:16.636039 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1358/2696] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:26:16.643695 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8d6eb636-c1ed-4a8c-8ddd-fd6b4db4eb6f admin admin] The token cache is being invalidate because project d5688118af734a7d9f38816b93736541 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:26:16.643991 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8d6eb636-c1ed-4a8c-8ddd-fd6b4db4eb6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:16.649093 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72faf266-54f1-4172-8bed-f236166b1313 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:16.649218 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8d6eb636-c1ed-4a8c-8ddd-fd6b4db4eb6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:16.649218 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1339/2697] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:26:16 2022] DELETE /identity/v3/projects/d5688118af734a7d9f38816b93736541 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:26:16.649480 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-72faf266-54f1-4172-8bed-f236166b1313 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:16.652778 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6eb636-c1ed-4a8c-8ddd-fd6b4db4eb6f admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:16.654281 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-8d6eb636-c1ed-4a8c-8ddd-fd6b4db4eb6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:16.662880 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72faf266-54f1-4172-8bed-f236166b1313 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:16.668060 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9360becf-f3b6-4dee-86f5-73f3a66a9108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:16.668955 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360becf-f3b6-4dee-86f5-73f3a66a9108 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:16.669240 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360becf-f3b6-4dee-86f5-73f3a66a9108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:16.669517 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360becf-f3b6-4dee-86f5-73f3a66a9108 admin admin] PATH_INFO: `/v3/projects/942f5695f3e54d4c868cfcb43567d799/users/cce24751d03344c295568f626803a5bf/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:16.672517 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6eb636-c1ed-4a8c-8ddd-fd6b4db4eb6f admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:16.679681 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fcc016-f5f4-4266-bf95-1d093313a13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:16.680869 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fcc016-f5f4-4266-bf95-1d093313a13b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:16.681272 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fcc016-f5f4-4266-bf95-1d093313a13b admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:16.681629 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fcc016-f5f4-4266-bf95-1d093313a13b admin admin] PATH_INFO: `/v3/users/e624e6e5ab64401d98854d1cc7b1b340` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:16.683255 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fcc016-f5f4-4266-bf95-1d093313a13b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e624e6e5ab64401d98854d1cc7b1b340)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:16.685537 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fcc016-f5f4-4266-bf95-1d093313a13b admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:16.685781 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9360becf-f3b6-4dee-86f5-73f3a66a9108 admin admin] RBAC: Authorizing `identity:create_grant(project_id=942f5695f3e54d4c868cfcb43567d799, user_id=cce24751d03344c295568f626803a5bf, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:16.688650 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9360becf-f3b6-4dee-86f5-73f3a66a9108 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:16.774383 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1359/2698] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:26:16 2022] PUT /identity/v3/projects/942f5695f3e54d4c868cfcb43567d799/users/cce24751d03344c295568f626803a5bf/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:26:16.785744 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f26cdf-2644-4739-8eda-13d39a77d8c3 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:16.786071 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f26cdf-2644-4739-8eda-13d39a77d8c3 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:16.786350 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f26cdf-2644-4739-8eda-13d39a77d8c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:16.814382 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-31f26cdf-2644-4739-8eda-13d39a77d8c3 None None] MFA Rules not processed for user `cce24751d03344c295568f626803a5bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:26:16.817333 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-31f26cdf-2644-4739-8eda-13d39a77d8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:16.875378 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-65fcc016-f5f4-4266-bf95-1d093313a13b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e624e6e5ab64401d98854d1cc7b1b340'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:16.876133 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-65fcc016-f5f4-4266-bf95-1d093313a13b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e624e6e5ab64401d98854d1cc7b1b340'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:16.882847 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-65fcc016-f5f4-4266-bf95-1d093313a13b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e624e6e5ab64401d98854d1cc7b1b340'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:16.883931 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1360/2699] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:26:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:26:16.888691 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f26cdf-2644-4739-8eda-13d39a77d8c3 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:16.888691 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-31f26cdf-2644-4739-8eda-13d39a77d8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:16.946929 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-65fcc016-f5f4-4266-bf95-1d093313a13b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e624e6e5ab64401d98854d1cc7b1b340'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:16.947596 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-65fcc016-f5f4-4266-bf95-1d093313a13b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e624e6e5ab64401d98854d1cc7b1b340'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:16.951780 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f26cdf-2644-4739-8eda-13d39a77d8c3 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:16.956403 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b111db3-1c75-4e10-832d-506346ba5659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:16.957265 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b111db3-1c75-4e10-832d-506346ba5659 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:16.959626 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b111db3-1c75-4e10-832d-506346ba5659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:16.959626 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b111db3-1c75-4e10-832d-506346ba5659 admin admin] PATH_INFO: `/v3/users/285cbf50fac34905b72f620030429585` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:16.959626 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b111db3-1c75-4e10-832d-506346ba5659 admin admin] RBAC: Authorizing `identity:delete_user(user_id=285cbf50fac34905b72f620030429585)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:16.960976 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b111db3-1c75-4e10-832d-506346ba5659 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:16.966683 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1340/2700] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:26:16 2022] DELETE /identity/v3/users/e624e6e5ab64401d98854d1cc7b1b340 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:26:16.967638 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fcc016-f5f4-4266-bf95-1d093313a13b admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:16.969056 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-65fcc016-f5f4-4266-bf95-1d093313a13b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:17.032176 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fcc016-f5f4-4266-bf95-1d093313a13b admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:17.039619 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94aec6-c1a7-4010-8741-46c9a4bf149a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:17.040785 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94aec6-c1a7-4010-8741-46c9a4bf149a service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:17.041199 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94aec6-c1a7-4010-8741-46c9a4bf149a service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:17.041576 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94aec6-c1a7-4010-8741-46c9a4bf149a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:17.044332 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-6f94aec6-c1a7-4010-8741-46c9a4bf149a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:17.103091 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-4b111db3-1c75-4e10-832d-506346ba5659 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '285cbf50fac34905b72f620030429585'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:17.108970 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f94aec6-c1a7-4010-8741-46c9a4bf149a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:17.110515 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f94aec6-c1a7-4010-8741-46c9a4bf149a service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:17.110679 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-4b111db3-1c75-4e10-832d-506346ba5659 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '285cbf50fac34905b72f620030429585'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:17.119707 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1341/2701] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:26:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:26:17.124360 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-4b111db3-1c75-4e10-832d-506346ba5659 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '285cbf50fac34905b72f620030429585'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:17.125214 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-4b111db3-1c75-4e10-832d-506346ba5659 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '285cbf50fac34905b72f620030429585'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:17.125850 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-4b111db3-1c75-4e10-832d-506346ba5659 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '285cbf50fac34905b72f620030429585'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:17.199597 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1361/2702] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:26:16 2022] DELETE /identity/v3/users/285cbf50fac34905b72f620030429585 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:26:17.377521 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94aec6-c1a7-4010-8741-46c9a4bf149a service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:17.377521 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-6f94aec6-c1a7-4010-8741-46c9a4bf149a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:17.439244 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94aec6-c1a7-4010-8741-46c9a4bf149a service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:17.494976 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8705639e-948d-4d36-bf89-8c4e16a64cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:17.495983 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705639e-948d-4d36-bf89-8c4e16a64cf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:17.496367 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705639e-948d-4d36-bf89-8c4e16a64cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:17.496719 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705639e-948d-4d36-bf89-8c4e16a64cf0 admin admin] PATH_INFO: `/v3/projects/5377579f4db046cc973bd45d3b5e915d` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:17.498170 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8705639e-948d-4d36-bf89-8c4e16a64cf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5377579f4db046cc973bd45d3b5e915d)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:17.500590 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8705639e-948d-4d36-bf89-8c4e16a64cf0 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:17.554627 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b111db3-1c75-4e10-832d-506346ba5659 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:17.556234 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-4b111db3-1c75-4e10-832d-506346ba5659 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:17.569906 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b111db3-1c75-4e10-832d-506346ba5659 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:17.575821 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d5e62-a723-4b82-95e1-7ed1f4c0b8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:17.576836 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d5e62-a723-4b82-95e1-7ed1f4c0b8da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:17.577197 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d5e62-a723-4b82-95e1-7ed1f4c0b8da admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:17.577575 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d5e62-a723-4b82-95e1-7ed1f4c0b8da admin admin] PATH_INFO: `/v3/projects/dfdd3106ad0d445fb9866648596f811e` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:17.579217 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7d5e62-a723-4b82-95e1-7ed1f4c0b8da admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfdd3106ad0d445fb9866648596f811e)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:17.581534 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7d5e62-a723-4b82-95e1-7ed1f4c0b8da admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:17.666998 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8705639e-948d-4d36-bf89-8c4e16a64cf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5377579f4db046cc973bd45d3b5e915d', 'request_id': 'req-8705639e-948d-4d36-bf89-8c4e16a64cf0'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:17.672949 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8705639e-948d-4d36-bf89-8c4e16a64cf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5377579f4db046cc973bd45d3b5e915d', 'request_id': 'req-8705639e-948d-4d36-bf89-8c4e16a64cf0'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:17.680509 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8705639e-948d-4d36-bf89-8c4e16a64cf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5377579f4db046cc973bd45d3b5e915d', 'request_id': 'req-8705639e-948d-4d36-bf89-8c4e16a64cf0'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:17.690475 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-bd7d5e62-a723-4b82-95e1-7ed1f4c0b8da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfdd3106ad0d445fb9866648596f811e', 'request_id': 'req-bd7d5e62-a723-4b82-95e1-7ed1f4c0b8da'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:17.695789 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-bd7d5e62-a723-4b82-95e1-7ed1f4c0b8da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfdd3106ad0d445fb9866648596f811e', 'request_id': 'req-bd7d5e62-a723-4b82-95e1-7ed1f4c0b8da'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:17.702412 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-bd7d5e62-a723-4b82-95e1-7ed1f4c0b8da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfdd3106ad0d445fb9866648596f811e', 'request_id': 'req-bd7d5e62-a723-4b82-95e1-7ed1f4c0b8da'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:17.778269 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8705639e-948d-4d36-bf89-8c4e16a64cf0 admin admin] The token cache is being invalidate because project 5377579f4db046cc973bd45d3b5e915d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:26:17.778269 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8705639e-948d-4d36-bf89-8c4e16a64cf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:17.778269 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8705639e-948d-4d36-bf89-8c4e16a64cf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:17.778269 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1342/2703] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:26:17 2022] DELETE /identity/v3/projects/5377579f4db046cc973bd45d3b5e915d => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:26:17.781985 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8705639e-948d-4d36-bf89-8c4e16a64cf0 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:17.783316 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-8705639e-948d-4d36-bf89-8c4e16a64cf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:17.847076 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8705639e-948d-4d36-bf89-8c4e16a64cf0 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:17.860060 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-bd7d5e62-a723-4b82-95e1-7ed1f4c0b8da admin admin] The token cache is being invalidate because project dfdd3106ad0d445fb9866648596f811e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:26:17.864170 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-bd7d5e62-a723-4b82-95e1-7ed1f4c0b8da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:17.864170 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-bd7d5e62-a723-4b82-95e1-7ed1f4c0b8da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:17.864170 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1362/2704] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:26:17 2022] DELETE /identity/v3/projects/dfdd3106ad0d445fb9866648596f811e => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:26:17.866488 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d5e62-a723-4b82-95e1-7ed1f4c0b8da admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:17.868453 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-bd7d5e62-a723-4b82-95e1-7ed1f4c0b8da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:17.905100 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea2e535-310f-4043-8186-6265f7519411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:17.905918 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2e535-310f-4043-8186-6265f7519411 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:17.906167 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2e535-310f-4043-8186-6265f7519411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:17.906454 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2e535-310f-4043-8186-6265f7519411 admin admin] PATH_INFO: `/v3/users/34f8bedf88224228a47171275293d658` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:17.907835 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea2e535-310f-4043-8186-6265f7519411 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34f8bedf88224228a47171275293d658)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:17.909913 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea2e535-310f-4043-8186-6265f7519411 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:17.937668 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d5e62-a723-4b82-95e1-7ed1f4c0b8da admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:17.942965 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a5316-d5cb-4de2-9946-e3d83d2bd834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:17.944035 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a5316-d5cb-4de2-9946-e3d83d2bd834 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:17.949691 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a5316-d5cb-4de2-9946-e3d83d2bd834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:17.949691 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a5316-d5cb-4de2-9946-e3d83d2bd834 admin admin] PATH_INFO: `/v3/users/4ddac7b9c0ea424fbd05a14ba9a561ac` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:17.949691 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a5316-d5cb-4de2-9946-e3d83d2bd834 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ddac7b9c0ea424fbd05a14ba9a561ac)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:17.949691 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a5316-d5cb-4de2-9946-e3d83d2bd834 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:18.102365 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8ea2e535-310f-4043-8186-6265f7519411 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34f8bedf88224228a47171275293d658'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:18.103052 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8ea2e535-310f-4043-8186-6265f7519411 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34f8bedf88224228a47171275293d658'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:18.109598 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8ea2e535-310f-4043-8186-6265f7519411 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34f8bedf88224228a47171275293d658'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:18.125847 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-ab4a5316-d5cb-4de2-9946-e3d83d2bd834 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ddac7b9c0ea424fbd05a14ba9a561ac'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:18.132463 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-ab4a5316-d5cb-4de2-9946-e3d83d2bd834 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ddac7b9c0ea424fbd05a14ba9a561ac'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:18.144305 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-ab4a5316-d5cb-4de2-9946-e3d83d2bd834 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ddac7b9c0ea424fbd05a14ba9a561ac'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:18.145038 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-ab4a5316-d5cb-4de2-9946-e3d83d2bd834 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ddac7b9c0ea424fbd05a14ba9a561ac'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:18.145639 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-ab4a5316-d5cb-4de2-9946-e3d83d2bd834 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ddac7b9c0ea424fbd05a14ba9a561ac'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:18.181078 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8ea2e535-310f-4043-8186-6265f7519411 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34f8bedf88224228a47171275293d658'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:18.181659 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8ea2e535-310f-4043-8186-6265f7519411 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34f8bedf88224228a47171275293d658'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:18.199484 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1343/2705] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:26:17 2022] DELETE /identity/v3/users/34f8bedf88224228a47171275293d658 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:26:18.232781 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1363/2706] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:26:17 2022] DELETE /identity/v3/users/4ddac7b9c0ea424fbd05a14ba9a561ac => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:26:18.535991 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea2e535-310f-4043-8186-6265f7519411 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:18.538452 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-8ea2e535-310f-4043-8186-6265f7519411 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:18.623313 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea2e535-310f-4043-8186-6265f7519411 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:18.673501 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a5316-d5cb-4de2-9946-e3d83d2bd834 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:18.676647 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-ab4a5316-d5cb-4de2-9946-e3d83d2bd834 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:18.685809 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18622df5-a143-468a-9b0c-3bc0ef9d15cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:18.685809 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18622df5-a143-468a-9b0c-3bc0ef9d15cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:18.685809 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18622df5-a143-468a-9b0c-3bc0ef9d15cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:18.685809 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18622df5-a143-468a-9b0c-3bc0ef9d15cc admin admin] PATH_INFO: `/v3/projects/16afaff995094343b880950c9362060d` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:18.686935 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18622df5-a143-468a-9b0c-3bc0ef9d15cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=16afaff995094343b880950c9362060d)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:18.688924 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18622df5-a143-468a-9b0c-3bc0ef9d15cc admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:18.752681 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a5316-d5cb-4de2-9946-e3d83d2bd834 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:18.757396 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12beea6d-2cec-4497-b5bd-47421009b0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:18.758274 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12beea6d-2cec-4497-b5bd-47421009b0c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:18.758621 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12beea6d-2cec-4497-b5bd-47421009b0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:18.758919 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12beea6d-2cec-4497-b5bd-47421009b0c6 admin admin] PATH_INFO: `/v3/projects/0a0fd8d8d40d446db33240f651ad8c1f` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:18.760699 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12beea6d-2cec-4497-b5bd-47421009b0c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a0fd8d8d40d446db33240f651ad8c1f)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:18.762737 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12beea6d-2cec-4497-b5bd-47421009b0c6 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:18.780656 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-18622df5-a143-468a-9b0c-3bc0ef9d15cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16afaff995094343b880950c9362060d', 'request_id': 'req-18622df5-a143-468a-9b0c-3bc0ef9d15cc'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:18.785909 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-18622df5-a143-468a-9b0c-3bc0ef9d15cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16afaff995094343b880950c9362060d', 'request_id': 'req-18622df5-a143-468a-9b0c-3bc0ef9d15cc'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:18.792082 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-18622df5-a143-468a-9b0c-3bc0ef9d15cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16afaff995094343b880950c9362060d', 'request_id': 'req-18622df5-a143-468a-9b0c-3bc0ef9d15cc'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:18.877502 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-12beea6d-2cec-4497-b5bd-47421009b0c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a0fd8d8d40d446db33240f651ad8c1f', 'request_id': 'req-12beea6d-2cec-4497-b5bd-47421009b0c6'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:18.882890 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-12beea6d-2cec-4497-b5bd-47421009b0c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a0fd8d8d40d446db33240f651ad8c1f', 'request_id': 'req-12beea6d-2cec-4497-b5bd-47421009b0c6'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:18.889509 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-12beea6d-2cec-4497-b5bd-47421009b0c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a0fd8d8d40d446db33240f651ad8c1f', 'request_id': 'req-12beea6d-2cec-4497-b5bd-47421009b0c6'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:18.890095 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-18622df5-a143-468a-9b0c-3bc0ef9d15cc admin admin] The token cache is being invalidate because project 16afaff995094343b880950c9362060d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:26:18.890399 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-18622df5-a143-468a-9b0c-3bc0ef9d15cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:18.891185 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-18622df5-a143-468a-9b0c-3bc0ef9d15cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:18.893408 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1344/2707] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:26:18 2022] DELETE /identity/v3/projects/16afaff995094343b880950c9362060d => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:26:18.898007 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683470c-834f-4944-b273-a76d57ea17a3 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:18.898343 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683470c-834f-4944-b273-a76d57ea17a3 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:18.898634 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683470c-834f-4944-b273-a76d57ea17a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:18.917243 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-1683470c-834f-4944-b273-a76d57ea17a3 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:26:18.921176 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-1683470c-834f-4944-b273-a76d57ea17a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:18.973806 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-12beea6d-2cec-4497-b5bd-47421009b0c6 admin admin] The token cache is being invalidate because project 0a0fd8d8d40d446db33240f651ad8c1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:26:18.973998 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-12beea6d-2cec-4497-b5bd-47421009b0c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:18.974709 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-12beea6d-2cec-4497-b5bd-47421009b0c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:18.976308 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1364/2708] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:26:18 2022] DELETE /identity/v3/projects/0a0fd8d8d40d446db33240f651ad8c1f => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:26:18.981501 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1345/2709] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:26:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:26:18.983349 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe727e1a-a4c5-4c60-85b7-afef8664c3b4 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:18.983712 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe727e1a-a4c5-4c60-85b7-afef8664c3b4 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:18.984142 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe727e1a-a4c5-4c60-85b7-afef8664c3b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:18.989587 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ed2b1-7540-4405-8cf3-bef9dff37893 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:18.989880 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ed2b1-7540-4405-8cf3-bef9dff37893 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:18.990162 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ed2b1-7540-4405-8cf3-bef9dff37893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:19.003199 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-fe727e1a-a4c5-4c60-85b7-afef8664c3b4 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:26:19.004724 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-fe727e1a-a4c5-4c60-85b7-afef8664c3b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:19.009226 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-609ed2b1-7540-4405-8cf3-bef9dff37893 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:26:19.010466 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-609ed2b1-7540-4405-8cf3-bef9dff37893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:19.013259 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1365/2710] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:26:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:26:19.020142 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1346/2711] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:26:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:26:19.022532 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32b6bf-32f6-486b-a9ce-5b3d0ae088b7 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:19.022825 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32b6bf-32f6-486b-a9ce-5b3d0ae088b7 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:19.023107 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32b6bf-32f6-486b-a9ce-5b3d0ae088b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:19.024305 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ed2b1-7540-4405-8cf3-bef9dff37893 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:19.034304 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ed2b1-7540-4405-8cf3-bef9dff37893 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:19.039136 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8b1f5-660c-40f4-a99b-b4070995ddac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:19.039904 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8b1f5-660c-40f4-a99b-b4070995ddac admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:19.040294 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8b1f5-660c-40f4-a99b-b4070995ddac admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:19.040575 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8b1f5-660c-40f4-a99b-b4070995ddac admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:19.041299 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab8b1f5-660c-40f4-a99b-b4070995ddac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:26:19.041608 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab8b1f5-660c-40f4-a99b-b4070995ddac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:19.043096 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-1f32b6bf-32f6-486b-a9ce-5b3d0ae088b7 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:26:19.043250 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab8b1f5-660c-40f4-a99b-b4070995ddac admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:19.044331 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-1f32b6bf-32f6-486b-a9ce-5b3d0ae088b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:19.053057 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1366/2712] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:26:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:26:19.058773 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1347/2713] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 10 03:26:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:26:19.058936 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f32b6bf-32f6-486b-a9ce-5b3d0ae088b7 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:19.059714 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8b1f5-660c-40f4-a99b-b4070995ddac admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:19.066002 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f32b6bf-32f6-486b-a9ce-5b3d0ae088b7 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:19.069531 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8b1f5-660c-40f4-a99b-b4070995ddac admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:19.070647 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d4f8c-0808-4b4c-a995-a75f100ec3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:19.071281 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d4f8c-0808-4b4c-a995-a75f100ec3d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:19.071565 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d4f8c-0808-4b4c-a995-a75f100ec3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:19.071839 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d4f8c-0808-4b4c-a995-a75f100ec3d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:19.072603 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35d4f8c-0808-4b4c-a995-a75f100ec3d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:26:19.072911 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35d4f8c-0808-4b4c-a995-a75f100ec3d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:19.074261 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f161d8b8-0bd9-4c2a-8883-1bd9cc25b386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:19.074484 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35d4f8c-0808-4b4c-a995-a75f100ec3d2 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:19.074924 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f161d8b8-0bd9-4c2a-8883-1bd9cc25b386 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:19.075209 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f161d8b8-0bd9-4c2a-8883-1bd9cc25b386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:19.075486 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f161d8b8-0bd9-4c2a-8883-1bd9cc25b386 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:19.076253 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f161d8b8-0bd9-4c2a-8883-1bd9cc25b386 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:19.078118 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f161d8b8-0bd9-4c2a-8883-1bd9cc25b386 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:19.085785 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1367/2714] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 10 03:26:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:26:19.090024 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d4f8c-0808-4b4c-a995-a75f100ec3d2 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:19.099772 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d4f8c-0808-4b4c-a995-a75f100ec3d2 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:19.107512 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0102ada4-a66f-4578-a1f7-81cd8aca5ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:19.108198 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102ada4-a66f-4578-a1f7-81cd8aca5ba7 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:19.108483 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102ada4-a66f-4578-a1f7-81cd8aca5ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:19.108759 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102ada4-a66f-4578-a1f7-81cd8aca5ba7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:19.109447 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0102ada4-a66f-4578-a1f7-81cd8aca5ba7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:19.111333 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0102ada4-a66f-4578-a1f7-81cd8aca5ba7 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:19.182518 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1348/2715] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:26:19 2022] POST /identity/v3/projects => generated 383 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:26:19.186556 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f161d8b8-0bd9-4c2a-8883-1bd9cc25b386 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:19.211287 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1368/2716] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:26:19 2022] POST /identity/v3/projects => generated 383 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:26:19.215515 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0102ada4-a66f-4578-a1f7-81cd8aca5ba7 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:19.247971 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f161d8b8-0bd9-4c2a-8883-1bd9cc25b386 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:19.276584 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0102ada4-a66f-4578-a1f7-81cd8aca5ba7 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:19.282005 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c74bafd-4406-476c-ab0a-420b06832536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:19.284174 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74bafd-4406-476c-ab0a-420b06832536 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:19.284174 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74bafd-4406-476c-ab0a-420b06832536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:19.284174 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74bafd-4406-476c-ab0a-420b06832536 admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:19.284174 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c74bafd-4406-476c-ab0a-420b06832536 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:19.285842 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c74bafd-4406-476c-ab0a-420b06832536 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:19.302986 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb59330-93d2-4eb0-ad5b-bfc40ac9d454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:19.307157 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb59330-93d2-4eb0-ad5b-bfc40ac9d454 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:19.307157 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb59330-93d2-4eb0-ad5b-bfc40ac9d454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:19.307157 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb59330-93d2-4eb0-ad5b-bfc40ac9d454 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:19.308790 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb59330-93d2-4eb0-ad5b-bfc40ac9d454 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:19.310822 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb59330-93d2-4eb0-ad5b-bfc40ac9d454 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:19.358632 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1369/2717] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:26:19 2022] POST /identity/v3/users => generated 292 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:26:19.362460 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c74bafd-4406-476c-ab0a-420b06832536 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:19.371566 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c74bafd-4406-476c-ab0a-420b06832536 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:19.376159 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a938b-32d9-4f6f-84e3-d4d51e316349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:19.376795 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a938b-32d9-4f6f-84e3-d4d51e316349 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:19.377076 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a938b-32d9-4f6f-84e3-d4d51e316349 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:19.377362 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a938b-32d9-4f6f-84e3-d4d51e316349 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:19.378080 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7a938b-32d9-4f6f-84e3-d4d51e316349 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:19.379760 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7a938b-32d9-4f6f-84e3-d4d51e316349 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:19.382545 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1349/2718] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:26:19 2022] POST /identity/v3/users => generated 292 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:26:19.386856 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb59330-93d2-4eb0-ad5b-bfc40ac9d454 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:19.390468 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1370/2719] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:26:19.394135 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a938b-32d9-4f6f-84e3-d4d51e316349 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:19.397426 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb59330-93d2-4eb0-ad5b-bfc40ac9d454 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:19.402198 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db18fdd-edff-4880-9421-f27cec79099d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:19.404839 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db18fdd-edff-4880-9421-f27cec79099d admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:19.404839 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db18fdd-edff-4880-9421-f27cec79099d admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:19.405038 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a938b-32d9-4f6f-84e3-d4d51e316349 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:19.405130 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db18fdd-edff-4880-9421-f27cec79099d admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:19.405130 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db18fdd-edff-4880-9421-f27cec79099d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:19.406569 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db18fdd-edff-4880-9421-f27cec79099d admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:19.408626 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f3af8-ee1d-4a59-bffe-2df8df38c426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:19.409250 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f3af8-ee1d-4a59-bffe-2df8df38c426 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:19.409535 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f3af8-ee1d-4a59-bffe-2df8df38c426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:19.409824 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f3af8-ee1d-4a59-bffe-2df8df38c426 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:19.410531 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745f3af8-ee1d-4a59-bffe-2df8df38c426 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:19.412106 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745f3af8-ee1d-4a59-bffe-2df8df38c426 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:19.417015 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1350/2720] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:26:19.421217 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db18fdd-edff-4880-9421-f27cec79099d admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:19.422347 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1371/2721] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:26:19.427966 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f3af8-ee1d-4a59-bffe-2df8df38c426 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:19.431799 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db18fdd-edff-4880-9421-f27cec79099d admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:19.436471 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2ade2-449e-48e5-b038-3296182632d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:19.437110 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2ade2-449e-48e5-b038-3296182632d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:19.437396 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2ade2-449e-48e5-b038-3296182632d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:19.437518 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f3af8-ee1d-4a59-bffe-2df8df38c426 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:19.437678 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2ade2-449e-48e5-b038-3296182632d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:19.438448 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed2ade2-449e-48e5-b038-3296182632d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:19.439992 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed2ade2-449e-48e5-b038-3296182632d4 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:19.442069 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b50508-4145-4e6d-89ff-d7cf996c9a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:19.442986 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b50508-4145-4e6d-89ff-d7cf996c9a76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:19.443269 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b50508-4145-4e6d-89ff-d7cf996c9a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:19.443546 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b50508-4145-4e6d-89ff-d7cf996c9a76 admin admin] PATH_INFO: `/v3/projects/62e5dd9ea01b4bd1adbc781c2bc4be4f/users/03c313020caa423bad637dd8423e145a/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:19.454609 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1351/2722] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:26:19.460408 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2ade2-449e-48e5-b038-3296182632d4 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:19.461732 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b50508-4145-4e6d-89ff-d7cf996c9a76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62e5dd9ea01b4bd1adbc781c2bc4be4f, user_id=03c313020caa423bad637dd8423e145a, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:19.464507 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b50508-4145-4e6d-89ff-d7cf996c9a76 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:19.471127 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2ade2-449e-48e5-b038-3296182632d4 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:19.475856 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd25c701-c484-444f-a79f-95ef00e1d791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:19.476921 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25c701-c484-444f-a79f-95ef00e1d791 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:19.477204 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25c701-c484-444f-a79f-95ef00e1d791 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:19.477480 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25c701-c484-444f-a79f-95ef00e1d791 admin admin] PATH_INFO: `/v3/projects/3957873d31c245d49abbd518a9b4b3cf/users/c5d5de0e5d6c45418f4abff3cb5ddc6a/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:19.491704 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd25c701-c484-444f-a79f-95ef00e1d791 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3957873d31c245d49abbd518a9b4b3cf, user_id=c5d5de0e5d6c45418f4abff3cb5ddc6a, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:19.494403 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd25c701-c484-444f-a79f-95ef00e1d791 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:19.570028 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1372/2723] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:26:19 2022] PUT /identity/v3/projects/62e5dd9ea01b4bd1adbc781c2bc4be4f/users/03c313020caa423bad637dd8423e145a/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:26:19.581676 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a15c86-4c0d-488d-a60c-76761d172faa None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:19.581970 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a15c86-4c0d-488d-a60c-76761d172faa None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:19.582256 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a15c86-4c0d-488d-a60c-76761d172faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:19.607822 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-73a15c86-4c0d-488d-a60c-76761d172faa None None] MFA Rules not processed for user `03c313020caa423bad637dd8423e145a`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:26:19.609126 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-73a15c86-4c0d-488d-a60c-76761d172faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:19.644067 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1352/2724] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:26:19 2022] PUT /identity/v3/projects/3957873d31c245d49abbd518a9b4b3cf/users/c5d5de0e5d6c45418f4abff3cb5ddc6a/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:26:19.645515 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f1aa9-854e-490e-9836-72075380797c None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:19.645837 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f1aa9-854e-490e-9836-72075380797c None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:19.646113 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f1aa9-854e-490e-9836-72075380797c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:19.671918 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-501f1aa9-854e-490e-9836-72075380797c None None] MFA Rules not processed for user `c5d5de0e5d6c45418f4abff3cb5ddc6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:26:19.673148 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-501f1aa9-854e-490e-9836-72075380797c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:19.674566 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1373/2725] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:26:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:26:19.678699 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a15c86-4c0d-488d-a60c-76761d172faa None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:19.737972 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1353/2726] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:26:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:26:19.742124 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a15c86-4c0d-488d-a60c-76761d172faa None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:19.749907 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f1aa9-854e-490e-9836-72075380797c None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:19.751342 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-501f1aa9-854e-490e-9836-72075380797c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:19.798129 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5dd91b-5614-454a-aead-1d9c60dd14b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:19.799214 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5dd91b-5614-454a-aead-1d9c60dd14b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:19.799573 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5dd91b-5614-454a-aead-1d9c60dd14b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:19.799918 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5dd91b-5614-454a-aead-1d9c60dd14b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:19.800718 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5dd91b-5614-454a-aead-1d9c60dd14b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:19.802662 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5dd91b-5614-454a-aead-1d9c60dd14b3 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:19.807958 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f1aa9-854e-490e-9836-72075380797c None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:19.812273 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8dd146-5509-4fa6-baba-608c42d9c561 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:19.814928 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8dd146-5509-4fa6-baba-608c42d9c561 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:19.814928 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8dd146-5509-4fa6-baba-608c42d9c561 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:19.814928 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8dd146-5509-4fa6-baba-608c42d9c561 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:19.821981 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8dd146-5509-4fa6-baba-608c42d9c561 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:19.823352 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8dd146-5509-4fa6-baba-608c42d9c561 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:19.832768 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1354/2727] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:26:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:26:19.851939 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8dd146-5509-4fa6-baba-608c42d9c561 service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:19.862375 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8dd146-5509-4fa6-baba-608c42d9c561 service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:19.867014 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e023a-2725-47bf-a94e-856b49480c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:19.867863 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e023a-2725-47bf-a94e-856b49480c4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:19.868182 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e023a-2725-47bf-a94e-856b49480c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:19.868463 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e023a-2725-47bf-a94e-856b49480c4b admin admin] PATH_INFO: `/v3/users/c5d5de0e5d6c45418f4abff3cb5ddc6a` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:19.869646 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1e023a-2725-47bf-a94e-856b49480c4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5d5de0e5d6c45418f4abff3cb5ddc6a)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:19.871579 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1e023a-2725-47bf-a94e-856b49480c4b admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:19.914371 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1374/2728] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:26:19 2022] POST /identity/v3/projects => generated 385 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:26:19.918036 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5dd91b-5614-454a-aead-1d9c60dd14b3 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:19.977315 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5dd91b-5614-454a-aead-1d9c60dd14b3 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:19.982528 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7bae8d-eca0-4c32-859e-b192e955a169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:19.983184 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7bae8d-eca0-4c32-859e-b192e955a169 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:19.983465 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7bae8d-eca0-4c32-859e-b192e955a169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:19.983741 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7bae8d-eca0-4c32-859e-b192e955a169 admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:19.984460 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7bae8d-eca0-4c32-859e-b192e955a169 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:19.986389 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7bae8d-eca0-4c32-859e-b192e955a169 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:20.102716 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2a1e023a-2725-47bf-a94e-856b49480c4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5d5de0e5d6c45418f4abff3cb5ddc6a'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:20.103302 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2a1e023a-2725-47bf-a94e-856b49480c4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5d5de0e5d6c45418f4abff3cb5ddc6a'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:20.110522 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2a1e023a-2725-47bf-a94e-856b49480c4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5d5de0e5d6c45418f4abff3cb5ddc6a'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:20.124749 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1375/2729] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:26:19 2022] POST /identity/v3/users => generated 299 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:26:20.128600 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7bae8d-eca0-4c32-859e-b192e955a169 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:20.138306 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7bae8d-eca0-4c32-859e-b192e955a169 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:20.143058 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce131166-fdb4-468e-8367-c3b0650c4bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:20.143696 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce131166-fdb4-468e-8367-c3b0650c4bae admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:20.148741 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce131166-fdb4-468e-8367-c3b0650c4bae admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:20.148741 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce131166-fdb4-468e-8367-c3b0650c4bae admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:20.148741 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce131166-fdb4-468e-8367-c3b0650c4bae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:20.148741 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce131166-fdb4-468e-8367-c3b0650c4bae admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:20.156393 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1376/2730] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:26:20 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:26:20.160366 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce131166-fdb4-468e-8367-c3b0650c4bae admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:20.170493 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce131166-fdb4-468e-8367-c3b0650c4bae admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:20.177496 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d82c482-8b7a-408b-a878-a1607b79d6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:20.177496 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82c482-8b7a-408b-a878-a1607b79d6fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:20.177496 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82c482-8b7a-408b-a878-a1607b79d6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:20.177496 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82c482-8b7a-408b-a878-a1607b79d6fc admin admin] PATH_INFO: `/v3/projects/94f8ec0842c14db6b7cd74b469b54e67/users/9e0907b8b890413aa763e9c5980ed055/roles/43105000610f402ca2486e7648018cca` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:20.191898 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d82c482-8b7a-408b-a878-a1607b79d6fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=94f8ec0842c14db6b7cd74b469b54e67, user_id=9e0907b8b890413aa763e9c5980ed055, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:20.194542 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d82c482-8b7a-408b-a878-a1607b79d6fc admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:20.198151 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2a1e023a-2725-47bf-a94e-856b49480c4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5d5de0e5d6c45418f4abff3cb5ddc6a'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:20.198771 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2a1e023a-2725-47bf-a94e-856b49480c4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5d5de0e5d6c45418f4abff3cb5ddc6a'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:20.216075 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1355/2731] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:26:19 2022] DELETE /identity/v3/users/c5d5de0e5d6c45418f4abff3cb5ddc6a => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:26:20.221052 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9155704-f7d5-450e-a15a-a83c0fc868e7 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:20.221345 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9155704-f7d5-450e-a15a-a83c0fc868e7 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:20.221625 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9155704-f7d5-450e-a15a-a83c0fc868e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:20.238539 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-a9155704-f7d5-450e-a15a-a83c0fc868e7 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:26:20.239781 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-a9155704-f7d5-450e-a15a-a83c0fc868e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:20.304015 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1356/2732] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:26:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:26:20.306228 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1377/2733] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:26:20 2022] PUT /identity/v3/projects/94f8ec0842c14db6b7cd74b469b54e67/users/9e0907b8b890413aa763e9c5980ed055/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:26:20.309973 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9155704-f7d5-450e-a15a-a83c0fc868e7 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:20.312073 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-a9155704-f7d5-450e-a15a-a83c0fc868e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:20.314284 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d82c482-8b7a-408b-a878-a1607b79d6fc admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:20.316030 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-2d82c482-8b7a-408b-a878-a1607b79d6fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:20.324027 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9155704-f7d5-450e-a15a-a83c0fc868e7 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:20.376343 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d82c482-8b7a-408b-a878-a1607b79d6fc admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:20.383231 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f47e78-6a4a-47d1-a732-94b38d45124a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:20.383231 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f47e78-6a4a-47d1-a732-94b38d45124a service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:20.383231 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f47e78-6a4a-47d1-a732-94b38d45124a service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:20.385240 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f47e78-6a4a-47d1-a732-94b38d45124a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:20.392321 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d89c870-7bcd-4e04-81ec-e3cc6dc20b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:20.392321 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89c870-7bcd-4e04-81ec-e3cc6dc20b80 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:20.392321 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89c870-7bcd-4e04-81ec-e3cc6dc20b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:20.394590 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89c870-7bcd-4e04-81ec-e3cc6dc20b80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:20.394590 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d89c870-7bcd-4e04-81ec-e3cc6dc20b80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:20.395573 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d89c870-7bcd-4e04-81ec-e3cc6dc20b80 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:20.398827 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f47e78-6a4a-47d1-a732-94b38d45124a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:20.401968 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f47e78-6a4a-47d1-a732-94b38d45124a service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:20.408033 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1357/2734] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:26:20 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:26:20.414147 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d89c870-7bcd-4e04-81ec-e3cc6dc20b80 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:20.420143 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1378/2735] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:26:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:26:20.431423 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d89c870-7bcd-4e04-81ec-e3cc6dc20b80 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:20.439693 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e8827-c695-4e86-bf8f-c84225e9357c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:20.441722 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e8827-c695-4e86-bf8f-c84225e9357c admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:20.441722 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e8827-c695-4e86-bf8f-c84225e9357c admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:20.441973 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e8827-c695-4e86-bf8f-c84225e9357c admin admin] PATH_INFO: `/v3/projects/94f8ec0842c14db6b7cd74b469b54e67/users/9e0907b8b890413aa763e9c5980ed055/roles/43105000610f402ca2486e7648018cca` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:20.443890 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808e8827-c695-4e86-bf8f-c84225e9357c admin admin] RBAC: Authorizing `identity:create_grant(project_id=94f8ec0842c14db6b7cd74b469b54e67, user_id=9e0907b8b890413aa763e9c5980ed055, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:20.446675 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808e8827-c695-4e86-bf8f-c84225e9357c admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:20.458092 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1358/2736] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:26:20 2022] PUT /identity/v3/projects/94f8ec0842c14db6b7cd74b469b54e67/users/9e0907b8b890413aa763e9c5980ed055/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:26:20.469586 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70fe2f-54f4-4e93-b23a-c0241e79d87d None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:20.470264 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70fe2f-54f4-4e93-b23a-c0241e79d87d None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:20.470707 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70fe2f-54f4-4e93-b23a-c0241e79d87d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:20.499171 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-1c70fe2f-54f4-4e93-b23a-c0241e79d87d None None] MFA Rules not processed for user `9e0907b8b890413aa763e9c5980ed055`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:26:20.500447 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-1c70fe2f-54f4-4e93-b23a-c0241e79d87d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:20.570944 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1379/2737] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:26:20 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:26:20.582393 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e8827-c695-4e86-bf8f-c84225e9357c admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:20.584368 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-808e8827-c695-4e86-bf8f-c84225e9357c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:20.652543 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e8827-c695-4e86-bf8f-c84225e9357c admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:20.657030 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ad39c-c082-4de8-9e9a-40490561f5aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:20.657768 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ad39c-c082-4de8-9e9a-40490561f5aa service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:20.658055 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ad39c-c082-4de8-9e9a-40490561f5aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:20.658330 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ad39c-c082-4de8-9e9a-40490561f5aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:20.660195 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-b53ad39c-c082-4de8-9e9a-40490561f5aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:20.727662 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ad39c-c082-4de8-9e9a-40490561f5aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:20.730157 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ad39c-c082-4de8-9e9a-40490561f5aa service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:20.742602 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1359/2738] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:26:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:26:20.893916 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c70fe2f-54f4-4e93-b23a-c0241e79d87d None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:20.895382 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-1c70fe2f-54f4-4e93-b23a-c0241e79d87d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:20.985537 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c70fe2f-54f4-4e93-b23a-c0241e79d87d None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:20.990291 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e50037e-0936-4c63-ac33-ff12b8eb7940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:20.991175 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50037e-0936-4c63-ac33-ff12b8eb7940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:20.991438 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50037e-0936-4c63-ac33-ff12b8eb7940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:20.991715 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50037e-0936-4c63-ac33-ff12b8eb7940 admin admin] PATH_INFO: `/v3/projects/3957873d31c245d49abbd518a9b4b3cf` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:20.992946 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e50037e-0936-4c63-ac33-ff12b8eb7940 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3957873d31c245d49abbd518a9b4b3cf)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:20.994857 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e50037e-0936-4c63-ac33-ff12b8eb7940 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:21.107782 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-8e50037e-0936-4c63-ac33-ff12b8eb7940 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3957873d31c245d49abbd518a9b4b3cf', 'request_id': 'req-8e50037e-0936-4c63-ac33-ff12b8eb7940'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:21.112973 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-8e50037e-0936-4c63-ac33-ff12b8eb7940 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3957873d31c245d49abbd518a9b4b3cf', 'request_id': 'req-8e50037e-0936-4c63-ac33-ff12b8eb7940'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:21.120976 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-8e50037e-0936-4c63-ac33-ff12b8eb7940 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3957873d31c245d49abbd518a9b4b3cf', 'request_id': 'req-8e50037e-0936-4c63-ac33-ff12b8eb7940'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:21.213817 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-8e50037e-0936-4c63-ac33-ff12b8eb7940 admin admin] The token cache is being invalidate because project 3957873d31c245d49abbd518a9b4b3cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:26:21.214111 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-8e50037e-0936-4c63-ac33-ff12b8eb7940 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:21.214740 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-8e50037e-0936-4c63-ac33-ff12b8eb7940 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:21.216877 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1380/2739] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:26:20 2022] DELETE /identity/v3/projects/3957873d31c245d49abbd518a9b4b3cf => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:26:21.221753 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d72c7-92a5-424d-8405-394a71f72eed None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:21.222206 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d72c7-92a5-424d-8405-394a71f72eed None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:21.222298 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d72c7-92a5-424d-8405-394a71f72eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:21.241518 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-a85d72c7-92a5-424d-8405-394a71f72eed None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:26:21.242761 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-a85d72c7-92a5-424d-8405-394a71f72eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:21.302019 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1360/2740] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:26:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:26:21.310355 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657620b8-043a-42b1-9fce-c0a87fd4a6a9 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:21.310653 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657620b8-043a-42b1-9fce-c0a87fd4a6a9 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:21.310937 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657620b8-043a-42b1-9fce-c0a87fd4a6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:21.329152 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-657620b8-043a-42b1-9fce-c0a87fd4a6a9 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:26:21.330393 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-657620b8-043a-42b1-9fce-c0a87fd4a6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:21.338478 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1381/2741] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:26:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:26:21.343425 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d72c7-92a5-424d-8405-394a71f72eed None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:21.352943 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d72c7-92a5-424d-8405-394a71f72eed None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:21.358150 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a2e01-43e6-4f0a-8138-5224a4aff1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:21.358798 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a2e01-43e6-4f0a-8138-5224a4aff1d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:21.359083 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a2e01-43e6-4f0a-8138-5224a4aff1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:21.359357 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a2e01-43e6-4f0a-8138-5224a4aff1d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:21.360100 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5a2e01-43e6-4f0a-8138-5224a4aff1d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:26:21.360406 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5a2e01-43e6-4f0a-8138-5224a4aff1d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:21.362030 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5a2e01-43e6-4f0a-8138-5224a4aff1d7 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:21.373221 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1361/2742] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 10 03:26:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:26:21.377525 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657620b8-043a-42b1-9fce-c0a87fd4a6a9 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:21.387572 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657620b8-043a-42b1-9fce-c0a87fd4a6a9 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:21.392641 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba81fc9-eaff-485a-852d-fe5e0fe9ceb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:21.393226 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba81fc9-eaff-485a-852d-fe5e0fe9ceb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:21.393514 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba81fc9-eaff-485a-852d-fe5e0fe9ceb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:21.393793 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba81fc9-eaff-485a-852d-fe5e0fe9ceb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:21.394496 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba81fc9-eaff-485a-852d-fe5e0fe9ceb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:21.396459 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba81fc9-eaff-485a-852d-fe5e0fe9ceb5 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:21.554173 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1382/2743] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:26:21 2022] POST /identity/v3/projects => generated 399 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:26:21.558396 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a2e01-43e6-4f0a-8138-5224a4aff1d7 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:21.568467 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a2e01-43e6-4f0a-8138-5224a4aff1d7 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:21.634832 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e803a50-aa99-4fa0-b104-bf7d43489aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:21.636598 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e803a50-aa99-4fa0-b104-bf7d43489aec admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:21.636953 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e803a50-aa99-4fa0-b104-bf7d43489aec admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:21.637323 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e803a50-aa99-4fa0-b104-bf7d43489aec admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:21.639111 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e803a50-aa99-4fa0-b104-bf7d43489aec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:21.641292 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e803a50-aa99-4fa0-b104-bf7d43489aec admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:21.715553 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1362/2744] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:26:21 2022] POST /identity/v3/users => generated 300 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:26:21.717667 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba81fc9-eaff-485a-852d-fe5e0fe9ceb5 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:21.727861 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba81fc9-eaff-485a-852d-fe5e0fe9ceb5 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:21.732731 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c72bdd-e7e4-4ca6-b036-ea9c0e135ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:21.733391 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c72bdd-e7e4-4ca6-b036-ea9c0e135ac7 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:21.733677 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c72bdd-e7e4-4ca6-b036-ea9c0e135ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:21.733992 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c72bdd-e7e4-4ca6-b036-ea9c0e135ac7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:21.734729 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c72bdd-e7e4-4ca6-b036-ea9c0e135ac7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:21.736347 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c72bdd-e7e4-4ca6-b036-ea9c0e135ac7 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:21.749021 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1383/2745] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:26:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:26:21.753307 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e803a50-aa99-4fa0-b104-bf7d43489aec admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:21.764690 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e803a50-aa99-4fa0-b104-bf7d43489aec admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:21.769752 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1309ab-1708-4136-af21-f36fadb9acb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:21.770426 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1309ab-1708-4136-af21-f36fadb9acb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:21.770711 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1309ab-1708-4136-af21-f36fadb9acb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:21.770996 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1309ab-1708-4136-af21-f36fadb9acb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:21.771781 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1309ab-1708-4136-af21-f36fadb9acb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:21.773444 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1309ab-1708-4136-af21-f36fadb9acb2 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:21.784508 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1363/2746] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:26:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:26:21.788724 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c72bdd-e7e4-4ca6-b036-ea9c0e135ac7 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:21.801546 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c72bdd-e7e4-4ca6-b036-ea9c0e135ac7 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:21.806781 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5785f6a3-e80c-4920-a599-6426acfe5bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:21.807759 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785f6a3-e80c-4920-a599-6426acfe5bb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:21.808092 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785f6a3-e80c-4920-a599-6426acfe5bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:21.808381 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785f6a3-e80c-4920-a599-6426acfe5bb1 admin admin] PATH_INFO: `/v3/projects/410d831ab2584eb499cf297828f381d2/users/0d422b6e12274af9bcadd98507d4b004/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:21.824845 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5785f6a3-e80c-4920-a599-6426acfe5bb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=410d831ab2584eb499cf297828f381d2, user_id=0d422b6e12274af9bcadd98507d4b004, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:21.832897 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5785f6a3-e80c-4920-a599-6426acfe5bb1 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:21.900978 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1384/2747] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:26:21 2022] PUT /identity/v3/projects/410d831ab2584eb499cf297828f381d2/users/0d422b6e12274af9bcadd98507d4b004/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:26:21.915714 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffecf2-ab8b-4f1b-96fd-e77564d3b723 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:21.916023 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffecf2-ab8b-4f1b-96fd-e77564d3b723 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:21.916307 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffecf2-ab8b-4f1b-96fd-e77564d3b723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:21.943583 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-1dffecf2-ab8b-4f1b-96fd-e77564d3b723 None None] MFA Rules not processed for user `0d422b6e12274af9bcadd98507d4b004`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:26:21.944826 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-1dffecf2-ab8b-4f1b-96fd-e77564d3b723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:22.010344 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1364/2748] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:26:21 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:26:22.164721 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5785f6a3-e80c-4920-a599-6426acfe5bb1 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:22.166454 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-5785f6a3-e80c-4920-a599-6426acfe5bb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:22.225667 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5785f6a3-e80c-4920-a599-6426acfe5bb1 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:22.229543 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede0ed1d-a07d-44ce-9a12-4b95b320fa92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:22.230198 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0ed1d-a07d-44ce-9a12-4b95b320fa92 service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:22.230485 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0ed1d-a07d-44ce-9a12-4b95b320fa92 service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:22.230771 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0ed1d-a07d-44ce-9a12-4b95b320fa92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:22.240813 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede0ed1d-a07d-44ce-9a12-4b95b320fa92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:22.242231 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede0ed1d-a07d-44ce-9a12-4b95b320fa92 service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:22.251196 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1385/2749] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:26:22 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:26:25.436460 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49a321-ca99-4c09-b077-1c76c0fa8a35 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:25.440602 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49a321-ca99-4c09-b077-1c76c0fa8a35 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:25.440602 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49a321-ca99-4c09-b077-1c76c0fa8a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:25.465917 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-ce49a321-ca99-4c09-b077-1c76c0fa8a35 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:26:25.468115 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-ce49a321-ca99-4c09-b077-1c76c0fa8a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:25.526911 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1365/2750] 10.222.0.61 () {58 vars in 1016 bytes} [Tue May 10 03:26:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:26:25.541568 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede0ed1d-a07d-44ce-9a12-4b95b320fa92 service cinder] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:25.543939 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-ede0ed1d-a07d-44ce-9a12-4b95b320fa92 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:25.617242 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede0ed1d-a07d-44ce-9a12-4b95b320fa92 service cinder] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:25.623292 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c1cec4-10db-49ba-99a9-a0b709935dd0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b7ccdccba0b4f9e86817946f22dbe28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:25.623939 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c1cec4-10db-49ba-99a9-a0b709935dd0 service nova] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:25.624295 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c1cec4-10db-49ba-99a9-a0b709935dd0 service nova] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:25.624572 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c1cec4-10db-49ba-99a9-a0b709935dd0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:25.635374 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c1cec4-10db-49ba-99a9-a0b709935dd0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:25.637151 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c1cec4-10db-49ba-99a9-a0b709935dd0 service nova] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:25.649672 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1386/2751] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:26:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:26:26.487156 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce49a321-ca99-4c09-b077-1c76c0fa8a35 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:26.497076 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce49a321-ca99-4c09-b077-1c76c0fa8a35 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:26.500809 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d429e9c-8920-421f-a0ad-afdf5280f770 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:26.501454 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d429e9c-8920-421f-a0ad-afdf5280f770 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:26.501737 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d429e9c-8920-421f-a0ad-afdf5280f770 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:26.502014 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d429e9c-8920-421f-a0ad-afdf5280f770 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:26.503808 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-2d429e9c-8920-421f-a0ad-afdf5280f770 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:26.569681 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d429e9c-8920-421f-a0ad-afdf5280f770 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:26.571132 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d429e9c-8920-421f-a0ad-afdf5280f770 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:26.581085 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1366/2752] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:26:26 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:26:28.304725 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c1cec4-10db-49ba-99a9-a0b709935dd0 service nova] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:28.314856 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c1cec4-10db-49ba-99a9-a0b709935dd0 service nova] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:28.320571 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd426db-7ec7-4b5d-b1d2-18f00b15069b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:28.321703 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd426db-7ec7-4b5d-b1d2-18f00b15069b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:28.322001 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd426db-7ec7-4b5d-b1d2-18f00b15069b admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:28.322283 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd426db-7ec7-4b5d-b1d2-18f00b15069b admin admin] PATH_INFO: `/v3/users/0d422b6e12274af9bcadd98507d4b004` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:28.323561 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd426db-7ec7-4b5d-b1d2-18f00b15069b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d422b6e12274af9bcadd98507d4b004)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:28.325706 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd426db-7ec7-4b5d-b1d2-18f00b15069b admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:28.514864 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-4cd426db-7ec7-4b5d-b1d2-18f00b15069b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d422b6e12274af9bcadd98507d4b004'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:28.521495 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-4cd426db-7ec7-4b5d-b1d2-18f00b15069b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d422b6e12274af9bcadd98507d4b004'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:28.533494 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-4cd426db-7ec7-4b5d-b1d2-18f00b15069b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d422b6e12274af9bcadd98507d4b004'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:28.534202 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-4cd426db-7ec7-4b5d-b1d2-18f00b15069b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d422b6e12274af9bcadd98507d4b004'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:28.534811 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-4cd426db-7ec7-4b5d-b1d2-18f00b15069b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d422b6e12274af9bcadd98507d4b004'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:28.628682 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1387/2753] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:26:28 2022] DELETE /identity/v3/users/0d422b6e12274af9bcadd98507d4b004 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:26:28.633290 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f7893-cf12-4ae7-8a93-e9e7b6fce897 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:28.633789 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f7893-cf12-4ae7-8a93-e9e7b6fce897 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:28.633899 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f7893-cf12-4ae7-8a93-e9e7b6fce897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:28.651268 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-0f4f7893-cf12-4ae7-8a93-e9e7b6fce897 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:26:28.652633 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-0f4f7893-cf12-4ae7-8a93-e9e7b6fce897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:28.713963 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1367/2754] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:26:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:26:28.724100 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd426db-7ec7-4b5d-b1d2-18f00b15069b admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:28.725526 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-4cd426db-7ec7-4b5d-b1d2-18f00b15069b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:28.782251 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd426db-7ec7-4b5d-b1d2-18f00b15069b admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:28.786144 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aabf59-8ea5-4776-80c5-0ccf24c1e4fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:28.786802 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aabf59-8ea5-4776-80c5-0ccf24c1e4fb service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:28.787085 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aabf59-8ea5-4776-80c5-0ccf24c1e4fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:28.787363 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aabf59-8ea5-4776-80c5-0ccf24c1e4fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:28.796946 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aabf59-8ea5-4776-80c5-0ccf24c1e4fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:28.798439 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aabf59-8ea5-4776-80c5-0ccf24c1e4fb service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:28.808320 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1388/2755] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:26:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:26:29.183296 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f7893-cf12-4ae7-8a93-e9e7b6fce897 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:29.185277 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-0f4f7893-cf12-4ae7-8a93-e9e7b6fce897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:29.208024 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f7893-cf12-4ae7-8a93-e9e7b6fce897 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:29.212629 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38acb14b-8113-483d-b19a-50671d30e5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:29.213488 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38acb14b-8113-483d-b19a-50671d30e5e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:29.213829 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38acb14b-8113-483d-b19a-50671d30e5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:29.214096 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38acb14b-8113-483d-b19a-50671d30e5e2 admin admin] PATH_INFO: `/v3/projects/410d831ab2584eb499cf297828f381d2` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:29.215272 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38acb14b-8113-483d-b19a-50671d30e5e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=410d831ab2584eb499cf297828f381d2)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:29.217233 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38acb14b-8113-483d-b19a-50671d30e5e2 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:29.334720 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-38acb14b-8113-483d-b19a-50671d30e5e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '410d831ab2584eb499cf297828f381d2', 'request_id': 'req-38acb14b-8113-483d-b19a-50671d30e5e2'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:29.340000 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-38acb14b-8113-483d-b19a-50671d30e5e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '410d831ab2584eb499cf297828f381d2', 'request_id': 'req-38acb14b-8113-483d-b19a-50671d30e5e2'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:29.346691 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-38acb14b-8113-483d-b19a-50671d30e5e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '410d831ab2584eb499cf297828f381d2', 'request_id': 'req-38acb14b-8113-483d-b19a-50671d30e5e2'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:29.427595 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-38acb14b-8113-483d-b19a-50671d30e5e2 admin admin] The token cache is being invalidate because project 410d831ab2584eb499cf297828f381d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:26:29.427891 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-38acb14b-8113-483d-b19a-50671d30e5e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:29.428566 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-38acb14b-8113-483d-b19a-50671d30e5e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:29.430348 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1368/2756] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:26:29 2022] DELETE /identity/v3/projects/410d831ab2584eb499cf297828f381d2 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:26:29.866268 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851ab34-02ee-4464-8e50-0d331a9b254c None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:29.866821 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851ab34-02ee-4464-8e50-0d331a9b254c None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:29.866821 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851ab34-02ee-4464-8e50-0d331a9b254c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:29.885333 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-e851ab34-02ee-4464-8e50-0d331a9b254c None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:26:29.886522 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-e851ab34-02ee-4464-8e50-0d331a9b254c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:29.947504 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1389/2757] 10.222.0.61 () {58 vars in 1016 bytes} [Tue May 10 03:26:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:26:29.962023 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38acb14b-8113-483d-b19a-50671d30e5e2 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:29.963631 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-38acb14b-8113-483d-b19a-50671d30e5e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:30.038265 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38acb14b-8113-483d-b19a-50671d30e5e2 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:30.043894 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8125c7f4-0eb3-444f-b887-fc98d7c8ad38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b7ccdccba0b4f9e86817946f22dbe28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:30.044578 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125c7f4-0eb3-444f-b887-fc98d7c8ad38 service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:30.044863 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125c7f4-0eb3-444f-b887-fc98d7c8ad38 service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:30.045172 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125c7f4-0eb3-444f-b887-fc98d7c8ad38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:30.053634 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8125c7f4-0eb3-444f-b887-fc98d7c8ad38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:30.055252 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8125c7f4-0eb3-444f-b887-fc98d7c8ad38 service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:30.065508 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1369/2758] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:26:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:26:32.419284 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e851ab34-02ee-4464-8e50-0d331a9b254c None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:32.420782 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-e851ab34-02ee-4464-8e50-0d331a9b254c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:32.433604 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e851ab34-02ee-4464-8e50-0d331a9b254c None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:32.438248 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee3299-4044-4c3a-9f93-9f7d6d1107b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:32.439134 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee3299-4044-4c3a-9f93-9f7d6d1107b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:32.439458 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee3299-4044-4c3a-9f93-9f7d6d1107b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:32.439740 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee3299-4044-4c3a-9f93-9f7d6d1107b4 admin admin] PATH_INFO: `/v3/users/cce24751d03344c295568f626803a5bf` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:32.440981 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ee3299-4044-4c3a-9f93-9f7d6d1107b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cce24751d03344c295568f626803a5bf)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:32.448755 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ee3299-4044-4c3a-9f93-9f7d6d1107b4 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:32.509618 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8125c7f4-0eb3-444f-b887-fc98d7c8ad38 service nova] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:32.511110 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-8125c7f4-0eb3-444f-b887-fc98d7c8ad38 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:32.524254 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8125c7f4-0eb3-444f-b887-fc98d7c8ad38 service nova] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:32.530403 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c01a7be-9e4a-401d-91bd-e651e0d09d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:32.530403 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01a7be-9e4a-401d-91bd-e651e0d09d6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:32.530403 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01a7be-9e4a-401d-91bd-e651e0d09d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:32.530730 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01a7be-9e4a-401d-91bd-e651e0d09d6d admin admin] PATH_INFO: `/v3/users/03c313020caa423bad637dd8423e145a` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:32.531765 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c01a7be-9e4a-401d-91bd-e651e0d09d6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=03c313020caa423bad637dd8423e145a)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:32.533957 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c01a7be-9e4a-401d-91bd-e651e0d09d6d admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:32.634919 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-37ee3299-4044-4c3a-9f93-9f7d6d1107b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cce24751d03344c295568f626803a5bf'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:32.642039 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-37ee3299-4044-4c3a-9f93-9f7d6d1107b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cce24751d03344c295568f626803a5bf'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:32.654562 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-37ee3299-4044-4c3a-9f93-9f7d6d1107b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cce24751d03344c295568f626803a5bf'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:32.655265 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-37ee3299-4044-4c3a-9f93-9f7d6d1107b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cce24751d03344c295568f626803a5bf'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:32.655879 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-37ee3299-4044-4c3a-9f93-9f7d6d1107b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cce24751d03344c295568f626803a5bf'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:32.732064 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-6c01a7be-9e4a-401d-91bd-e651e0d09d6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03c313020caa423bad637dd8423e145a'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:32.732717 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-6c01a7be-9e4a-401d-91bd-e651e0d09d6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03c313020caa423bad637dd8423e145a'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:32.740507 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-6c01a7be-9e4a-401d-91bd-e651e0d09d6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03c313020caa423bad637dd8423e145a'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:32.749336 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1390/2759] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:26:32 2022] DELETE /identity/v3/users/cce24751d03344c295568f626803a5bf => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:26:32.753974 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840fd7de-579e-445f-8a05-7c7b2e83af6c None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:32.754287 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840fd7de-579e-445f-8a05-7c7b2e83af6c None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:32.754607 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840fd7de-579e-445f-8a05-7c7b2e83af6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:32.772411 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-840fd7de-579e-445f-8a05-7c7b2e83af6c None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:26:32.773615 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-840fd7de-579e-445f-8a05-7c7b2e83af6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:32.821496 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-6c01a7be-9e4a-401d-91bd-e651e0d09d6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03c313020caa423bad637dd8423e145a'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:32.822143 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-6c01a7be-9e4a-401d-91bd-e651e0d09d6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03c313020caa423bad637dd8423e145a'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:32.830586 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1391/2760] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:26:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:26:32.839969 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840fd7de-579e-445f-8a05-7c7b2e83af6c None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:32.843261 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1370/2761] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:26:32 2022] DELETE /identity/v3/users/03c313020caa423bad637dd8423e145a => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:26:32.843383 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-840fd7de-579e-445f-8a05-7c7b2e83af6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:32.847176 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a07713-da1d-4c1c-bda6-ae161dab8d2d None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:32.847471 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a07713-da1d-4c1c-bda6-ae161dab8d2d None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:32.847749 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a07713-da1d-4c1c-bda6-ae161dab8d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:32.864741 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-66a07713-da1d-4c1c-bda6-ae161dab8d2d None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:26:32.865942 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-66a07713-da1d-4c1c-bda6-ae161dab8d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:32.898269 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840fd7de-579e-445f-8a05-7c7b2e83af6c None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:32.923359 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1371/2762] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:26:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:26:32.933324 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a07713-da1d-4c1c-bda6-ae161dab8d2d None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:32.934986 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-66a07713-da1d-4c1c-bda6-ae161dab8d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:32.948541 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb3b12c-71ef-40b6-97a3-030be6048ecc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:32.948541 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3b12c-71ef-40b6-97a3-030be6048ecc service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:32.948541 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3b12c-71ef-40b6-97a3-030be6048ecc service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:32.948541 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3b12c-71ef-40b6-97a3-030be6048ecc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:32.958893 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb3b12c-71ef-40b6-97a3-030be6048ecc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:32.960433 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb3b12c-71ef-40b6-97a3-030be6048ecc service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:32.970828 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1392/2763] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:26:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:26:32.994287 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a07713-da1d-4c1c-bda6-ae161dab8d2d None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:32.998274 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6b7999-942c-4f00-a026-dd2a0923c65c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:33.009793 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b7999-942c-4f00-a026-dd2a0923c65c service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:33.009793 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b7999-942c-4f00-a026-dd2a0923c65c service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:33.009793 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b7999-942c-4f00-a026-dd2a0923c65c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:33.010229 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6b7999-942c-4f00-a026-dd2a0923c65c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:33.011712 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6b7999-942c-4f00-a026-dd2a0923c65c service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:33.022497 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1372/2764] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:26:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:26:33.312613 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98bfa2-c64d-408f-a289-0783e1b94176 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:33.312903 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98bfa2-c64d-408f-a289-0783e1b94176 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:33.313700 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98bfa2-c64d-408f-a289-0783e1b94176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:33.332661 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-6c98bfa2-c64d-408f-a289-0783e1b94176 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:26:33.333893 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-6c98bfa2-c64d-408f-a289-0783e1b94176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:33.348793 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1393/2765] 10.222.0.61 () {58 vars in 1016 bytes} [Tue May 10 03:26:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:26:33.375944 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6b7999-942c-4f00-a026-dd2a0923c65c service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:33.375944 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-6e6b7999-942c-4f00-a026-dd2a0923c65c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:33.417475 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c98bfa2-c64d-408f-a289-0783e1b94176 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:33.421549 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-6c98bfa2-c64d-408f-a289-0783e1b94176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:33.432476 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c98bfa2-c64d-408f-a289-0783e1b94176 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:33.437247 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b64441f-5670-48db-88a7-ef5b2fc23a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:33.438284 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64441f-5670-48db-88a7-ef5b2fc23a55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:33.438501 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64441f-5670-48db-88a7-ef5b2fc23a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:33.438841 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64441f-5670-48db-88a7-ef5b2fc23a55 admin admin] PATH_INFO: `/v3/projects/942f5695f3e54d4c868cfcb43567d799` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:33.440230 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b64441f-5670-48db-88a7-ef5b2fc23a55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=942f5695f3e54d4c868cfcb43567d799)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:33.442690 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b64441f-5670-48db-88a7-ef5b2fc23a55 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:33.447443 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6b7999-942c-4f00-a026-dd2a0923c65c service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:33.463891 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc375686-8d56-45f3-8ed5-6470fc43fda3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b7ccdccba0b4f9e86817946f22dbe28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:33.465077 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc375686-8d56-45f3-8ed5-6470fc43fda3 service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:33.465929 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc375686-8d56-45f3-8ed5-6470fc43fda3 service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:33.465929 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc375686-8d56-45f3-8ed5-6470fc43fda3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:33.476025 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc375686-8d56-45f3-8ed5-6470fc43fda3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:33.477751 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc375686-8d56-45f3-8ed5-6470fc43fda3 service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:33.493260 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1373/2766] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:26:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:26:33.494108 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc375686-8d56-45f3-8ed5-6470fc43fda3 service nova] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:33.495433 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-bc375686-8d56-45f3-8ed5-6470fc43fda3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:33.508774 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc375686-8d56-45f3-8ed5-6470fc43fda3 service nova] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:33.513513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c75b8-0ddb-44af-9782-a09e526a5615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:33.514370 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c75b8-0ddb-44af-9782-a09e526a5615 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:33.514652 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c75b8-0ddb-44af-9782-a09e526a5615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:33.514931 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c75b8-0ddb-44af-9782-a09e526a5615 admin admin] PATH_INFO: `/v3/projects/62e5dd9ea01b4bd1adbc781c2bc4be4f` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:33.516160 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199c75b8-0ddb-44af-9782-a09e526a5615 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62e5dd9ea01b4bd1adbc781c2bc4be4f)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:33.518051 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199c75b8-0ddb-44af-9782-a09e526a5615 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:33.585418 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-2b64441f-5670-48db-88a7-ef5b2fc23a55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '942f5695f3e54d4c868cfcb43567d799', 'request_id': 'req-2b64441f-5670-48db-88a7-ef5b2fc23a55'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:33.590762 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-2b64441f-5670-48db-88a7-ef5b2fc23a55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '942f5695f3e54d4c868cfcb43567d799', 'request_id': 'req-2b64441f-5670-48db-88a7-ef5b2fc23a55'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:33.597137 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-2b64441f-5670-48db-88a7-ef5b2fc23a55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '942f5695f3e54d4c868cfcb43567d799', 'request_id': 'req-2b64441f-5670-48db-88a7-ef5b2fc23a55'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:33.719365 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-2b64441f-5670-48db-88a7-ef5b2fc23a55 admin admin] The token cache is being invalidate because project 942f5695f3e54d4c868cfcb43567d799 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:26:33.719591 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-2b64441f-5670-48db-88a7-ef5b2fc23a55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:33.720726 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-2b64441f-5670-48db-88a7-ef5b2fc23a55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:33.722778 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1394/2767] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:26:33 2022] DELETE /identity/v3/projects/942f5695f3e54d4c868cfcb43567d799 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:26:33.727712 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832b2ff-0285-49e1-9e37-5ff081a1fea2 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:33.728049 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832b2ff-0285-49e1-9e37-5ff081a1fea2 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:33.728445 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832b2ff-0285-49e1-9e37-5ff081a1fea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:33.731519 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-199c75b8-0ddb-44af-9782-a09e526a5615 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62e5dd9ea01b4bd1adbc781c2bc4be4f', 'request_id': 'req-199c75b8-0ddb-44af-9782-a09e526a5615'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:33.738223 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-199c75b8-0ddb-44af-9782-a09e526a5615 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62e5dd9ea01b4bd1adbc781c2bc4be4f', 'request_id': 'req-199c75b8-0ddb-44af-9782-a09e526a5615'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:33.744439 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-199c75b8-0ddb-44af-9782-a09e526a5615 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62e5dd9ea01b4bd1adbc781c2bc4be4f', 'request_id': 'req-199c75b8-0ddb-44af-9782-a09e526a5615'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:33.747591 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-2832b2ff-0285-49e1-9e37-5ff081a1fea2 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:26:33.750507 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-2832b2ff-0285-49e1-9e37-5ff081a1fea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:33.806214 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1395/2768] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:26:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:26:33.813808 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1c024-3f12-4f3e-88d5-369aab47a1fc None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:33.814100 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1c024-3f12-4f3e-88d5-369aab47a1fc None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:33.814379 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1c024-3f12-4f3e-88d5-369aab47a1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:33.832666 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-199c75b8-0ddb-44af-9782-a09e526a5615 admin admin] The token cache is being invalidate because project 62e5dd9ea01b4bd1adbc781c2bc4be4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:26:33.836616 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-12e1c024-3f12-4f3e-88d5-369aab47a1fc None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:26:33.836749 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-199c75b8-0ddb-44af-9782-a09e526a5615 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:33.836749 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-199c75b8-0ddb-44af-9782-a09e526a5615 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:33.836948 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-12e1c024-3f12-4f3e-88d5-369aab47a1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:33.837059 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1374/2769] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:26:33 2022] DELETE /identity/v3/projects/62e5dd9ea01b4bd1adbc781c2bc4be4f => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:26:33.839048 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c75b8-0ddb-44af-9782-a09e526a5615 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:33.840412 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-199c75b8-0ddb-44af-9782-a09e526a5615 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:33.842383 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1396/2770] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:26:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:26:33.846241 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e1c024-3f12-4f3e-88d5-369aab47a1fc None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:33.855304 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e1c024-3f12-4f3e-88d5-369aab47a1fc None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:33.855760 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c75b8-0ddb-44af-9782-a09e526a5615 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:33.860264 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70082838-fa7a-4fdd-9aa5-44cd00b46111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:33.860556 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263202e2-a1bb-4d1d-b48d-f8e36201f5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:33.865287 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70082838-fa7a-4fdd-9aa5-44cd00b46111 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:33.865287 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70082838-fa7a-4fdd-9aa5-44cd00b46111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:33.865478 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263202e2-a1bb-4d1d-b48d-f8e36201f5a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:33.865569 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70082838-fa7a-4fdd-9aa5-44cd00b46111 admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:33.865657 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263202e2-a1bb-4d1d-b48d-f8e36201f5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:33.865657 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263202e2-a1bb-4d1d-b48d-f8e36201f5a3 admin admin] PATH_INFO: `/v3/users/9e0907b8b890413aa763e9c5980ed055` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:33.865838 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70082838-fa7a-4fdd-9aa5-44cd00b46111 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:26:33.865838 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70082838-fa7a-4fdd-9aa5-44cd00b46111 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:33.866001 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263202e2-a1bb-4d1d-b48d-f8e36201f5a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e0907b8b890413aa763e9c5980ed055)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:33.866089 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70082838-fa7a-4fdd-9aa5-44cd00b46111 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:33.866182 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263202e2-a1bb-4d1d-b48d-f8e36201f5a3 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:33.875887 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1397/2771] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 10 03:26:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:26:33.880678 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70082838-fa7a-4fdd-9aa5-44cd00b46111 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:33.890248 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70082838-fa7a-4fdd-9aa5-44cd00b46111 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:33.896595 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea1c20d-1cc6-47a0-8fd3-40c38c146281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:33.899670 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea1c20d-1cc6-47a0-8fd3-40c38c146281 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:33.899670 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea1c20d-1cc6-47a0-8fd3-40c38c146281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:33.899670 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea1c20d-1cc6-47a0-8fd3-40c38c146281 admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:33.899670 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea1c20d-1cc6-47a0-8fd3-40c38c146281 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:33.900440 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea1c20d-1cc6-47a0-8fd3-40c38c146281 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:33.982016 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1398/2772] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:26:33 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:26:33.985960 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea1c20d-1cc6-47a0-8fd3-40c38c146281 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:34.044928 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea1c20d-1cc6-47a0-8fd3-40c38c146281 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:34.048869 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-263202e2-a1bb-4d1d-b48d-f8e36201f5a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e0907b8b890413aa763e9c5980ed055'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:34.048869 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-263202e2-a1bb-4d1d-b48d-f8e36201f5a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e0907b8b890413aa763e9c5980ed055'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:34.050315 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e2cc5-25a5-4abf-9efe-116ed5623570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:34.050976 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e2cc5-25a5-4abf-9efe-116ed5623570 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:34.051257 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e2cc5-25a5-4abf-9efe-116ed5623570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:34.051539 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e2cc5-25a5-4abf-9efe-116ed5623570 admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:34.052252 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e2cc5-25a5-4abf-9efe-116ed5623570 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:34.053933 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-263202e2-a1bb-4d1d-b48d-f8e36201f5a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e0907b8b890413aa763e9c5980ed055'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:34.054168 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e2cc5-25a5-4abf-9efe-116ed5623570 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:34.129712 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-263202e2-a1bb-4d1d-b48d-f8e36201f5a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e0907b8b890413aa763e9c5980ed055'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:34.130378 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-263202e2-a1bb-4d1d-b48d-f8e36201f5a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e0907b8b890413aa763e9c5980ed055'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:34.147479 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1375/2773] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:26:33 2022] DELETE /identity/v3/users/9e0907b8b890413aa763e9c5980ed055 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:26:34.177841 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1399/2774] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:26:33 2022] POST /identity/v3/users => generated 292 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:26:34.179373 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263202e2-a1bb-4d1d-b48d-f8e36201f5a3 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:34.180858 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-263202e2-a1bb-4d1d-b48d-f8e36201f5a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:34.244504 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263202e2-a1bb-4d1d-b48d-f8e36201f5a3 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:34.249347 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29569bb5-5bbc-4d94-93c9-27bda1aa9b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:34.250024 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29569bb5-5bbc-4d94-93c9-27bda1aa9b32 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:34.250307 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29569bb5-5bbc-4d94-93c9-27bda1aa9b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:34.250587 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29569bb5-5bbc-4d94-93c9-27bda1aa9b32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:34.251340 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29569bb5-5bbc-4d94-93c9-27bda1aa9b32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:34.253708 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29569bb5-5bbc-4d94-93c9-27bda1aa9b32 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:34.263407 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1376/2775] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:26:34.267465 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e2cc5-25a5-4abf-9efe-116ed5623570 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:34.277542 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e2cc5-25a5-4abf-9efe-116ed5623570 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:34.282214 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f21bb3-9d22-4804-b81e-0116a78a5164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:34.282851 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f21bb3-9d22-4804-b81e-0116a78a5164 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:34.283137 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f21bb3-9d22-4804-b81e-0116a78a5164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:34.283417 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f21bb3-9d22-4804-b81e-0116a78a5164 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:34.284184 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f21bb3-9d22-4804-b81e-0116a78a5164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:34.285812 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f21bb3-9d22-4804-b81e-0116a78a5164 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:34.295567 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1400/2776] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:26:34.300383 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29569bb5-5bbc-4d94-93c9-27bda1aa9b32 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:34.310989 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29569bb5-5bbc-4d94-93c9-27bda1aa9b32 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:34.316433 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86798f07-9703-4567-bcab-d4cda2f73630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:34.317344 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86798f07-9703-4567-bcab-d4cda2f73630 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:34.317631 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86798f07-9703-4567-bcab-d4cda2f73630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:34.317910 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86798f07-9703-4567-bcab-d4cda2f73630 admin admin] PATH_INFO: `/v3/projects/e4b0163544d04c9ab32061d760c23931/users/691a282df8ad402fad12be3ab9383eba/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:34.332599 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86798f07-9703-4567-bcab-d4cda2f73630 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4b0163544d04c9ab32061d760c23931, user_id=691a282df8ad402fad12be3ab9383eba, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:34.335447 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86798f07-9703-4567-bcab-d4cda2f73630 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:34.403713 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1377/2777] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:26:34 2022] PUT /identity/v3/projects/e4b0163544d04c9ab32061d760c23931/users/691a282df8ad402fad12be3ab9383eba/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:26:34.414969 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9c97d-b451-4cd2-a0fc-3d111050912b None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:34.415258 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9c97d-b451-4cd2-a0fc-3d111050912b None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:34.415816 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9c97d-b451-4cd2-a0fc-3d111050912b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:34.446826 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-2ef9c97d-b451-4cd2-a0fc-3d111050912b None None] MFA Rules not processed for user `691a282df8ad402fad12be3ab9383eba`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:26:34.448085 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-2ef9c97d-b451-4cd2-a0fc-3d111050912b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:34.515091 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1401/2778] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:26:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:26:34.519562 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86798f07-9703-4567-bcab-d4cda2f73630 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:34.553886 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef9c97d-b451-4cd2-a0fc-3d111050912b None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:34.555699 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-2ef9c97d-b451-4cd2-a0fc-3d111050912b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:34.587957 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86798f07-9703-4567-bcab-d4cda2f73630 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:34.593171 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54976b4-5b1d-4c03-a962-8360710d84c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:34.593847 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54976b4-5b1d-4c03-a962-8360710d84c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:34.594134 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54976b4-5b1d-4c03-a962-8360710d84c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:34.594417 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54976b4-5b1d-4c03-a962-8360710d84c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:34.595166 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54976b4-5b1d-4c03-a962-8360710d84c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:34.597797 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54976b4-5b1d-4c03-a962-8360710d84c6 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:34.623978 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef9c97d-b451-4cd2-a0fc-3d111050912b None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:34.628529 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3f6a6-f6ad-4791-91a6-c52458d8dae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:34.629380 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3f6a6-f6ad-4791-91a6-c52458d8dae9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:34.629656 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3f6a6-f6ad-4791-91a6-c52458d8dae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:34.629971 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3f6a6-f6ad-4791-91a6-c52458d8dae9 admin admin] PATH_INFO: `/v3/projects/94f8ec0842c14db6b7cd74b469b54e67` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:34.631146 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d3f6a6-f6ad-4791-91a6-c52458d8dae9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94f8ec0842c14db6b7cd74b469b54e67)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:34.633058 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d3f6a6-f6ad-4791-91a6-c52458d8dae9 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:34.731327 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1378/2779] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:26:34 2022] POST /identity/v3/projects => generated 383 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:26:34.735929 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54976b4-5b1d-4c03-a962-8360710d84c6 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:34.753566 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-67d3f6a6-f6ad-4791-91a6-c52458d8dae9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94f8ec0842c14db6b7cd74b469b54e67', 'request_id': 'req-67d3f6a6-f6ad-4791-91a6-c52458d8dae9'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:34.758990 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-67d3f6a6-f6ad-4791-91a6-c52458d8dae9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94f8ec0842c14db6b7cd74b469b54e67', 'request_id': 'req-67d3f6a6-f6ad-4791-91a6-c52458d8dae9'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:34.764984 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-67d3f6a6-f6ad-4791-91a6-c52458d8dae9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94f8ec0842c14db6b7cd74b469b54e67', 'request_id': 'req-67d3f6a6-f6ad-4791-91a6-c52458d8dae9'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:34.801922 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54976b4-5b1d-4c03-a962-8360710d84c6 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:34.854799 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-67d3f6a6-f6ad-4791-91a6-c52458d8dae9 admin admin] The token cache is being invalidate because project 94f8ec0842c14db6b7cd74b469b54e67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:26:34.855086 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-67d3f6a6-f6ad-4791-91a6-c52458d8dae9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:34.855834 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-67d3f6a6-f6ad-4791-91a6-c52458d8dae9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:34.857826 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1402/2780] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:26:34 2022] DELETE /identity/v3/projects/94f8ec0842c14db6b7cd74b469b54e67 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:26:34.858664 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e8b090-938f-43ae-851c-0a18e3266cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:34.859343 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8b090-938f-43ae-851c-0a18e3266cf3 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:34.859624 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8b090-938f-43ae-851c-0a18e3266cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:34.859907 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8b090-938f-43ae-851c-0a18e3266cf3 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:34.860617 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e8b090-938f-43ae-851c-0a18e3266cf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:34.862631 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e8b090-938f-43ae-851c-0a18e3266cf3 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:34.863472 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f7a7ad-b50c-407a-8222-3f101ee9dda1 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:34.863834 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f7a7ad-b50c-407a-8222-3f101ee9dda1 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:34.864229 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f7a7ad-b50c-407a-8222-3f101ee9dda1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:34.882098 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-b9f7a7ad-b50c-407a-8222-3f101ee9dda1 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:26:34.883309 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-b9f7a7ad-b50c-407a-8222-3f101ee9dda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:34.891501 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1403/2781] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:26:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:26:34.900026 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486fe85-0593-4644-a8db-c9e0da08f61e None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:34.900278 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486fe85-0593-4644-a8db-c9e0da08f61e None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:34.900555 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486fe85-0593-4644-a8db-c9e0da08f61e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:34.918663 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-4486fe85-0593-4644-a8db-c9e0da08f61e None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:26:34.919845 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-4486fe85-0593-4644-a8db-c9e0da08f61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:34.928152 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1404/2782] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:26:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:26:34.932237 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4486fe85-0593-4644-a8db-c9e0da08f61e None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:34.941171 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4486fe85-0593-4644-a8db-c9e0da08f61e None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:34.941351 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1379/2783] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:26:34 2022] POST /identity/v3/users => generated 292 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:26:34.945763 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df87404-87c3-4a2e-8c91-15297d153101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:34.946470 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df87404-87c3-4a2e-8c91-15297d153101 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:34.946755 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df87404-87c3-4a2e-8c91-15297d153101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:34.947032 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df87404-87c3-4a2e-8c91-15297d153101 admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:34.947755 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df87404-87c3-4a2e-8c91-15297d153101 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:26:34.948088 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df87404-87c3-4a2e-8c91-15297d153101 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:34.948943 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e8b090-938f-43ae-851c-0a18e3266cf3 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:34.949674 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df87404-87c3-4a2e-8c91-15297d153101 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:34.950664 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-59e8b090-938f-43ae-851c-0a18e3266cf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:34.961805 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1405/2784] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 10 03:26:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 03:26:34.962819 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e8b090-938f-43ae-851c-0a18e3266cf3 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:34.965935 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df87404-87c3-4a2e-8c91-15297d153101 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:34.968085 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695b832e-c25e-4d16-9c24-39bd6af9a8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:34.968881 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b832e-c25e-4d16-9c24-39bd6af9a8b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:34.969240 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b832e-c25e-4d16-9c24-39bd6af9a8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:34.979136 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b832e-c25e-4d16-9c24-39bd6af9a8b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:34.979136 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695b832e-c25e-4d16-9c24-39bd6af9a8b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:34.979136 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695b832e-c25e-4d16-9c24-39bd6af9a8b3 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:34.979622 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df87404-87c3-4a2e-8c91-15297d153101 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:34.981355 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f86a5-dfd2-4f4d-9d7f-40d269c5f3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:34.982051 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f86a5-dfd2-4f4d-9d7f-40d269c5f3b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:34.982337 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f86a5-dfd2-4f4d-9d7f-40d269c5f3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:34.982616 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f86a5-dfd2-4f4d-9d7f-40d269c5f3b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:34.985851 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1380/2785] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:26:34.985978 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81f86a5-dfd2-4f4d-9d7f-40d269c5f3b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:34.985978 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81f86a5-dfd2-4f4d-9d7f-40d269c5f3b1 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:34.986837 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695b832e-c25e-4d16-9c24-39bd6af9a8b3 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:34.996479 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695b832e-c25e-4d16-9c24-39bd6af9a8b3 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:35.001189 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f9ef83-3af9-47ba-9972-5b69a60f5eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:35.001843 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9ef83-3af9-47ba-9972-5b69a60f5eb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:35.002125 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9ef83-3af9-47ba-9972-5b69a60f5eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:35.002402 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9ef83-3af9-47ba-9972-5b69a60f5eb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:35.003209 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f9ef83-3af9-47ba-9972-5b69a60f5eb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:35.004868 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f9ef83-3af9-47ba-9972-5b69a60f5eb8 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:35.015447 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1381/2786] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:26:35.020317 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f9ef83-3af9-47ba-9972-5b69a60f5eb8 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:35.029530 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f9ef83-3af9-47ba-9972-5b69a60f5eb8 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:35.034778 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a578178-5a05-4668-89a8-2c68aaf7fccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:35.035645 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a578178-5a05-4668-89a8-2c68aaf7fccd admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:35.035927 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a578178-5a05-4668-89a8-2c68aaf7fccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:35.036231 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a578178-5a05-4668-89a8-2c68aaf7fccd admin admin] PATH_INFO: `/v3/projects/65723d6c40bd4048aaff1d184169ec39/users/f05693f2725a47bb9dca4eada432489b/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:35.051202 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a578178-5a05-4668-89a8-2c68aaf7fccd admin admin] RBAC: Authorizing `identity:create_grant(project_id=65723d6c40bd4048aaff1d184169ec39, user_id=f05693f2725a47bb9dca4eada432489b, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:35.054091 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a578178-5a05-4668-89a8-2c68aaf7fccd admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:35.097605 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1406/2787] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:26:34 2022] POST /identity/v3/projects => generated 385 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:26:35.101501 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f86a5-dfd2-4f4d-9d7f-40d269c5f3b1 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:35.140985 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1382/2788] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:26:35 2022] PUT /identity/v3/projects/65723d6c40bd4048aaff1d184169ec39/users/f05693f2725a47bb9dca4eada432489b/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:26:35.152673 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e0093-d347-454d-80ac-f091d0123507 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:35.152965 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e0093-d347-454d-80ac-f091d0123507 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:35.153246 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e0093-d347-454d-80ac-f091d0123507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:35.161608 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f86a5-dfd2-4f4d-9d7f-40d269c5f3b1 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:35.179780 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-ca0e0093-d347-454d-80ac-f091d0123507 None None] MFA Rules not processed for user `f05693f2725a47bb9dca4eada432489b`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:26:35.181065 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-ca0e0093-d347-454d-80ac-f091d0123507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:35.216023 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3397ab65-9a91-4ce4-b895-674020c3f66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:35.216749 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3397ab65-9a91-4ce4-b895-674020c3f66d admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:35.217034 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3397ab65-9a91-4ce4-b895-674020c3f66d admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:35.217308 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3397ab65-9a91-4ce4-b895-674020c3f66d admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:35.217992 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3397ab65-9a91-4ce4-b895-674020c3f66d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:35.219899 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3397ab65-9a91-4ce4-b895-674020c3f66d admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:35.242799 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1383/2789] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:26:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:26:35.247259 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0e0093-d347-454d-80ac-f091d0123507 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:35.257565 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0e0093-d347-454d-80ac-f091d0123507 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:35.262186 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4400dde1-367c-4679-9e53-762de49e1637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:35.262814 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4400dde1-367c-4679-9e53-762de49e1637 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:35.263098 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4400dde1-367c-4679-9e53-762de49e1637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:35.263373 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4400dde1-367c-4679-9e53-762de49e1637 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:35.264147 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4400dde1-367c-4679-9e53-762de49e1637 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:35.266040 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4400dde1-367c-4679-9e53-762de49e1637 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:35.324321 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1407/2790] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:26:35 2022] POST /identity/v3/users => generated 293 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:26:35.328360 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3397ab65-9a91-4ce4-b895-674020c3f66d admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:35.338699 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3397ab65-9a91-4ce4-b895-674020c3f66d admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:35.343410 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf1b589-2677-4bed-9cd8-8a8828624b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:35.344081 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1b589-2677-4bed-9cd8-8a8828624b94 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:35.344370 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1b589-2677-4bed-9cd8-8a8828624b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:35.344650 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1b589-2677-4bed-9cd8-8a8828624b94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:35.345398 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf1b589-2677-4bed-9cd8-8a8828624b94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:35.346986 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf1b589-2677-4bed-9cd8-8a8828624b94 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:35.355441 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1384/2791] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:26:35 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:26:35.356790 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1408/2792] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:26:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:26:35.362469 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf1b589-2677-4bed-9cd8-8a8828624b94 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:35.362600 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4400dde1-367c-4679-9e53-762de49e1637 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:35.372085 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf1b589-2677-4bed-9cd8-8a8828624b94 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:35.423411 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4400dde1-367c-4679-9e53-762de49e1637 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:35.428561 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b38223-b9fc-42a1-b797-11cb9290472f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:35.428745 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee34b5c-fde0-4fb1-97f6-92c204d63c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:35.429228 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b38223-b9fc-42a1-b797-11cb9290472f admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:35.429516 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b38223-b9fc-42a1-b797-11cb9290472f admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:35.429696 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee34b5c-fde0-4fb1-97f6-92c204d63c44 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:35.429827 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b38223-b9fc-42a1-b797-11cb9290472f admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:35.430156 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee34b5c-fde0-4fb1-97f6-92c204d63c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:35.430462 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b38223-b9fc-42a1-b797-11cb9290472f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:35.430606 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee34b5c-fde0-4fb1-97f6-92c204d63c44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:35.431582 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee34b5c-fde0-4fb1-97f6-92c204d63c44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:35.432424 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b38223-b9fc-42a1-b797-11cb9290472f admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:35.433405 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee34b5c-fde0-4fb1-97f6-92c204d63c44 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:35.443902 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1385/2793] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:26:35 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:26:35.447992 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee34b5c-fde0-4fb1-97f6-92c204d63c44 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:35.458526 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee34b5c-fde0-4fb1-97f6-92c204d63c44 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:35.463780 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc1965-abfd-4b56-82c1-22b17399c56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:35.464688 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc1965-abfd-4b56-82c1-22b17399c56e admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:35.464998 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc1965-abfd-4b56-82c1-22b17399c56e admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:35.465274 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc1965-abfd-4b56-82c1-22b17399c56e admin admin] PATH_INFO: `/v3/projects/619a6d46cc1a420a96a51dc648421c9a/users/a6250150609a4511883929fcc49d8d97/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:35.479940 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abc1965-abfd-4b56-82c1-22b17399c56e admin admin] RBAC: Authorizing `identity:create_grant(project_id=619a6d46cc1a420a96a51dc648421c9a, user_id=a6250150609a4511883929fcc49d8d97, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:35.482630 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abc1965-abfd-4b56-82c1-22b17399c56e admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:35.523486 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1409/2794] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:26:35 2022] POST /identity/v3/users => generated 299 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:26:35.527399 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b38223-b9fc-42a1-b797-11cb9290472f admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:35.536704 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b38223-b9fc-42a1-b797-11cb9290472f admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:35.541388 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84b4294-0d4d-41e5-8105-aa573088407c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:35.543363 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b4294-0d4d-41e5-8105-aa573088407c admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:35.543363 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b4294-0d4d-41e5-8105-aa573088407c admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:35.543363 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b4294-0d4d-41e5-8105-aa573088407c admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:35.543363 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84b4294-0d4d-41e5-8105-aa573088407c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:35.544980 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84b4294-0d4d-41e5-8105-aa573088407c admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:35.555670 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1410/2795] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:26:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:26:35.559477 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84b4294-0d4d-41e5-8105-aa573088407c admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:35.569207 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84b4294-0d4d-41e5-8105-aa573088407c admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:35.574004 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7314990-ba10-4f65-a578-fce5e440d801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:35.577926 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7314990-ba10-4f65-a578-fce5e440d801 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:35.577926 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7314990-ba10-4f65-a578-fce5e440d801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:35.577926 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7314990-ba10-4f65-a578-fce5e440d801 admin admin] PATH_INFO: `/v3/projects/ec0a680a07714400b1eb98ee4aec7c72/users/3d3e8e748f9d4b718b86a8e62aae3a3c/roles/43105000610f402ca2486e7648018cca` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:35.580276 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1386/2796] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:26:35 2022] PUT /identity/v3/projects/619a6d46cc1a420a96a51dc648421c9a/users/a6250150609a4511883929fcc49d8d97/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:26:35.589729 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7314990-ba10-4f65-a578-fce5e440d801 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec0a680a07714400b1eb98ee4aec7c72, user_id=3d3e8e748f9d4b718b86a8e62aae3a3c, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:35.591556 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714c1bc-b59c-4466-8df4-c05fbd9a9dd3 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:35.591929 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714c1bc-b59c-4466-8df4-c05fbd9a9dd3 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:35.592260 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714c1bc-b59c-4466-8df4-c05fbd9a9dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:35.592383 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7314990-ba10-4f65-a578-fce5e440d801 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:35.619386 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-3714c1bc-b59c-4466-8df4-c05fbd9a9dd3 None None] MFA Rules not processed for user `a6250150609a4511883929fcc49d8d97`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:26:35.620626 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-3714c1bc-b59c-4466-8df4-c05fbd9a9dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:35.682118 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1387/2797] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:26:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:26:35.694438 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3714c1bc-b59c-4466-8df4-c05fbd9a9dd3 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:35.695840 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-3714c1bc-b59c-4466-8df4-c05fbd9a9dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:35.697131 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1411/2798] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:26:35 2022] PUT /identity/v3/projects/ec0a680a07714400b1eb98ee4aec7c72/users/3d3e8e748f9d4b718b86a8e62aae3a3c/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:26:35.701034 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7314990-ba10-4f65-a578-fce5e440d801 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:35.750729 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3714c1bc-b59c-4466-8df4-c05fbd9a9dd3 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:35.761221 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7314990-ba10-4f65-a578-fce5e440d801 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:35.765991 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0821c0-a97e-4768-aa72-dc23aa7177a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:35.766658 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0821c0-a97e-4768-aa72-dc23aa7177a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:35.766947 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0821c0-a97e-4768-aa72-dc23aa7177a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:35.767228 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0821c0-a97e-4768-aa72-dc23aa7177a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:35.767951 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0821c0-a97e-4768-aa72-dc23aa7177a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:35.769589 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0821c0-a97e-4768-aa72-dc23aa7177a6 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:35.779443 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1412/2799] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:26:35 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:26:35.783482 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0821c0-a97e-4768-aa72-dc23aa7177a6 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:35.793073 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0821c0-a97e-4768-aa72-dc23aa7177a6 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:35.797645 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3691736f-52e5-49f5-93cc-342d93a2c5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:35.798510 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691736f-52e5-49f5-93cc-342d93a2c5c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:35.803818 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabff218-1a5f-4c4f-8a94-162894d7c87a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:35.803965 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691736f-52e5-49f5-93cc-342d93a2c5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:35.803965 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691736f-52e5-49f5-93cc-342d93a2c5c5 admin admin] PATH_INFO: `/v3/projects/ec0a680a07714400b1eb98ee4aec7c72/users/3d3e8e748f9d4b718b86a8e62aae3a3c/roles/43105000610f402ca2486e7648018cca` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:35.804182 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabff218-1a5f-4c4f-8a94-162894d7c87a service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:35.804182 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabff218-1a5f-4c4f-8a94-162894d7c87a service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:35.804182 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabff218-1a5f-4c4f-8a94-162894d7c87a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:35.804454 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3691736f-52e5-49f5-93cc-342d93a2c5c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec0a680a07714400b1eb98ee4aec7c72, user_id=3d3e8e748f9d4b718b86a8e62aae3a3c, role_id=43105000610f402ca2486e7648018cca)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:35.804556 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3691736f-52e5-49f5-93cc-342d93a2c5c5 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:35.814555 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1413/2800] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:26:35 2022] PUT /identity/v3/projects/ec0a680a07714400b1eb98ee4aec7c72/users/3d3e8e748f9d4b718b86a8e62aae3a3c/roles/43105000610f402ca2486e7648018cca => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:26:35.825385 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4880f1-562a-4fdc-b5db-61b9b36b16f7 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:35.825732 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4880f1-562a-4fdc-b5db-61b9b36b16f7 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:35.826068 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4880f1-562a-4fdc-b5db-61b9b36b16f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:35.857087 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-ae4880f1-562a-4fdc-b5db-61b9b36b16f7 None None] MFA Rules not processed for user `3d3e8e748f9d4b718b86a8e62aae3a3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:26:35.857087 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-ae4880f1-562a-4fdc-b5db-61b9b36b16f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:35.857413 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabff218-1a5f-4c4f-8a94-162894d7c87a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:35.857887 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabff218-1a5f-4c4f-8a94-162894d7c87a service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:35.867427 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1388/2801] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:26:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:26:35.921832 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1414/2802] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:26:35 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:26:35.934194 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabff218-1a5f-4c4f-8a94-162894d7c87a service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:35.935696 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-cabff218-1a5f-4c4f-8a94-162894d7c87a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:35.947015 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabff218-1a5f-4c4f-8a94-162894d7c87a service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:35.997129 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518bd781-f205-47da-8167-080d8e1f7b84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:35.997776 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518bd781-f205-47da-8167-080d8e1f7b84 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:35.998054 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518bd781-f205-47da-8167-080d8e1f7b84 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:35.998322 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518bd781-f205-47da-8167-080d8e1f7b84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:36.000150 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-518bd781-f205-47da-8167-080d8e1f7b84 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:36.058276 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518bd781-f205-47da-8167-080d8e1f7b84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:36.059791 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518bd781-f205-47da-8167-080d8e1f7b84 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:36.069292 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1389/2803] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:26:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:26:36.627355 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6eddc-7b9a-4b77-a6b2-d3714cbae708 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:36.627871 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6eddc-7b9a-4b77-a6b2-d3714cbae708 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:36.628122 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6eddc-7b9a-4b77-a6b2-d3714cbae708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:36.646733 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-65e6eddc-7b9a-4b77-a6b2-d3714cbae708 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:26:36.647991 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-65e6eddc-7b9a-4b77-a6b2-d3714cbae708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:36.707211 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1415/2804] 10.222.0.61 () {58 vars in 1016 bytes} [Tue May 10 03:26:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:26:36.722339 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518bd781-f205-47da-8167-080d8e1f7b84 service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:36.723841 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-518bd781-f205-47da-8167-080d8e1f7b84 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:36.801409 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518bd781-f205-47da-8167-080d8e1f7b84 service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:36.806982 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a03a4c-8149-41c1-a6d3-cf42c6c04be0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b7ccdccba0b4f9e86817946f22dbe28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:36.807665 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a03a4c-8149-41c1-a6d3-cf42c6c04be0 service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:36.807922 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a03a4c-8149-41c1-a6d3-cf42c6c04be0 service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:36.808235 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a03a4c-8149-41c1-a6d3-cf42c6c04be0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:36.816931 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a03a4c-8149-41c1-a6d3-cf42c6c04be0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:36.818694 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a03a4c-8149-41c1-a6d3-cf42c6c04be0 service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:36.828874 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1390/2805] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:26:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:26:38.141316 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e6eddc-7b9a-4b77-a6b2-d3714cbae708 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:38.156970 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e6eddc-7b9a-4b77-a6b2-d3714cbae708 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:38.163057 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc6ed45-00c3-4b2a-8e83-f0a756f448c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:38.163711 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6ed45-00c3-4b2a-8e83-f0a756f448c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:38.163994 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6ed45-00c3-4b2a-8e83-f0a756f448c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:38.164304 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6ed45-00c3-4b2a-8e83-f0a756f448c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:38.226378 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc6ed45-00c3-4b2a-8e83-f0a756f448c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:38.227847 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc6ed45-00c3-4b2a-8e83-f0a756f448c5 service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:38.236864 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1416/2806] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:26:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:26:39.807387 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a03a4c-8149-41c1-a6d3-cf42c6c04be0 service nova] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:39.816755 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a03a4c-8149-41c1-a6d3-cf42c6c04be0 service nova] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:39.820443 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131eeb38-c31f-41a9-ac77-a4454172ebfa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:39.821078 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131eeb38-c31f-41a9-ac77-a4454172ebfa service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:39.821364 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131eeb38-c31f-41a9-ac77-a4454172ebfa service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:39.821661 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131eeb38-c31f-41a9-ac77-a4454172ebfa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:39.830494 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131eeb38-c31f-41a9-ac77-a4454172ebfa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:39.831940 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131eeb38-c31f-41a9-ac77-a4454172ebfa service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:39.841531 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1391/2807] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:26:39 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:26:39.899764 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e16f55-cdda-4fbd-85ce-b24b71b762c0 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:39.900304 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e16f55-cdda-4fbd-85ce-b24b71b762c0 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:39.900499 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e16f55-cdda-4fbd-85ce-b24b71b762c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:39.919513 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-a9e16f55-cdda-4fbd-85ce-b24b71b762c0 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:26:39.920779 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-a9e16f55-cdda-4fbd-85ce-b24b71b762c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:39.929687 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1417/2808] 10.222.0.61 () {58 vars in 1016 bytes} [Tue May 10 03:26:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:26:39.944307 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131eeb38-c31f-41a9-ac77-a4454172ebfa service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:39.945810 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-131eeb38-c31f-41a9-ac77-a4454172ebfa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:39.961174 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131eeb38-c31f-41a9-ac77-a4454172ebfa service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:39.966666 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac4ca5d-0d13-4b8a-af06-b72bd184ea4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b7ccdccba0b4f9e86817946f22dbe28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:39.967300 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac4ca5d-0d13-4b8a-af06-b72bd184ea4c service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:39.967583 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac4ca5d-0d13-4b8a-af06-b72bd184ea4c service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:39.967862 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac4ca5d-0d13-4b8a-af06-b72bd184ea4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:39.976592 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac4ca5d-0d13-4b8a-af06-b72bd184ea4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:39.978214 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac4ca5d-0d13-4b8a-af06-b72bd184ea4c service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:39.987968 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1392/2809] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:26:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:26:42.911310 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e16f55-cdda-4fbd-85ce-b24b71b762c0 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:42.915638 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e16f55-cdda-4fbd-85ce-b24b71b762c0 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:42.920202 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff62b061-413d-4117-ae11-bd849ffc87cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:42.921052 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62b061-413d-4117-ae11-bd849ffc87cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:42.921330 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62b061-413d-4117-ae11-bd849ffc87cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:42.921599 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62b061-413d-4117-ae11-bd849ffc87cc admin admin] PATH_INFO: `/v3/users/a6250150609a4511883929fcc49d8d97` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:42.922768 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff62b061-413d-4117-ae11-bd849ffc87cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6250150609a4511883929fcc49d8d97)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:42.924961 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff62b061-413d-4117-ae11-bd849ffc87cc admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:43.126189 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-ff62b061-413d-4117-ae11-bd849ffc87cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6250150609a4511883929fcc49d8d97'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:43.133884 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-ff62b061-413d-4117-ae11-bd849ffc87cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6250150609a4511883929fcc49d8d97'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:43.144861 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-ff62b061-413d-4117-ae11-bd849ffc87cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6250150609a4511883929fcc49d8d97'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:43.149337 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-ff62b061-413d-4117-ae11-bd849ffc87cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6250150609a4511883929fcc49d8d97'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:43.149337 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-ff62b061-413d-4117-ae11-bd849ffc87cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6250150609a4511883929fcc49d8d97'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:43.235514 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1418/2810] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:26:42 2022] DELETE /identity/v3/users/a6250150609a4511883929fcc49d8d97 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:26:43.236942 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d528613-9bc9-4880-ba5e-bc67245bf9f2 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:43.237393 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d528613-9bc9-4880-ba5e-bc67245bf9f2 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:43.237393 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d528613-9bc9-4880-ba5e-bc67245bf9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:43.257534 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-1d528613-9bc9-4880-ba5e-bc67245bf9f2 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:26:43.257534 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-1d528613-9bc9-4880-ba5e-bc67245bf9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:43.272090 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3a065-863c-482b-977d-90615982e455 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:43.272408 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3a065-863c-482b-977d-90615982e455 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:43.272638 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3a065-863c-482b-977d-90615982e455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:43.294634 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-76b3a065-863c-482b-977d-90615982e455 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:26:43.295868 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-76b3a065-863c-482b-977d-90615982e455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:43.323081 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1393/2811] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:26:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:26:43.332793 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d528613-9bc9-4880-ba5e-bc67245bf9f2 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:43.334217 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-1d528613-9bc9-4880-ba5e-bc67245bf9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:43.357804 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1419/2812] 10.222.0.61 () {58 vars in 1016 bytes} [Tue May 10 03:26:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:26:43.373501 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b3a065-863c-482b-977d-90615982e455 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:43.377239 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-76b3a065-863c-482b-977d-90615982e455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:43.396910 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d528613-9bc9-4880-ba5e-bc67245bf9f2 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:43.400468 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f281c6-b9ff-4cff-a10e-53a278fc1a21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:43.401114 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f281c6-b9ff-4cff-a10e-53a278fc1a21 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:43.401393 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f281c6-b9ff-4cff-a10e-53a278fc1a21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:43.401665 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f281c6-b9ff-4cff-a10e-53a278fc1a21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:43.410788 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f281c6-b9ff-4cff-a10e-53a278fc1a21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:43.412346 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f281c6-b9ff-4cff-a10e-53a278fc1a21 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:43.422478 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1394/2813] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:26:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:26:43.447664 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b3a065-863c-482b-977d-90615982e455 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:43.462883 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c3126-9646-464a-b350-de68f112d91b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b7ccdccba0b4f9e86817946f22dbe28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:43.464164 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c3126-9646-464a-b350-de68f112d91b service nova] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:43.464630 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c3126-9646-464a-b350-de68f112d91b service nova] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:43.465142 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c3126-9646-464a-b350-de68f112d91b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:43.479434 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779c3126-9646-464a-b350-de68f112d91b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:43.481088 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779c3126-9646-464a-b350-de68f112d91b service nova] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:43.491923 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1420/2814] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:26:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:26:43.871706 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f281c6-b9ff-4cff-a10e-53a278fc1a21 service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:43.871706 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-d4f281c6-b9ff-4cff-a10e-53a278fc1a21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:43.882658 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f281c6-b9ff-4cff-a10e-53a278fc1a21 service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:43.887344 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b8b944-1095-435d-8ac3-ad14827c5f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:43.888241 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8b944-1095-435d-8ac3-ad14827c5f0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:43.888526 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8b944-1095-435d-8ac3-ad14827c5f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:43.888800 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8b944-1095-435d-8ac3-ad14827c5f0a admin admin] PATH_INFO: `/v3/projects/619a6d46cc1a420a96a51dc648421c9a` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:43.890031 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b8b944-1095-435d-8ac3-ad14827c5f0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=619a6d46cc1a420a96a51dc648421c9a)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:43.891986 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b8b944-1095-435d-8ac3-ad14827c5f0a admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:44.050264 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c0b8b944-1095-435d-8ac3-ad14827c5f0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '619a6d46cc1a420a96a51dc648421c9a', 'request_id': 'req-c0b8b944-1095-435d-8ac3-ad14827c5f0a'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:44.055691 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c0b8b944-1095-435d-8ac3-ad14827c5f0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '619a6d46cc1a420a96a51dc648421c9a', 'request_id': 'req-c0b8b944-1095-435d-8ac3-ad14827c5f0a'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:44.062071 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c0b8b944-1095-435d-8ac3-ad14827c5f0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '619a6d46cc1a420a96a51dc648421c9a', 'request_id': 'req-c0b8b944-1095-435d-8ac3-ad14827c5f0a'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:44.141134 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c0b8b944-1095-435d-8ac3-ad14827c5f0a admin admin] The token cache is being invalidate because project 619a6d46cc1a420a96a51dc648421c9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:26:44.147516 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c0b8b944-1095-435d-8ac3-ad14827c5f0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:44.147516 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c0b8b944-1095-435d-8ac3-ad14827c5f0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:44.147516 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1395/2815] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:26:43 2022] DELETE /identity/v3/projects/619a6d46cc1a420a96a51dc648421c9a => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:26:44.149107 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd62b8-827e-4361-b8a2-63814231abb1 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:44.149561 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd62b8-827e-4361-b8a2-63814231abb1 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:44.149663 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd62b8-827e-4361-b8a2-63814231abb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:44.169323 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-97bd62b8-827e-4361-b8a2-63814231abb1 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:26:44.170544 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-97bd62b8-827e-4361-b8a2-63814231abb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:44.226829 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1421/2816] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:26:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:26:44.235515 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad759b5-adfd-471a-a4e2-da99c43f91ee None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:44.235803 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad759b5-adfd-471a-a4e2-da99c43f91ee None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:44.236118 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad759b5-adfd-471a-a4e2-da99c43f91ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:44.254054 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-1ad759b5-adfd-471a-a4e2-da99c43f91ee None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:26:44.255240 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-1ad759b5-adfd-471a-a4e2-da99c43f91ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:44.263599 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1396/2817] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:26:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:26:44.272825 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd62b8-827e-4361-b8a2-63814231abb1 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:44.282651 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd62b8-827e-4361-b8a2-63814231abb1 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:44.290910 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195334c-33d7-4bc4-bcb4-636327086a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:44.291605 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195334c-33d7-4bc4-bcb4-636327086a69 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:44.291889 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195334c-33d7-4bc4-bcb4-636327086a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:44.292219 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195334c-33d7-4bc4-bcb4-636327086a69 admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:44.292954 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3195334c-33d7-4bc4-bcb4-636327086a69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:26:44.293268 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3195334c-33d7-4bc4-bcb4-636327086a69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:44.294918 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3195334c-33d7-4bc4-bcb4-636327086a69 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:44.306748 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1422/2818] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 10 03:26:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:26:44.311057 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad759b5-adfd-471a-a4e2-da99c43f91ee None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:44.320721 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad759b5-adfd-471a-a4e2-da99c43f91ee None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:44.325375 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4765e461-1523-4c48-a5dd-d475e122c0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:44.326020 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765e461-1523-4c48-a5dd-d475e122c0bd admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:44.326305 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765e461-1523-4c48-a5dd-d475e122c0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:44.326584 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765e461-1523-4c48-a5dd-d475e122c0bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:44.327273 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4765e461-1523-4c48-a5dd-d475e122c0bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:44.329196 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4765e461-1523-4c48-a5dd-d475e122c0bd admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:44.433393 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1397/2819] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:26:44 2022] POST /identity/v3/projects => generated 373 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:26:44.437710 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195334c-33d7-4bc4-bcb4-636327086a69 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:44.448660 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195334c-33d7-4bc4-bcb4-636327086a69 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:44.504689 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ad1c1-bb5e-4ac7-8f56-1c253929fde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:44.505662 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ad1c1-bb5e-4ac7-8f56-1c253929fde3 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:44.505945 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ad1c1-bb5e-4ac7-8f56-1c253929fde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:44.506773 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ad1c1-bb5e-4ac7-8f56-1c253929fde3 admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:44.507477 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ad1c1-bb5e-4ac7-8f56-1c253929fde3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:44.509416 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ad1c1-bb5e-4ac7-8f56-1c253929fde3 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:44.585206 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1423/2820] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:26:44 2022] POST /identity/v3/users => generated 287 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:26:44.589213 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4765e461-1523-4c48-a5dd-d475e122c0bd admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:44.599295 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4765e461-1523-4c48-a5dd-d475e122c0bd admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:44.603912 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e819918-c743-4368-a3bf-c75aae9fa5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:44.604602 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e819918-c743-4368-a3bf-c75aae9fa5d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:44.604887 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e819918-c743-4368-a3bf-c75aae9fa5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:44.605159 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e819918-c743-4368-a3bf-c75aae9fa5d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:44.605876 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e819918-c743-4368-a3bf-c75aae9fa5d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:44.607494 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e819918-c743-4368-a3bf-c75aae9fa5d7 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:44.618475 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1398/2821] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:26:44.622289 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ad1c1-bb5e-4ac7-8f56-1c253929fde3 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:44.632876 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ad1c1-bb5e-4ac7-8f56-1c253929fde3 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:44.637447 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849d7d0a-4fe8-4a81-8b44-14abfdc45554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:44.638089 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d7d0a-4fe8-4a81-8b44-14abfdc45554 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:44.638369 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d7d0a-4fe8-4a81-8b44-14abfdc45554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:44.648152 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d7d0a-4fe8-4a81-8b44-14abfdc45554 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:44.648152 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849d7d0a-4fe8-4a81-8b44-14abfdc45554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:44.648152 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849d7d0a-4fe8-4a81-8b44-14abfdc45554 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:44.650856 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1424/2822] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:26:44.654823 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e819918-c743-4368-a3bf-c75aae9fa5d7 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:44.664730 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e819918-c743-4368-a3bf-c75aae9fa5d7 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:44.669414 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc9e137-87a9-4c51-94eb-3bd6b11ca2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:44.670409 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc9e137-87a9-4c51-94eb-3bd6b11ca2ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:44.670704 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc9e137-87a9-4c51-94eb-3bd6b11ca2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:44.670976 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc9e137-87a9-4c51-94eb-3bd6b11ca2ea admin admin] PATH_INFO: `/v3/projects/e4baece40fd84f5ca3bbadf4cbb40572/users/e099ff9798964f2c90dd74159a9c3803/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:44.689001 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc9e137-87a9-4c51-94eb-3bd6b11ca2ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4baece40fd84f5ca3bbadf4cbb40572, user_id=e099ff9798964f2c90dd74159a9c3803, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:44.691808 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc9e137-87a9-4c51-94eb-3bd6b11ca2ea admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:44.733212 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849d7d0a-4fe8-4a81-8b44-14abfdc45554 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:44.734948 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-849d7d0a-4fe8-4a81-8b44-14abfdc45554 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:44.748096 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849d7d0a-4fe8-4a81-8b44-14abfdc45554 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:44.752778 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b6e385-d5d7-45d3-961d-ff321d4c5bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:44.753631 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b6e385-d5d7-45d3-961d-ff321d4c5bf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:44.753920 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b6e385-d5d7-45d3-961d-ff321d4c5bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:44.754195 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b6e385-d5d7-45d3-961d-ff321d4c5bf8 admin admin] PATH_INFO: `/v3/users/691a282df8ad402fad12be3ab9383eba` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:44.755373 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b6e385-d5d7-45d3-961d-ff321d4c5bf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=691a282df8ad402fad12be3ab9383eba)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:44.758003 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b6e385-d5d7-45d3-961d-ff321d4c5bf8 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:44.780731 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1399/2823] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:26:44 2022] PUT /identity/v3/projects/e4baece40fd84f5ca3bbadf4cbb40572/users/e099ff9798964f2c90dd74159a9c3803/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:26:44.790828 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f077d-47da-442a-aea9-4f211b8a01b6 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:44.797557 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f077d-47da-442a-aea9-4f211b8a01b6 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:44.797557 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f077d-47da-442a-aea9-4f211b8a01b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:44.817834 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-1b5f077d-47da-442a-aea9-4f211b8a01b6 None None] MFA Rules not processed for user `e099ff9798964f2c90dd74159a9c3803`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:26:44.819691 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-1b5f077d-47da-442a-aea9-4f211b8a01b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:44.881973 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1400/2824] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:26:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:26:44.893628 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f077d-47da-442a-aea9-4f211b8a01b6 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:44.895079 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-1b5f077d-47da-442a-aea9-4f211b8a01b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:44.951328 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f077d-47da-442a-aea9-4f211b8a01b6 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:44.954974 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c3be8-32d3-47de-8eb8-cd0494ece0d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:44.955627 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c3be8-32d3-47de-8eb8-cd0494ece0d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:44.956059 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c3be8-32d3-47de-8eb8-cd0494ece0d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:44.956227 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c3be8-32d3-47de-8eb8-cd0494ece0d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:44.960901 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-14b6e385-d5d7-45d3-961d-ff321d4c5bf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '691a282df8ad402fad12be3ab9383eba'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:44.964874 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c3be8-32d3-47de-8eb8-cd0494ece0d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:44.966321 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c3be8-32d3-47de-8eb8-cd0494ece0d1 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:44.967666 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-14b6e385-d5d7-45d3-961d-ff321d4c5bf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '691a282df8ad402fad12be3ab9383eba'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:44.976390 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1401/2825] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:26:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:26:44.980187 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-14b6e385-d5d7-45d3-961d-ff321d4c5bf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '691a282df8ad402fad12be3ab9383eba'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:44.987894 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-14b6e385-d5d7-45d3-961d-ff321d4c5bf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '691a282df8ad402fad12be3ab9383eba'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:44.987894 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-14b6e385-d5d7-45d3-961d-ff321d4c5bf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '691a282df8ad402fad12be3ab9383eba'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:45.056328 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1425/2826] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:26:44 2022] DELETE /identity/v3/users/691a282df8ad402fad12be3ab9383eba => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:26:45.060728 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085775b-94ac-4bdd-898e-88ead4b22820 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:45.061022 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085775b-94ac-4bdd-898e-88ead4b22820 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:45.061301 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085775b-94ac-4bdd-898e-88ead4b22820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:45.078759 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-0085775b-94ac-4bdd-898e-88ead4b22820 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:26:45.079972 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-0085775b-94ac-4bdd-898e-88ead4b22820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:45.139283 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1402/2827] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:26:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:26:45.148910 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b6e385-d5d7-45d3-961d-ff321d4c5bf8 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:45.150344 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-14b6e385-d5d7-45d3-961d-ff321d4c5bf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:45.208068 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b6e385-d5d7-45d3-961d-ff321d4c5bf8 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:45.212299 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6505ea-375b-454f-8ce5-d512ed569ebf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:45.212943 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6505ea-375b-454f-8ce5-d512ed569ebf service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:45.213229 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6505ea-375b-454f-8ce5-d512ed569ebf service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:45.213507 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6505ea-375b-454f-8ce5-d512ed569ebf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:45.222543 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6505ea-375b-454f-8ce5-d512ed569ebf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:45.223963 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6505ea-375b-454f-8ce5-d512ed569ebf service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:45.234134 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1426/2828] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:26:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:26:45.628116 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0085775b-94ac-4bdd-898e-88ead4b22820 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:45.629772 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-0085775b-94ac-4bdd-898e-88ead4b22820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:45.643739 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0085775b-94ac-4bdd-898e-88ead4b22820 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:45.661777 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568b0a01-f126-4fec-90f8-bb3dc5f0b93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:45.661777 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b0a01-f126-4fec-90f8-bb3dc5f0b93b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:45.661777 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b0a01-f126-4fec-90f8-bb3dc5f0b93b admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:45.661777 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b0a01-f126-4fec-90f8-bb3dc5f0b93b admin admin] PATH_INFO: `/v3/projects/e4b0163544d04c9ab32061d760c23931` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:45.663539 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568b0a01-f126-4fec-90f8-bb3dc5f0b93b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4b0163544d04c9ab32061d760c23931)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:45.665651 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568b0a01-f126-4fec-90f8-bb3dc5f0b93b admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:45.813166 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-568b0a01-f126-4fec-90f8-bb3dc5f0b93b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4b0163544d04c9ab32061d760c23931', 'request_id': 'req-568b0a01-f126-4fec-90f8-bb3dc5f0b93b'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:45.818364 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-568b0a01-f126-4fec-90f8-bb3dc5f0b93b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4b0163544d04c9ab32061d760c23931', 'request_id': 'req-568b0a01-f126-4fec-90f8-bb3dc5f0b93b'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:45.824903 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-568b0a01-f126-4fec-90f8-bb3dc5f0b93b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4b0163544d04c9ab32061d760c23931', 'request_id': 'req-568b0a01-f126-4fec-90f8-bb3dc5f0b93b'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:45.932993 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-568b0a01-f126-4fec-90f8-bb3dc5f0b93b admin admin] The token cache is being invalidate because project e4b0163544d04c9ab32061d760c23931 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:26:45.933279 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-568b0a01-f126-4fec-90f8-bb3dc5f0b93b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:45.933890 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-568b0a01-f126-4fec-90f8-bb3dc5f0b93b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:45.935460 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1403/2829] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:26:45 2022] DELETE /identity/v3/projects/e4b0163544d04c9ab32061d760c23931 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:26:45.939456 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6505ea-375b-454f-8ce5-d512ed569ebf service neutron] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:45.949556 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6505ea-375b-454f-8ce5-d512ed569ebf service neutron] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:46.004875 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc659a5-35ac-45a8-a48e-7e090d9e6b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:46.005668 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc659a5-35ac-45a8-a48e-7e090d9e6b0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:46.005956 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc659a5-35ac-45a8-a48e-7e090d9e6b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:46.006819 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc659a5-35ac-45a8-a48e-7e090d9e6b0b admin admin] PATH_INFO: `/v3/users/f05693f2725a47bb9dca4eada432489b` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:46.008014 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc659a5-35ac-45a8-a48e-7e090d9e6b0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f05693f2725a47bb9dca4eada432489b)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:46.009935 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc659a5-35ac-45a8-a48e-7e090d9e6b0b admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:46.217162 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-abc659a5-35ac-45a8-a48e-7e090d9e6b0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f05693f2725a47bb9dca4eada432489b'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:46.223932 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-abc659a5-35ac-45a8-a48e-7e090d9e6b0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f05693f2725a47bb9dca4eada432489b'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:46.235903 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-abc659a5-35ac-45a8-a48e-7e090d9e6b0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f05693f2725a47bb9dca4eada432489b'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:46.236727 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-abc659a5-35ac-45a8-a48e-7e090d9e6b0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f05693f2725a47bb9dca4eada432489b'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:46.237356 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-abc659a5-35ac-45a8-a48e-7e090d9e6b0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f05693f2725a47bb9dca4eada432489b'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:46.351484 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1427/2830] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:26:45 2022] DELETE /identity/v3/users/f05693f2725a47bb9dca4eada432489b => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:26:46.803158 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568b0a01-f126-4fec-90f8-bb3dc5f0b93b admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:46.805156 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-568b0a01-f126-4fec-90f8-bb3dc5f0b93b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:46.838903 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568b0a01-f126-4fec-90f8-bb3dc5f0b93b admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:46.899139 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2148e30a-8259-410e-a50c-3eb8e24d425e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:46.900032 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148e30a-8259-410e-a50c-3eb8e24d425e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:46.900325 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148e30a-8259-410e-a50c-3eb8e24d425e admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:46.900605 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148e30a-8259-410e-a50c-3eb8e24d425e admin admin] PATH_INFO: `/v3/projects/65723d6c40bd4048aaff1d184169ec39` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:46.901816 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2148e30a-8259-410e-a50c-3eb8e24d425e admin admin] RBAC: Authorizing `identity:delete_project(project_id=65723d6c40bd4048aaff1d184169ec39)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:46.903740 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2148e30a-8259-410e-a50c-3eb8e24d425e admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:47.021405 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2148e30a-8259-410e-a50c-3eb8e24d425e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65723d6c40bd4048aaff1d184169ec39', 'request_id': 'req-2148e30a-8259-410e-a50c-3eb8e24d425e'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:47.034786 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2148e30a-8259-410e-a50c-3eb8e24d425e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65723d6c40bd4048aaff1d184169ec39', 'request_id': 'req-2148e30a-8259-410e-a50c-3eb8e24d425e'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:47.034786 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2148e30a-8259-410e-a50c-3eb8e24d425e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65723d6c40bd4048aaff1d184169ec39', 'request_id': 'req-2148e30a-8259-410e-a50c-3eb8e24d425e'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:47.116083 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2148e30a-8259-410e-a50c-3eb8e24d425e admin admin] The token cache is being invalidate because project 65723d6c40bd4048aaff1d184169ec39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:26:47.116377 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2148e30a-8259-410e-a50c-3eb8e24d425e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:47.117006 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2148e30a-8259-410e-a50c-3eb8e24d425e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:47.118594 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1404/2831] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:26:46 2022] DELETE /identity/v3/projects/65723d6c40bd4048aaff1d184169ec39 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:26:47.122596 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc659a5-35ac-45a8-a48e-7e090d9e6b0b admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:47.123986 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-abc659a5-35ac-45a8-a48e-7e090d9e6b0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:47.137341 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc659a5-35ac-45a8-a48e-7e090d9e6b0b admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:47.190816 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3391286-69b0-43fc-9ccd-64b473e8683d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:47.191680 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3391286-69b0-43fc-9ccd-64b473e8683d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:47.191960 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3391286-69b0-43fc-9ccd-64b473e8683d admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:47.192268 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3391286-69b0-43fc-9ccd-64b473e8683d admin admin] PATH_INFO: `/v3/users/3d3e8e748f9d4b718b86a8e62aae3a3c` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:47.193448 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3391286-69b0-43fc-9ccd-64b473e8683d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d3e8e748f9d4b718b86a8e62aae3a3c)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:47.195908 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3391286-69b0-43fc-9ccd-64b473e8683d admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:47.400872 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-e3391286-69b0-43fc-9ccd-64b473e8683d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d3e8e748f9d4b718b86a8e62aae3a3c'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:47.416106 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-e3391286-69b0-43fc-9ccd-64b473e8683d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d3e8e748f9d4b718b86a8e62aae3a3c'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:47.422180 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-e3391286-69b0-43fc-9ccd-64b473e8683d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d3e8e748f9d4b718b86a8e62aae3a3c'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:47.422901 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-e3391286-69b0-43fc-9ccd-64b473e8683d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d3e8e748f9d4b718b86a8e62aae3a3c'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:47.423507 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-e3391286-69b0-43fc-9ccd-64b473e8683d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d3e8e748f9d4b718b86a8e62aae3a3c'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:47.524027 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1428/2832] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:26:47 2022] DELETE /identity/v3/users/3d3e8e748f9d4b718b86a8e62aae3a3c => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:26:47.908498 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2148e30a-8259-410e-a50c-3eb8e24d425e admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:47.909725 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-2148e30a-8259-410e-a50c-3eb8e24d425e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:47.924636 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2148e30a-8259-410e-a50c-3eb8e24d425e admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:47.989767 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76195e90-cdb6-4db3-baa7-921f27b994d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:47.992187 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76195e90-cdb6-4db3-baa7-921f27b994d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:47.992572 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76195e90-cdb6-4db3-baa7-921f27b994d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:47.992916 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76195e90-cdb6-4db3-baa7-921f27b994d0 admin admin] PATH_INFO: `/v3/projects/ec0a680a07714400b1eb98ee4aec7c72` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:47.994451 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76195e90-cdb6-4db3-baa7-921f27b994d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec0a680a07714400b1eb98ee4aec7c72)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:47.996621 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76195e90-cdb6-4db3-baa7-921f27b994d0 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:48.141185 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-76195e90-cdb6-4db3-baa7-921f27b994d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec0a680a07714400b1eb98ee4aec7c72', 'request_id': 'req-76195e90-cdb6-4db3-baa7-921f27b994d0'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:48.146673 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-76195e90-cdb6-4db3-baa7-921f27b994d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec0a680a07714400b1eb98ee4aec7c72', 'request_id': 'req-76195e90-cdb6-4db3-baa7-921f27b994d0'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:48.152889 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-76195e90-cdb6-4db3-baa7-921f27b994d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec0a680a07714400b1eb98ee4aec7c72', 'request_id': 'req-76195e90-cdb6-4db3-baa7-921f27b994d0'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:48.226736 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-76195e90-cdb6-4db3-baa7-921f27b994d0 admin admin] The token cache is being invalidate because project ec0a680a07714400b1eb98ee4aec7c72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:26:48.227030 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-76195e90-cdb6-4db3-baa7-921f27b994d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:48.227675 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-76195e90-cdb6-4db3-baa7-921f27b994d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:48.229571 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1405/2833] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:26:47 2022] DELETE /identity/v3/projects/ec0a680a07714400b1eb98ee4aec7c72 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:26:48.235147 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72264f5-d24a-44ef-a110-39cb2fbeb421 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:48.235445 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72264f5-d24a-44ef-a110-39cb2fbeb421 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:48.235781 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72264f5-d24a-44ef-a110-39cb2fbeb421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:48.254967 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-c72264f5-d24a-44ef-a110-39cb2fbeb421 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:26:48.256205 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-c72264f5-d24a-44ef-a110-39cb2fbeb421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:48.317680 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1429/2834] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:26:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:26:48.326481 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c664fe-582d-4a36-a322-c5f9ddeb15da None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:48.326764 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c664fe-582d-4a36-a322-c5f9ddeb15da None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:48.327039 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c664fe-582d-4a36-a322-c5f9ddeb15da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:48.345380 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-33c664fe-582d-4a36-a322-c5f9ddeb15da None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:26:48.346564 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-33c664fe-582d-4a36-a322-c5f9ddeb15da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:48.355098 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1406/2835] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:26:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:26:48.359787 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72264f5-d24a-44ef-a110-39cb2fbeb421 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:48.369700 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72264f5-d24a-44ef-a110-39cb2fbeb421 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:48.376640 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0046034d-7b5a-4232-9b7d-be46fcf2018d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:48.377454 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046034d-7b5a-4232-9b7d-be46fcf2018d admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:48.377747 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046034d-7b5a-4232-9b7d-be46fcf2018d admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:48.378026 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046034d-7b5a-4232-9b7d-be46fcf2018d admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:48.378767 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0046034d-7b5a-4232-9b7d-be46fcf2018d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:26:48.379079 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0046034d-7b5a-4232-9b7d-be46fcf2018d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:48.380967 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0046034d-7b5a-4232-9b7d-be46fcf2018d admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:48.393266 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1430/2836] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 10 03:26:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:26:48.398067 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c664fe-582d-4a36-a322-c5f9ddeb15da None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:48.407620 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c664fe-582d-4a36-a322-c5f9ddeb15da None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:48.412271 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bfe7c1-bf26-4b20-b74f-20bc230fb496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:48.412934 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bfe7c1-bf26-4b20-b74f-20bc230fb496 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:48.413925 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bfe7c1-bf26-4b20-b74f-20bc230fb496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:48.414178 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bfe7c1-bf26-4b20-b74f-20bc230fb496 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:48.414883 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bfe7c1-bf26-4b20-b74f-20bc230fb496 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:48.416849 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bfe7c1-bf26-4b20-b74f-20bc230fb496 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:48.520207 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1407/2837] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:26:48 2022] POST /identity/v3/projects => generated 367 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:26:48.524373 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0046034d-7b5a-4232-9b7d-be46fcf2018d admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:48.534410 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0046034d-7b5a-4232-9b7d-be46fcf2018d admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:48.591120 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30450e95-a825-48d3-860c-55960cdb5588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:48.591794 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30450e95-a825-48d3-860c-55960cdb5588 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:48.592110 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30450e95-a825-48d3-860c-55960cdb5588 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:48.592394 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30450e95-a825-48d3-860c-55960cdb5588 admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:48.593100 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30450e95-a825-48d3-860c-55960cdb5588 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:48.595011 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30450e95-a825-48d3-860c-55960cdb5588 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:48.678053 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1431/2838] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:26:48 2022] POST /identity/v3/users => generated 284 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 03:26:48.682741 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bfe7c1-bf26-4b20-b74f-20bc230fb496 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:48.693177 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bfe7c1-bf26-4b20-b74f-20bc230fb496 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:48.697818 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e54569-8ff1-4b31-b300-6bf02fdf3c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:48.698475 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e54569-8ff1-4b31-b300-6bf02fdf3c72 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:48.703671 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e54569-8ff1-4b31-b300-6bf02fdf3c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:48.703671 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e54569-8ff1-4b31-b300-6bf02fdf3c72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:48.703671 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e54569-8ff1-4b31-b300-6bf02fdf3c72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:48.703671 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e54569-8ff1-4b31-b300-6bf02fdf3c72 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:48.711687 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1408/2839] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:26:48.715865 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30450e95-a825-48d3-860c-55960cdb5588 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:48.726369 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30450e95-a825-48d3-860c-55960cdb5588 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:48.731155 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec26bef-40d3-4176-8f74-4fced5386362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:48.732398 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec26bef-40d3-4176-8f74-4fced5386362 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:48.732398 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec26bef-40d3-4176-8f74-4fced5386362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:48.732591 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec26bef-40d3-4176-8f74-4fced5386362 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:48.733164 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec26bef-40d3-4176-8f74-4fced5386362 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:48.734755 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec26bef-40d3-4176-8f74-4fced5386362 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:48.745547 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1432/2840] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:26:48.749411 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e54569-8ff1-4b31-b300-6bf02fdf3c72 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:48.759352 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e54569-8ff1-4b31-b300-6bf02fdf3c72 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:48.764097 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b57265-c334-4602-ab8e-38cefc36a218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:48.764976 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b57265-c334-4602-ab8e-38cefc36a218 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:48.765262 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b57265-c334-4602-ab8e-38cefc36a218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:48.765538 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b57265-c334-4602-ab8e-38cefc36a218 admin admin] PATH_INFO: `/v3/projects/139f58c79b0d44b98f738fd5e74eb191/users/68f2c44500e84039be8f386de1d10077/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:48.779677 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b57265-c334-4602-ab8e-38cefc36a218 admin admin] RBAC: Authorizing `identity:create_grant(project_id=139f58c79b0d44b98f738fd5e74eb191, user_id=68f2c44500e84039be8f386de1d10077, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:48.782367 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b57265-c334-4602-ab8e-38cefc36a218 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:48.867826 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1409/2841] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:26:48 2022] PUT /identity/v3/projects/139f58c79b0d44b98f738fd5e74eb191/users/68f2c44500e84039be8f386de1d10077/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:26:48.878099 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8abc37-ac0f-4cf7-9a02-16d37331e683 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:48.878397 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8abc37-ac0f-4cf7-9a02-16d37331e683 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:48.878673 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8abc37-ac0f-4cf7-9a02-16d37331e683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:48.904036 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-7d8abc37-ac0f-4cf7-9a02-16d37331e683 None None] MFA Rules not processed for user `68f2c44500e84039be8f386de1d10077`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:26:48.905236 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-7d8abc37-ac0f-4cf7-9a02-16d37331e683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:48.966323 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1433/2842] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:26:48 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:26:48.978084 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b57265-c334-4602-ab8e-38cefc36a218 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:48.979815 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-e0b57265-c334-4602-ab8e-38cefc36a218 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:49.035076 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b57265-c334-4602-ab8e-38cefc36a218 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:49.039507 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bbb563-4630-4c52-9774-9ed85dd0ab9f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c79f0a3a3223444c82589da07305469f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:49.040199 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bbb563-4630-4c52-9774-9ed85dd0ab9f service glance] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:49.040485 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bbb563-4630-4c52-9774-9ed85dd0ab9f service glance] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:49.040760 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bbb563-4630-4c52-9774-9ed85dd0ab9f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:49.042594 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8abc37-ac0f-4cf7-9a02-16d37331e683 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:49.043946 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-7d8abc37-ac0f-4cf7-9a02-16d37331e683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:49.049928 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bbb563-4630-4c52-9774-9ed85dd0ab9f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:49.051396 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bbb563-4630-4c52-9774-9ed85dd0ab9f service glance] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:49.060327 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1410/2843] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:26:48 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:26:49.108299 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8abc37-ac0f-4cf7-9a02-16d37331e683 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:49.113474 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3947c526-f6d4-4570-a91d-6f7d8f0f33d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:49.114294 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947c526-f6d4-4570-a91d-6f7d8f0f33d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:49.114501 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947c526-f6d4-4570-a91d-6f7d8f0f33d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:49.114777 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947c526-f6d4-4570-a91d-6f7d8f0f33d7 admin admin] PATH_INFO: `/v3/users/e099ff9798964f2c90dd74159a9c3803` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:49.115994 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3947c526-f6d4-4570-a91d-6f7d8f0f33d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e099ff9798964f2c90dd74159a9c3803)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:49.117929 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3947c526-f6d4-4570-a91d-6f7d8f0f33d7 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:49.312954 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-3947c526-f6d4-4570-a91d-6f7d8f0f33d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e099ff9798964f2c90dd74159a9c3803'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:49.320466 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-3947c526-f6d4-4570-a91d-6f7d8f0f33d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e099ff9798964f2c90dd74159a9c3803'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:49.331914 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-3947c526-f6d4-4570-a91d-6f7d8f0f33d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e099ff9798964f2c90dd74159a9c3803'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:49.332631 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-3947c526-f6d4-4570-a91d-6f7d8f0f33d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e099ff9798964f2c90dd74159a9c3803'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:49.333251 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-3947c526-f6d4-4570-a91d-6f7d8f0f33d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e099ff9798964f2c90dd74159a9c3803'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:49.436497 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1434/2844] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:26:49 2022] DELETE /identity/v3/users/e099ff9798964f2c90dd74159a9c3803 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 03:26:49.441016 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d7f8eb-7391-4e30-8567-04e05949c09d None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:49.441317 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d7f8eb-7391-4e30-8567-04e05949c09d None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:49.441598 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d7f8eb-7391-4e30-8567-04e05949c09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:49.459181 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-81d7f8eb-7391-4e30-8567-04e05949c09d None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:26:49.460978 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-81d7f8eb-7391-4e30-8567-04e05949c09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:49.521105 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1411/2845] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:26:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:26:49.531343 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3947c526-f6d4-4570-a91d-6f7d8f0f33d7 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:49.532902 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-3947c526-f6d4-4570-a91d-6f7d8f0f33d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:49.591669 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3947c526-f6d4-4570-a91d-6f7d8f0f33d7 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:49.595655 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2cc703-f7fe-4df5-903a-53f2b23a2ab3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:49.596453 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2cc703-f7fe-4df5-903a-53f2b23a2ab3 service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:49.596840 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2cc703-f7fe-4df5-903a-53f2b23a2ab3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:49.597212 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2cc703-f7fe-4df5-903a-53f2b23a2ab3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:49.608234 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2cc703-f7fe-4df5-903a-53f2b23a2ab3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:49.609797 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2cc703-f7fe-4df5-903a-53f2b23a2ab3 service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:49.620370 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1435/2846] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:26:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:26:50.084312 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d7f8eb-7391-4e30-8567-04e05949c09d None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:50.086792 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-81d7f8eb-7391-4e30-8567-04e05949c09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:50.097649 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d7f8eb-7391-4e30-8567-04e05949c09d None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:50.102997 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813c9c5-753f-4f26-af32-61fd6678eed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:50.103859 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813c9c5-753f-4f26-af32-61fd6678eed0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:50.104285 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813c9c5-753f-4f26-af32-61fd6678eed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:50.104559 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813c9c5-753f-4f26-af32-61fd6678eed0 admin admin] PATH_INFO: `/v3/projects/e4baece40fd84f5ca3bbadf4cbb40572` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:50.105751 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0813c9c5-753f-4f26-af32-61fd6678eed0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4baece40fd84f5ca3bbadf4cbb40572)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:50.107658 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0813c9c5-753f-4f26-af32-61fd6678eed0 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:50.227116 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-0813c9c5-753f-4f26-af32-61fd6678eed0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4baece40fd84f5ca3bbadf4cbb40572', 'request_id': 'req-0813c9c5-753f-4f26-af32-61fd6678eed0'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:50.232731 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-0813c9c5-753f-4f26-af32-61fd6678eed0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4baece40fd84f5ca3bbadf4cbb40572', 'request_id': 'req-0813c9c5-753f-4f26-af32-61fd6678eed0'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:50.239329 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-0813c9c5-753f-4f26-af32-61fd6678eed0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4baece40fd84f5ca3bbadf4cbb40572', 'request_id': 'req-0813c9c5-753f-4f26-af32-61fd6678eed0'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:50.324674 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-0813c9c5-753f-4f26-af32-61fd6678eed0 admin admin] The token cache is being invalidate because project e4baece40fd84f5ca3bbadf4cbb40572 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:26:50.325065 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-0813c9c5-753f-4f26-af32-61fd6678eed0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:50.325902 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-0813c9c5-753f-4f26-af32-61fd6678eed0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:26:50.331126 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1412/2847] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:26:50 2022] DELETE /identity/v3/projects/e4baece40fd84f5ca3bbadf4cbb40572 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:26:50.333246 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbc99b-d8ac-4793-8ea6-4e2c30f519bb None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:50.333581 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbc99b-d8ac-4793-8ea6-4e2c30f519bb None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:50.333958 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbc99b-d8ac-4793-8ea6-4e2c30f519bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:50.355123 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-0bdbc99b-d8ac-4793-8ea6-4e2c30f519bb None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:26:50.356381 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-0bdbc99b-d8ac-4793-8ea6-4e2c30f519bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:50.417304 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1436/2848] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:26:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:26:50.425539 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa76471-3f93-4325-80c7-99ff68a9bbeb None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:50.425835 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa76471-3f93-4325-80c7-99ff68a9bbeb None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:50.426119 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa76471-3f93-4325-80c7-99ff68a9bbeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:50.445781 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-dfa76471-3f93-4325-80c7-99ff68a9bbeb None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:26:50.447038 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-dfa76471-3f93-4325-80c7-99ff68a9bbeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:50.455378 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1413/2849] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:26:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:26:50.459439 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdbc99b-d8ac-4793-8ea6-4e2c30f519bb None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:50.470307 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdbc99b-d8ac-4793-8ea6-4e2c30f519bb None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:50.474964 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad780df1-205b-4bf4-94bc-0e6913050549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:50.476398 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad780df1-205b-4bf4-94bc-0e6913050549 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:50.476707 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad780df1-205b-4bf4-94bc-0e6913050549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:50.477256 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad780df1-205b-4bf4-94bc-0e6913050549 admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:50.477995 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad780df1-205b-4bf4-94bc-0e6913050549 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:26:50.478307 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad780df1-205b-4bf4-94bc-0e6913050549 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:50.479901 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad780df1-205b-4bf4-94bc-0e6913050549 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:50.491656 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1437/2850] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 10 03:26:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:26:50.495988 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa76471-3f93-4325-80c7-99ff68a9bbeb None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:50.507575 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa76471-3f93-4325-80c7-99ff68a9bbeb None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:50.512560 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6634e9b-31df-476b-94ab-6e61c2833147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:50.513245 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6634e9b-31df-476b-94ab-6e61c2833147 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:50.513512 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6634e9b-31df-476b-94ab-6e61c2833147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:50.513791 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6634e9b-31df-476b-94ab-6e61c2833147 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:50.514501 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6634e9b-31df-476b-94ab-6e61c2833147 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:50.516443 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6634e9b-31df-476b-94ab-6e61c2833147 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:50.640418 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1414/2851] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:26:50 2022] POST /identity/v3/projects => generated 371 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:26:50.651290 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad780df1-205b-4bf4-94bc-0e6913050549 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:50.661064 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad780df1-205b-4bf4-94bc-0e6913050549 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:50.721194 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8539dd-52cd-41c5-8673-c1f543c2d783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:50.721895 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8539dd-52cd-41c5-8673-c1f543c2d783 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:50.722180 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8539dd-52cd-41c5-8673-c1f543c2d783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:50.722454 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8539dd-52cd-41c5-8673-c1f543c2d783 admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:50.723172 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8539dd-52cd-41c5-8673-c1f543c2d783 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:50.725137 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8539dd-52cd-41c5-8673-c1f543c2d783 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:50.862285 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1438/2852] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:26:50 2022] POST /identity/v3/users => generated 286 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:26:50.866202 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6634e9b-31df-476b-94ab-6e61c2833147 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:50.876087 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6634e9b-31df-476b-94ab-6e61c2833147 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:50.880945 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a806d3b5-e8b7-47ea-8055-0de424ec82b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:50.881617 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a806d3b5-e8b7-47ea-8055-0de424ec82b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:50.882409 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a806d3b5-e8b7-47ea-8055-0de424ec82b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:50.882686 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a806d3b5-e8b7-47ea-8055-0de424ec82b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:50.883419 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a806d3b5-e8b7-47ea-8055-0de424ec82b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:50.885048 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a806d3b5-e8b7-47ea-8055-0de424ec82b6 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:50.899108 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1415/2853] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:26:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 03:26:50.900414 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8539dd-52cd-41c5-8673-c1f543c2d783 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:50.910926 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8539dd-52cd-41c5-8673-c1f543c2d783 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:50.915614 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495aaf03-16ca-4868-a9ab-5c9c53161512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:50.916312 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495aaf03-16ca-4868-a9ab-5c9c53161512 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:50.916619 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495aaf03-16ca-4868-a9ab-5c9c53161512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:50.916893 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495aaf03-16ca-4868-a9ab-5c9c53161512 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:50.917676 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495aaf03-16ca-4868-a9ab-5c9c53161512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:50.919256 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495aaf03-16ca-4868-a9ab-5c9c53161512 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:50.930692 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1439/2854] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:26:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:26:50.934695 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a806d3b5-e8b7-47ea-8055-0de424ec82b6 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:50.945272 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a806d3b5-e8b7-47ea-8055-0de424ec82b6 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:50.949821 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0d4136-6725-4584-b08c-848ac2ccf282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:50.950699 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d4136-6725-4584-b08c-848ac2ccf282 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:50.950986 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d4136-6725-4584-b08c-848ac2ccf282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:50.951271 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d4136-6725-4584-b08c-848ac2ccf282 admin admin] PATH_INFO: `/v3/projects/999c5e799e2148c8b9385edb3f634e1d/users/919ba2451a4c4a1d82428794abd1214e/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:50.965809 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0d4136-6725-4584-b08c-848ac2ccf282 admin admin] RBAC: Authorizing `identity:create_grant(project_id=999c5e799e2148c8b9385edb3f634e1d, user_id=919ba2451a4c4a1d82428794abd1214e, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:50.968487 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0d4136-6725-4584-b08c-848ac2ccf282 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:51.061582 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1416/2855] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:26:50 2022] PUT /identity/v3/projects/999c5e799e2148c8b9385edb3f634e1d/users/919ba2451a4c4a1d82428794abd1214e/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:26:51.066763 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f3062-a43b-4ecb-acf3-f331409510ce None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:51.067081 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f3062-a43b-4ecb-acf3-f331409510ce None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:51.067348 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f3062-a43b-4ecb-acf3-f331409510ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:51.087768 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-2b1f3062-a43b-4ecb-acf3-f331409510ce None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:26:51.089034 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-2b1f3062-a43b-4ecb-acf3-f331409510ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:51.147472 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1440/2856] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:26:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:26:51.157554 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0d4136-6725-4584-b08c-848ac2ccf282 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:51.159272 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-3b0d4136-6725-4584-b08c-848ac2ccf282 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:51.215783 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0d4136-6725-4584-b08c-848ac2ccf282 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:51.219590 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395944ff-2413-4e04-b874-5e694edf0a6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:51.220294 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395944ff-2413-4e04-b874-5e694edf0a6e service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:51.220580 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395944ff-2413-4e04-b874-5e694edf0a6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:51.220859 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395944ff-2413-4e04-b874-5e694edf0a6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:51.230977 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395944ff-2413-4e04-b874-5e694edf0a6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:51.232651 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395944ff-2413-4e04-b874-5e694edf0a6e service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:51.241869 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1417/2857] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:26:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:26:52.457436 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be5fb1-c726-4fda-8564-7f4c86a7b18c None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:52.457984 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be5fb1-c726-4fda-8564-7f4c86a7b18c None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:52.458192 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be5fb1-c726-4fda-8564-7f4c86a7b18c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:52.487864 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-28be5fb1-c726-4fda-8564-7f4c86a7b18c None None] MFA Rules not processed for user `919ba2451a4c4a1d82428794abd1214e`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:26:52.489234 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-28be5fb1-c726-4fda-8564-7f4c86a7b18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:52.557817 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1441/2858] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:26:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:26:52.568848 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395944ff-2413-4e04-b874-5e694edf0a6e service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:26:52.570236 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-395944ff-2413-4e04-b874-5e694edf0a6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:52.627210 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395944ff-2413-4e04-b874-5e694edf0a6e service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:26:52.630904 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2811fb1-6aff-4889-92e5-6ba69d4c5dca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:26:52.631560 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2811fb1-6aff-4889-92e5-6ba69d4c5dca service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:52.631847 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2811fb1-6aff-4889-92e5-6ba69d4c5dca service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:52.632160 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2811fb1-6aff-4889-92e5-6ba69d4c5dca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:52.640783 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2811fb1-6aff-4889-92e5-6ba69d4c5dca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:26:52.642247 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2811fb1-6aff-4889-92e5-6ba69d4c5dca service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:26:52.651019 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1418/2859] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:26:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:26:54.317658 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26276908-5d3f-419e-9de5-970b14d59c7a None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:54.318187 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26276908-5d3f-419e-9de5-970b14d59c7a None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:54.318187 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26276908-5d3f-419e-9de5-970b14d59c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:54.336781 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-26276908-5d3f-419e-9de5-970b14d59c7a None None] MFA Rules not processed for user `919ba2451a4c4a1d82428794abd1214e`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:26:54.337994 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-26276908-5d3f-419e-9de5-970b14d59c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:54.345028 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1442/2860] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:26:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:26:59.654581 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5b9ed-9f9d-437c-93f2-20b5008986da None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:26:59.655106 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5b9ed-9f9d-437c-93f2-20b5008986da None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:26:59.655210 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5b9ed-9f9d-437c-93f2-20b5008986da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:26:59.672306 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-dcd5b9ed-9f9d-437c-93f2-20b5008986da None None] MFA Rules not processed for user `f43ec3800caa42ed9a4fcf3405ef3d5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:26:59.673596 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-dcd5b9ed-9f9d-437c-93f2-20b5008986da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:26:59.736677 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1419/2861] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:26:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:27:12.907378 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938070b9-4189-4c0f-abf2-3dbcd67ab2d3 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:27:12.907941 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938070b9-4189-4c0f-abf2-3dbcd67ab2d3 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:27:12.907941 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938070b9-4189-4c0f-abf2-3dbcd67ab2d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:27:12.925325 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-938070b9-4189-4c0f-abf2-3dbcd67ab2d3 None None] MFA Rules not processed for user `919ba2451a4c4a1d82428794abd1214e`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:27:12.926515 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-938070b9-4189-4c0f-abf2-3dbcd67ab2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:27:12.933865 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1443/2862] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:27:12 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:27:13.609928 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd5b9ed-9f9d-437c-93f2-20b5008986da None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:27:13.612063 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-dcd5b9ed-9f9d-437c-93f2-20b5008986da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:27:13.625436 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd5b9ed-9f9d-437c-93f2-20b5008986da None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:27:13.630251 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1630b2-0350-44a8-9caf-9b29fe7a9962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:27:13.631187 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1630b2-0350-44a8-9caf-9b29fe7a9962 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:27:13.631456 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1630b2-0350-44a8-9caf-9b29fe7a9962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:27:13.631786 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1630b2-0350-44a8-9caf-9b29fe7a9962 admin admin] PATH_INFO: `/v3/users/68f2c44500e84039be8f386de1d10077` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:27:13.633001 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1630b2-0350-44a8-9caf-9b29fe7a9962 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68f2c44500e84039be8f386de1d10077)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:27:13.634852 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1630b2-0350-44a8-9caf-9b29fe7a9962 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:27:13.809791 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-ad1630b2-0350-44a8-9caf-9b29fe7a9962 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68f2c44500e84039be8f386de1d10077'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:27:13.810481 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-ad1630b2-0350-44a8-9caf-9b29fe7a9962 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68f2c44500e84039be8f386de1d10077'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:27:13.817160 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-ad1630b2-0350-44a8-9caf-9b29fe7a9962 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68f2c44500e84039be8f386de1d10077'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:27:13.876343 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-ad1630b2-0350-44a8-9caf-9b29fe7a9962 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68f2c44500e84039be8f386de1d10077'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:27:13.877018 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-ad1630b2-0350-44a8-9caf-9b29fe7a9962 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68f2c44500e84039be8f386de1d10077'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:27:13.895392 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1420/2863] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:27:13 2022] DELETE /identity/v3/users/68f2c44500e84039be8f386de1d10077 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:27:13.899897 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5abb85-f2dd-45aa-b0e9-ec9dd873bd14 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:27:13.900219 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5abb85-f2dd-45aa-b0e9-ec9dd873bd14 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:27:13.900500 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5abb85-f2dd-45aa-b0e9-ec9dd873bd14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:27:13.919212 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-1a5abb85-f2dd-45aa-b0e9-ec9dd873bd14 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:27:13.920468 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-1a5abb85-f2dd-45aa-b0e9-ec9dd873bd14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:27:13.979328 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1444/2864] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:27:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:27:13.989513 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1630b2-0350-44a8-9caf-9b29fe7a9962 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:27:13.990916 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-ad1630b2-0350-44a8-9caf-9b29fe7a9962 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:27:14.050753 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1630b2-0350-44a8-9caf-9b29fe7a9962 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:27:14.055156 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fca559-c6e2-435a-a0f9-e5bedd3c8bcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:27:14.055783 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fca559-c6e2-435a-a0f9-e5bedd3c8bcd service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:27:14.056112 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fca559-c6e2-435a-a0f9-e5bedd3c8bcd service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:27:14.056383 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fca559-c6e2-435a-a0f9-e5bedd3c8bcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:27:14.072595 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fca559-c6e2-435a-a0f9-e5bedd3c8bcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:27:14.072595 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fca559-c6e2-435a-a0f9-e5bedd3c8bcd service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:27:14.079072 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1421/2865] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:27:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:27:14.466880 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5abb85-f2dd-45aa-b0e9-ec9dd873bd14 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:27:14.468461 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-1a5abb85-f2dd-45aa-b0e9-ec9dd873bd14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:27:14.480895 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5abb85-f2dd-45aa-b0e9-ec9dd873bd14 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:27:14.486499 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd397f31-de26-44c1-b734-df2b75aba405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:27:14.487366 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd397f31-de26-44c1-b734-df2b75aba405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:27:14.487871 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd397f31-de26-44c1-b734-df2b75aba405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:27:14.488396 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd397f31-de26-44c1-b734-df2b75aba405 admin admin] PATH_INFO: `/v3/projects/139f58c79b0d44b98f738fd5e74eb191` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:27:14.490108 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd397f31-de26-44c1-b734-df2b75aba405 admin admin] RBAC: Authorizing `identity:delete_project(project_id=139f58c79b0d44b98f738fd5e74eb191)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:27:14.492880 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd397f31-de26-44c1-b734-df2b75aba405 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:27:14.650481 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-fd397f31-de26-44c1-b734-df2b75aba405 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '139f58c79b0d44b98f738fd5e74eb191', 'request_id': 'req-fd397f31-de26-44c1-b734-df2b75aba405'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:27:14.656136 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-fd397f31-de26-44c1-b734-df2b75aba405 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '139f58c79b0d44b98f738fd5e74eb191', 'request_id': 'req-fd397f31-de26-44c1-b734-df2b75aba405'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:27:14.662718 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-fd397f31-de26-44c1-b734-df2b75aba405 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '139f58c79b0d44b98f738fd5e74eb191', 'request_id': 'req-fd397f31-de26-44c1-b734-df2b75aba405'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:27:14.757920 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-fd397f31-de26-44c1-b734-df2b75aba405 admin admin] The token cache is being invalidate because project 139f58c79b0d44b98f738fd5e74eb191 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:27:14.758131 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-fd397f31-de26-44c1-b734-df2b75aba405 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:27:14.758782 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-fd397f31-de26-44c1-b734-df2b75aba405 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:27:14.760386 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1445/2866] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:27:14 2022] DELETE /identity/v3/projects/139f58c79b0d44b98f738fd5e74eb191 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:27:14.801833 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fca559-c6e2-435a-a0f9-e5bedd3c8bcd service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:27:14.803479 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-74fca559-c6e2-435a-a0f9-e5bedd3c8bcd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:27:14.877475 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fca559-c6e2-435a-a0f9-e5bedd3c8bcd service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:27:14.940813 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625f131-96b5-46e5-a4bf-09c55f56754b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f646147bdad8476ba0ab9da5d9c50b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:27:14.941498 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625f131-96b5-46e5-a4bf-09c55f56754b service placement] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:27:14.941787 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625f131-96b5-46e5-a4bf-09c55f56754b service placement] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:27:14.942065 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625f131-96b5-46e5-a4bf-09c55f56754b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:27:14.944114 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-7625f131-96b5-46e5-a4bf-09c55f56754b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:27:14.956719 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7625f131-96b5-46e5-a4bf-09c55f56754b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:27:14.958353 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7625f131-96b5-46e5-a4bf-09c55f56754b service placement] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:27:14.969330 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1422/2867] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:27:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:27:15.882030 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2c38a-d269-4d21-942c-9547689e06e2 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:27:15.882612 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2c38a-d269-4d21-942c-9547689e06e2 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:27:15.882733 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2c38a-d269-4d21-942c-9547689e06e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:27:15.901922 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-66d2c38a-d269-4d21-942c-9547689e06e2 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:27:15.903137 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-66d2c38a-d269-4d21-942c-9547689e06e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:27:15.964236 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1446/2868] 10.222.0.61 () {58 vars in 1016 bytes} [Tue May 10 03:27:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:27:16.008237 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625f131-96b5-46e5-a4bf-09c55f56754b service placement] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:27:16.010029 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-7625f131-96b5-46e5-a4bf-09c55f56754b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:27:16.084903 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625f131-96b5-46e5-a4bf-09c55f56754b service placement] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:27:16.090531 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be55f87e-97b2-4fc9-b4ed-0a4440064c3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b7ccdccba0b4f9e86817946f22dbe28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:27:16.094977 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55f87e-97b2-4fc9-b4ed-0a4440064c3a service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:27:16.094977 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55f87e-97b2-4fc9-b4ed-0a4440064c3a service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:27:16.094977 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55f87e-97b2-4fc9-b4ed-0a4440064c3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:27:16.100414 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be55f87e-97b2-4fc9-b4ed-0a4440064c3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:27:16.102211 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be55f87e-97b2-4fc9-b4ed-0a4440064c3a service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:27:16.117520 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1423/2869] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:27:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 03:27:19.254768 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b6707-7647-4787-9300-2b482d131d25 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:27:19.255323 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b6707-7647-4787-9300-2b482d131d25 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:27:19.255323 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b6707-7647-4787-9300-2b482d131d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:27:19.274117 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-db2b6707-7647-4787-9300-2b482d131d25 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:27:19.275352 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-db2b6707-7647-4787-9300-2b482d131d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:27:19.283893 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1447/2870] 10.222.0.61 () {58 vars in 1016 bytes} [Tue May 10 03:27:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:27:19.297493 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be55f87e-97b2-4fc9-b4ed-0a4440064c3a service nova] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:27:19.298940 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-be55f87e-97b2-4fc9-b4ed-0a4440064c3a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:27:19.314414 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be55f87e-97b2-4fc9-b4ed-0a4440064c3a service nova] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:27:19.319886 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313e25d2-5048-44b4-afc7-4193770ecc91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b7ccdccba0b4f9e86817946f22dbe28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:27:19.320551 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e25d2-5048-44b4-afc7-4193770ecc91 service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:27:19.320836 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e25d2-5048-44b4-afc7-4193770ecc91 service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:27:19.321112 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e25d2-5048-44b4-afc7-4193770ecc91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:27:19.329180 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313e25d2-5048-44b4-afc7-4193770ecc91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:27:19.330733 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313e25d2-5048-44b4-afc7-4193770ecc91 service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:27:19.340042 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1424/2871] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:27:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:27:22.147452 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52155538-6f66-4056-bcac-381670f48be1 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:27:22.147953 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52155538-6f66-4056-bcac-381670f48be1 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:27:22.148087 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52155538-6f66-4056-bcac-381670f48be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:27:22.165770 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-52155538-6f66-4056-bcac-381670f48be1 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:27:22.166945 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-52155538-6f66-4056-bcac-381670f48be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:27:22.175461 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1448/2872] 10.222.0.61 () {58 vars in 1016 bytes} [Tue May 10 03:27:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:27:22.226385 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313e25d2-5048-44b4-afc7-4193770ecc91 service nova] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:27:22.237328 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313e25d2-5048-44b4-afc7-4193770ecc91 service nova] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:27:22.242766 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5209db21-3b5b-4b63-9b2a-f24b46369e54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b7ccdccba0b4f9e86817946f22dbe28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:27:22.243395 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209db21-3b5b-4b63-9b2a-f24b46369e54 service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:27:22.243674 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209db21-3b5b-4b63-9b2a-f24b46369e54 service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:27:22.243949 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209db21-3b5b-4b63-9b2a-f24b46369e54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:27:22.251810 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5209db21-3b5b-4b63-9b2a-f24b46369e54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:27:22.253408 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5209db21-3b5b-4b63-9b2a-f24b46369e54 service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:27:22.263016 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1425/2873] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:27:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:27:25.384134 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d653cf-4999-448a-9cd7-6c006b72c0d8 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:27:25.385009 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d653cf-4999-448a-9cd7-6c006b72c0d8 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:27:25.385526 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d653cf-4999-448a-9cd7-6c006b72c0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:27:25.403600 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-e3d653cf-4999-448a-9cd7-6c006b72c0d8 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:27:25.404926 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-e3d653cf-4999-448a-9cd7-6c006b72c0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:27:25.412852 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1449/2874] 10.222.0.61 () {58 vars in 1016 bytes} [Tue May 10 03:27:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:27:25.426829 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5209db21-3b5b-4b63-9b2a-f24b46369e54 service nova] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:27:25.438674 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5209db21-3b5b-4b63-9b2a-f24b46369e54 service nova] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:27:25.444282 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2ea85f-2388-4017-af9f-6cb09c596057 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b7ccdccba0b4f9e86817946f22dbe28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:27:25.444915 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ea85f-2388-4017-af9f-6cb09c596057 service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:27:25.445197 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ea85f-2388-4017-af9f-6cb09c596057 service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:27:25.445473 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ea85f-2388-4017-af9f-6cb09c596057 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:27:25.454046 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2ea85f-2388-4017-af9f-6cb09c596057 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:27:25.455632 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2ea85f-2388-4017-af9f-6cb09c596057 service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:27:25.465175 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1426/2875] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:27:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:27:28.614003 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f63384c-5ee3-429f-930e-def79972eb28 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:27:28.614514 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f63384c-5ee3-429f-930e-def79972eb28 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:27:28.614609 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f63384c-5ee3-429f-930e-def79972eb28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:27:28.633630 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-1f63384c-5ee3-429f-930e-def79972eb28 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:27:28.634829 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-1f63384c-5ee3-429f-930e-def79972eb28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:27:28.643534 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1450/2876] 10.222.0.61 () {58 vars in 1016 bytes} [Tue May 10 03:27:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:27:28.658393 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2ea85f-2388-4017-af9f-6cb09c596057 service nova] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:27:28.669607 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2ea85f-2388-4017-af9f-6cb09c596057 service nova] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:27:28.675500 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d30f47-1652-4cc4-af56-aa3687df8794 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b7ccdccba0b4f9e86817946f22dbe28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:27:28.676205 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d30f47-1652-4cc4-af56-aa3687df8794 service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:27:28.676491 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d30f47-1652-4cc4-af56-aa3687df8794 service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:27:28.676769 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d30f47-1652-4cc4-af56-aa3687df8794 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:27:28.687100 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d30f47-1652-4cc4-af56-aa3687df8794 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:27:28.689009 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d30f47-1652-4cc4-af56-aa3687df8794 service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:27:28.700455 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1427/2877] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:27:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:27:32.986353 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126bd82b-e3d6-45ab-9d86-6ac7ba5b264a None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:27:32.986803 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126bd82b-e3d6-45ab-9d86-6ac7ba5b264a None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:27:32.986901 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126bd82b-e3d6-45ab-9d86-6ac7ba5b264a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:27:33.005002 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-126bd82b-e3d6-45ab-9d86-6ac7ba5b264a None None] MFA Rules not processed for user `6ebfab3ff0b24f4aaabb8c6bb0ad10c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:27:33.006197 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-126bd82b-e3d6-45ab-9d86-6ac7ba5b264a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:27:33.068894 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1451/2878] 10.222.0.65 () {58 vars in 1009 bytes} [Tue May 10 03:27:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:27:33.212723 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d30f47-1652-4cc4-af56-aa3687df8794 service nova] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:27:33.214111 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-52d30f47-1652-4cc4-af56-aa3687df8794 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:27:33.281541 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d30f47-1652-4cc4-af56-aa3687df8794 service nova] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:27:33.286553 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f80878-e266-4053-929f-736fbebcbd1b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1cb8ad43a234233ad602f451f0f8ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:27:33.287203 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f80878-e266-4053-929f-736fbebcbd1b service swift] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:27:33.287488 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f80878-e266-4053-929f-736fbebcbd1b service swift] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:27:33.287764 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f80878-e266-4053-929f-736fbebcbd1b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:27:33.298282 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f80878-e266-4053-929f-736fbebcbd1b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:27:33.302342 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f80878-e266-4053-929f-736fbebcbd1b service swift] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:27:33.308986 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1428/2879] 10.222.0.65 () {60 vars in 1384 bytes} [Tue May 10 03:27:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 03:27:49.684532 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf38d16-ba0b-4fad-a50e-b1ef01425c99 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:27:49.685006 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf38d16-ba0b-4fad-a50e-b1ef01425c99 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:27:49.685107 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf38d16-ba0b-4fad-a50e-b1ef01425c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:27:49.703356 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-7bf38d16-ba0b-4fad-a50e-b1ef01425c99 None None] MFA Rules not processed for user `6ebfab3ff0b24f4aaabb8c6bb0ad10c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:27:49.704577 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-7bf38d16-ba0b-4fad-a50e-b1ef01425c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:27:49.712042 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1452/2880] 10.222.0.65 () {58 vars in 967 bytes} [Tue May 10 03:27:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:27:49.723808 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f80878-e266-4053-929f-736fbebcbd1b service swift] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:27:49.734298 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f80878-e266-4053-929f-736fbebcbd1b service swift] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:27:49.741065 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b764a-cbe7-4589-aaf0-b165ab67f0f2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1cb8ad43a234233ad602f451f0f8ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:27:49.741731 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b764a-cbe7-4589-aaf0-b165ab67f0f2 service swift] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:27:49.742043 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b764a-cbe7-4589-aaf0-b165ab67f0f2 service swift] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:27:49.742322 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b764a-cbe7-4589-aaf0-b165ab67f0f2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:27:49.751541 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727b764a-cbe7-4589-aaf0-b165ab67f0f2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:27:49.753181 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727b764a-cbe7-4589-aaf0-b165ab67f0f2 service swift] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:27:49.761171 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1429/2881] 10.222.0.65 () {60 vars in 1384 bytes} [Tue May 10 03:27:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 03:27:52.684421 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf38d16-ba0b-4fad-a50e-b1ef01425c99 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:27:52.685908 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-7bf38d16-ba0b-4fad-a50e-b1ef01425c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:27:52.700821 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf38d16-ba0b-4fad-a50e-b1ef01425c99 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:27:52.706255 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946cedda-67cf-4105-884f-541b91fa7660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:27:52.707122 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946cedda-67cf-4105-884f-541b91fa7660 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:27:52.707410 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946cedda-67cf-4105-884f-541b91fa7660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:27:52.707689 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946cedda-67cf-4105-884f-541b91fa7660 admin admin] PATH_INFO: `/v3/users/919ba2451a4c4a1d82428794abd1214e` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:27:52.708930 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946cedda-67cf-4105-884f-541b91fa7660 admin admin] RBAC: Authorizing `identity:delete_user(user_id=919ba2451a4c4a1d82428794abd1214e)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:27:52.710832 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946cedda-67cf-4105-884f-541b91fa7660 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:27:52.932183 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-946cedda-67cf-4105-884f-541b91fa7660 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '919ba2451a4c4a1d82428794abd1214e'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:27:52.939678 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-946cedda-67cf-4105-884f-541b91fa7660 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '919ba2451a4c4a1d82428794abd1214e'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:27:52.950965 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-946cedda-67cf-4105-884f-541b91fa7660 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '919ba2451a4c4a1d82428794abd1214e'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:27:52.951657 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-946cedda-67cf-4105-884f-541b91fa7660 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '919ba2451a4c4a1d82428794abd1214e'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:27:52.952296 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-946cedda-67cf-4105-884f-541b91fa7660 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '919ba2451a4c4a1d82428794abd1214e'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:27:53.026885 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1453/2882] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:27:52 2022] DELETE /identity/v3/users/919ba2451a4c4a1d82428794abd1214e => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:27:53.282072 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b764a-cbe7-4589-aaf0-b165ab67f0f2 service swift] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:27:53.291282 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b764a-cbe7-4589-aaf0-b165ab67f0f2 service swift] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:27:53.350251 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103cdb93-0a32-4ca0-b820-1523b6844434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:27:53.351148 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103cdb93-0a32-4ca0-b820-1523b6844434 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:27:53.351435 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103cdb93-0a32-4ca0-b820-1523b6844434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:27:53.351712 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103cdb93-0a32-4ca0-b820-1523b6844434 admin admin] PATH_INFO: `/v3/projects/999c5e799e2148c8b9385edb3f634e1d` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:27:53.352942 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103cdb93-0a32-4ca0-b820-1523b6844434 admin admin] RBAC: Authorizing `identity:delete_project(project_id=999c5e799e2148c8b9385edb3f634e1d)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:27:53.354872 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103cdb93-0a32-4ca0-b820-1523b6844434 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:27:53.467294 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-103cdb93-0a32-4ca0-b820-1523b6844434 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '999c5e799e2148c8b9385edb3f634e1d', 'request_id': 'req-103cdb93-0a32-4ca0-b820-1523b6844434'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:27:53.473151 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-103cdb93-0a32-4ca0-b820-1523b6844434 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '999c5e799e2148c8b9385edb3f634e1d', 'request_id': 'req-103cdb93-0a32-4ca0-b820-1523b6844434'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:27:53.479257 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-103cdb93-0a32-4ca0-b820-1523b6844434 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '999c5e799e2148c8b9385edb3f634e1d', 'request_id': 'req-103cdb93-0a32-4ca0-b820-1523b6844434'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:27:53.584218 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-103cdb93-0a32-4ca0-b820-1523b6844434 admin admin] The token cache is being invalidate because project 999c5e799e2148c8b9385edb3f634e1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:27:53.584431 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-103cdb93-0a32-4ca0-b820-1523b6844434 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:27:53.585051 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-103cdb93-0a32-4ca0-b820-1523b6844434 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:27:53.586587 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1430/2883] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:27:53 2022] DELETE /identity/v3/projects/999c5e799e2148c8b9385edb3f634e1d => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:27:53.591488 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e075d-3e1b-420a-9e42-ccdbf7080487 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:27:53.591782 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e075d-3e1b-420a-9e42-ccdbf7080487 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:27:53.592098 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e075d-3e1b-420a-9e42-ccdbf7080487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:27:53.610648 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-bc1e075d-3e1b-420a-9e42-ccdbf7080487 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:27:53.611856 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-bc1e075d-3e1b-420a-9e42-ccdbf7080487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:27:53.667742 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1454/2884] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:27:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:27:53.675550 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f2b5e5-a7f2-42dc-aeb9-3c093e9a9014 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:27:53.676134 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f2b5e5-a7f2-42dc-aeb9-3c093e9a9014 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:27:53.676422 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f2b5e5-a7f2-42dc-aeb9-3c093e9a9014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:27:53.694251 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-c1f2b5e5-a7f2-42dc-aeb9-3c093e9a9014 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:27:53.695442 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-c1f2b5e5-a7f2-42dc-aeb9-3c093e9a9014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:27:53.703915 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1431/2885] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:27:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:27:53.707962 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1e075d-3e1b-420a-9e42-ccdbf7080487 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:27:53.717631 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1e075d-3e1b-420a-9e42-ccdbf7080487 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:27:53.722807 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43316a-9758-49c7-b87c-c474d91b4845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:27:53.723457 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43316a-9758-49c7-b87c-c474d91b4845 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:27:53.723739 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43316a-9758-49c7-b87c-c474d91b4845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:27:53.724025 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43316a-9758-49c7-b87c-c474d91b4845 admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:27:53.724777 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c43316a-9758-49c7-b87c-c474d91b4845 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 03:27:53.725085 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c43316a-9758-49c7-b87c-c474d91b4845 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:27:53.726662 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c43316a-9758-49c7-b87c-c474d91b4845 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:27:53.738056 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1455/2886] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 10 03:27:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 03:27:53.742233 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f2b5e5-a7f2-42dc-aeb9-3c093e9a9014 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:27:53.751202 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f2b5e5-a7f2-42dc-aeb9-3c093e9a9014 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:27:53.755875 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbbdcfb-752e-4fed-9d58-c25f14c9a15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:27:53.756552 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbbdcfb-752e-4fed-9d58-c25f14c9a15e admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:27:53.756832 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbbdcfb-752e-4fed-9d58-c25f14c9a15e admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:27:53.757105 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbbdcfb-752e-4fed-9d58-c25f14c9a15e admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:27:53.757785 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbbdcfb-752e-4fed-9d58-c25f14c9a15e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:27:53.759655 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbbdcfb-752e-4fed-9d58-c25f14c9a15e admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:27:53.856477 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1432/2887] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 10 03:27:53 2022] POST /identity/v3/projects => generated 363 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:27:53.860433 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43316a-9758-49c7-b87c-c474d91b4845 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:27:53.870030 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43316a-9758-49c7-b87c-c474d91b4845 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:27:53.929166 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a4bc9-0196-4560-8b71-059cfdb910d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:27:53.929820 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a4bc9-0196-4560-8b71-059cfdb910d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:27:53.930101 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a4bc9-0196-4560-8b71-059cfdb910d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:27:53.930379 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a4bc9-0196-4560-8b71-059cfdb910d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:27:53.931053 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35a4bc9-0196-4560-8b71-059cfdb910d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:27:53.932976 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35a4bc9-0196-4560-8b71-059cfdb910d1 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:27:54.004214 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1456/2888] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 10 03:27:53 2022] POST /identity/v3/users => generated 282 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 03:27:54.008590 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbbdcfb-752e-4fed-9d58-c25f14c9a15e admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:27:54.019386 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbbdcfb-752e-4fed-9d58-c25f14c9a15e admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:27:54.024023 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da77af-4765-4d51-b354-d3e7707b3a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:27:54.024702 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da77af-4765-4d51-b354-d3e7707b3a7d admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:27:54.024975 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da77af-4765-4d51-b354-d3e7707b3a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:27:54.025255 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da77af-4765-4d51-b354-d3e7707b3a7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:27:54.025986 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6da77af-4765-4d51-b354-d3e7707b3a7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:27:54.027609 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6da77af-4765-4d51-b354-d3e7707b3a7d admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:27:54.037804 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1433/2889] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:27:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:27:54.041580 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a4bc9-0196-4560-8b71-059cfdb910d1 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:27:54.055499 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a4bc9-0196-4560-8b71-059cfdb910d1 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:27:54.056808 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc87dac7-a28f-431f-9ce7-44fb01ffc3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:27:54.057468 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87dac7-a28f-431f-9ce7-44fb01ffc3e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:27:54.057754 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87dac7-a28f-431f-9ce7-44fb01ffc3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:27:54.058030 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87dac7-a28f-431f-9ce7-44fb01ffc3e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:27:54.058745 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc87dac7-a28f-431f-9ce7-44fb01ffc3e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:27:54.060428 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc87dac7-a28f-431f-9ce7-44fb01ffc3e5 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:27:54.071231 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1457/2890] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 10 03:27:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 03:27:54.075265 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da77af-4765-4d51-b354-d3e7707b3a7d admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:27:54.085776 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da77af-4765-4d51-b354-d3e7707b3a7d admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:27:54.090417 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e192f3ec-bce3-4d63-81fc-e9297d3778f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:27:54.091299 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192f3ec-bce3-4d63-81fc-e9297d3778f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:27:54.091583 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192f3ec-bce3-4d63-81fc-e9297d3778f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:27:54.091858 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192f3ec-bce3-4d63-81fc-e9297d3778f0 admin admin] PATH_INFO: `/v3/projects/d54b491eeba14d5090d1f6250e8a1842/users/60089a3943884dbf980b7a647166ad89/roles/bab81fd8d58945b8a1ea63c93b3b4857` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:27:54.106076 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e192f3ec-bce3-4d63-81fc-e9297d3778f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d54b491eeba14d5090d1f6250e8a1842, user_id=60089a3943884dbf980b7a647166ad89, role_id=bab81fd8d58945b8a1ea63c93b3b4857)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:27:54.108819 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e192f3ec-bce3-4d63-81fc-e9297d3778f0 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:27:54.218586 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1434/2891] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 10 03:27:54 2022] PUT /identity/v3/projects/d54b491eeba14d5090d1f6250e8a1842/users/60089a3943884dbf980b7a647166ad89/roles/bab81fd8d58945b8a1ea63c93b3b4857 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:27:54.228624 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448fe2db-e222-48bf-897e-e80c41f0253a None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:27:54.228923 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448fe2db-e222-48bf-897e-e80c41f0253a None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:27:54.229204 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448fe2db-e222-48bf-897e-e80c41f0253a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:27:54.255425 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-448fe2db-e222-48bf-897e-e80c41f0253a None None] MFA Rules not processed for user `60089a3943884dbf980b7a647166ad89`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:27:54.256677 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-448fe2db-e222-48bf-897e-e80c41f0253a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:27:54.321018 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1458/2892] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:27:54 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 03:27:54.332773 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e192f3ec-bce3-4d63-81fc-e9297d3778f0 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:27:54.334499 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-e192f3ec-bce3-4d63-81fc-e9297d3778f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:27:54.390567 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e192f3ec-bce3-4d63-81fc-e9297d3778f0 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:27:54.394296 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f85b913-2090-46c4-b4fd-3c2cc27bf633 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509cdb58f6a4d05a7ed79e46791ac19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:27:54.394940 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85b913-2090-46c4-b4fd-3c2cc27bf633 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:27:54.395221 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85b913-2090-46c4-b4fd-3c2cc27bf633 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:27:54.395498 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85b913-2090-46c4-b4fd-3c2cc27bf633 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:27:54.404119 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f85b913-2090-46c4-b4fd-3c2cc27bf633 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:27:54.405534 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f85b913-2090-46c4-b4fd-3c2cc27bf633 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:27:54.414622 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1435/2893] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:27:54 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:28:01.225556 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448fe2db-e222-48bf-897e-e80c41f0253a None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:28:01.227303 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-448fe2db-e222-48bf-897e-e80c41f0253a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:28:01.310678 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448fe2db-e222-48bf-897e-e80c41f0253a None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:28:01.316182 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa87f64c-c989-4434-97ac-2bda0c378c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:28:01.317075 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87f64c-c989-4434-97ac-2bda0c378c51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:28:01.317359 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87f64c-c989-4434-97ac-2bda0c378c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:28:01.317631 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87f64c-c989-4434-97ac-2bda0c378c51 admin admin] PATH_INFO: `/v3/users/f43ec3800caa42ed9a4fcf3405ef3d5e` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:28:01.318819 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa87f64c-c989-4434-97ac-2bda0c378c51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f43ec3800caa42ed9a4fcf3405ef3d5e)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:28:01.320947 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa87f64c-c989-4434-97ac-2bda0c378c51 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:28:01.525551 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-aa87f64c-c989-4434-97ac-2bda0c378c51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f43ec3800caa42ed9a4fcf3405ef3d5e'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:28:01.532028 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-aa87f64c-c989-4434-97ac-2bda0c378c51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f43ec3800caa42ed9a4fcf3405ef3d5e'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:28:01.543909 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-aa87f64c-c989-4434-97ac-2bda0c378c51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f43ec3800caa42ed9a4fcf3405ef3d5e'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:28:01.544608 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-aa87f64c-c989-4434-97ac-2bda0c378c51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f43ec3800caa42ed9a4fcf3405ef3d5e'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:28:01.545207 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-aa87f64c-c989-4434-97ac-2bda0c378c51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f43ec3800caa42ed9a4fcf3405ef3d5e'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:28:01.601835 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1459/2894] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:28:01 2022] DELETE /identity/v3/users/f43ec3800caa42ed9a4fcf3405ef3d5e => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:28:01.844988 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f85b913-2090-46c4-b4fd-3c2cc27bf633 service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:28:01.856429 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f85b913-2090-46c4-b4fd-3c2cc27bf633 service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:28:01.911058 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6493519-0efa-4be6-8193-544496290739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:28:01.911922 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6493519-0efa-4be6-8193-544496290739 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:28:01.912244 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6493519-0efa-4be6-8193-544496290739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:28:01.912522 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6493519-0efa-4be6-8193-544496290739 admin admin] PATH_INFO: `/v3/projects/f3186bec57c94e2f84ae52cae506dbc2` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:28:01.913704 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6493519-0efa-4be6-8193-544496290739 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3186bec57c94e2f84ae52cae506dbc2)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:28:01.915619 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6493519-0efa-4be6-8193-544496290739 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:28:02.020216 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c6493519-0efa-4be6-8193-544496290739 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3186bec57c94e2f84ae52cae506dbc2', 'request_id': 'req-c6493519-0efa-4be6-8193-544496290739'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:28:02.025449 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c6493519-0efa-4be6-8193-544496290739 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3186bec57c94e2f84ae52cae506dbc2', 'request_id': 'req-c6493519-0efa-4be6-8193-544496290739'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:28:02.031443 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c6493519-0efa-4be6-8193-544496290739 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3186bec57c94e2f84ae52cae506dbc2', 'request_id': 'req-c6493519-0efa-4be6-8193-544496290739'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:28:02.103426 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c6493519-0efa-4be6-8193-544496290739 admin admin] The token cache is being invalidate because project f3186bec57c94e2f84ae52cae506dbc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:28:02.103646 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c6493519-0efa-4be6-8193-544496290739 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:28:02.104313 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c6493519-0efa-4be6-8193-544496290739 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:28:02.105897 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1436/2895] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:28:01 2022] DELETE /identity/v3/projects/f3186bec57c94e2f84ae52cae506dbc2 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:28:27.434995 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa87f64c-c989-4434-97ac-2bda0c378c51 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:28:27.434995 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-aa87f64c-c989-4434-97ac-2bda0c378c51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:28:27.437306 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa87f64c-c989-4434-97ac-2bda0c378c51 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:28:27.492514 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a90c1-828e-48f5-8ba8-1ca858d0eaca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:28:27.493383 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a90c1-828e-48f5-8ba8-1ca858d0eaca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:28:27.493695 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a90c1-828e-48f5-8ba8-1ca858d0eaca admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:28:27.493966 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a90c1-828e-48f5-8ba8-1ca858d0eaca admin admin] PATH_INFO: `/v3/users/60089a3943884dbf980b7a647166ad89` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:28:27.495149 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118a90c1-828e-48f5-8ba8-1ca858d0eaca admin admin] RBAC: Authorizing `identity:delete_user(user_id=60089a3943884dbf980b7a647166ad89)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:28:27.497143 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118a90c1-828e-48f5-8ba8-1ca858d0eaca admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:28:27.710773 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-118a90c1-828e-48f5-8ba8-1ca858d0eaca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60089a3943884dbf980b7a647166ad89'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:28:27.717274 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-118a90c1-828e-48f5-8ba8-1ca858d0eaca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60089a3943884dbf980b7a647166ad89'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:28:27.730200 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-118a90c1-828e-48f5-8ba8-1ca858d0eaca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60089a3943884dbf980b7a647166ad89'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:28:27.730971 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-118a90c1-828e-48f5-8ba8-1ca858d0eaca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60089a3943884dbf980b7a647166ad89'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:28:27.731542 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-118a90c1-828e-48f5-8ba8-1ca858d0eaca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60089a3943884dbf980b7a647166ad89'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:28:27.820830 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1460/2896] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 10 03:28:27 2022] DELETE /identity/v3/users/60089a3943884dbf980b7a647166ad89 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:28:27.825384 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa9d20-e960-4a06-b6c7-f7f04ab20851 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:28:27.825853 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa9d20-e960-4a06-b6c7-f7f04ab20851 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:28:27.825976 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa9d20-e960-4a06-b6c7-f7f04ab20851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:28:27.844121 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-feaa9d20-e960-4a06-b6c7-f7f04ab20851 None None] MFA Rules not processed for user `3229265247eb495190623e424798942d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 03:28:27.845349 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-feaa9d20-e960-4a06-b6c7-f7f04ab20851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:28:27.901569 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1437/2897] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 10 03:28:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 03:28:27.911467 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a90c1-828e-48f5-8ba8-1ca858d0eaca admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:28:27.912870 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-118a90c1-828e-48f5-8ba8-1ca858d0eaca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:28:27.967946 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a90c1-828e-48f5-8ba8-1ca858d0eaca admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:28:27.971468 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d53e2be-7455-4db6-8c47-5fbfcb3af6d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccfba74826234915bc989fede9bde3e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:28:27.972146 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d53e2be-7455-4db6-8c47-5fbfcb3af6d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:28:27.972431 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d53e2be-7455-4db6-8c47-5fbfcb3af6d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:28:27.972707 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d53e2be-7455-4db6-8c47-5fbfcb3af6d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:28:27.981478 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d53e2be-7455-4db6-8c47-5fbfcb3af6d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:28:27.982931 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d53e2be-7455-4db6-8c47-5fbfcb3af6d7 service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:28:27.992843 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1461/2898] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:28:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 03:28:28.379627 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaa9d20-e960-4a06-b6c7-f7f04ab20851 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:28:28.381627 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-feaa9d20-e960-4a06-b6c7-f7f04ab20851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:28:28.394579 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaa9d20-e960-4a06-b6c7-f7f04ab20851 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:28:28.399306 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdf30cc-7f25-4b53-ae87-5a753d3d1a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3229265247eb495190623e424798942d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2907edfa2f14a3b85299455266c251c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:28:28.400202 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf30cc-7f25-4b53-ae87-5a753d3d1a7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:28:28.400483 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf30cc-7f25-4b53-ae87-5a753d3d1a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:28:28.401389 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf30cc-7f25-4b53-ae87-5a753d3d1a7b admin admin] PATH_INFO: `/v3/projects/d54b491eeba14d5090d1f6250e8a1842` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:28:28.402784 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdf30cc-7f25-4b53-ae87-5a753d3d1a7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d54b491eeba14d5090d1f6250e8a1842)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:28:28.404812 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdf30cc-7f25-4b53-ae87-5a753d3d1a7b admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:28:28.506625 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-5fdf30cc-7f25-4b53-ae87-5a753d3d1a7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd54b491eeba14d5090d1f6250e8a1842', 'request_id': 'req-5fdf30cc-7f25-4b53-ae87-5a753d3d1a7b'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:28:28.511801 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-5fdf30cc-7f25-4b53-ae87-5a753d3d1a7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd54b491eeba14d5090d1f6250e8a1842', 'request_id': 'req-5fdf30cc-7f25-4b53-ae87-5a753d3d1a7b'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:28:28.517993 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-5fdf30cc-7f25-4b53-ae87-5a753d3d1a7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd54b491eeba14d5090d1f6250e8a1842', 'request_id': 'req-5fdf30cc-7f25-4b53-ae87-5a753d3d1a7b'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:28:28.573785 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-5fdf30cc-7f25-4b53-ae87-5a753d3d1a7b admin admin] The token cache is being invalidate because project d54b491eeba14d5090d1f6250e8a1842 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 03:28:28.574071 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-5fdf30cc-7f25-4b53-ae87-5a753d3d1a7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:28:28.574678 dv-cinder-830094-4-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-5fdf30cc-7f25-4b53-ae87-5a753d3d1a7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 03:28:28.576551 dv-cinder-830094-4-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1438/2899] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 10 03:28:28 2022] DELETE /identity/v3/projects/d54b491eeba14d5090d1f6250e8a1842 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 03:33:06.440221 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d53e2be-7455-4db6-8c47-5fbfcb3af6d7 service neutron] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 03:33:06.441654 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-4d53e2be-7455-4db6-8c47-5fbfcb3af6d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:33:06.574036 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d53e2be-7455-4db6-8c47-5fbfcb3af6d7 service neutron] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 03:33:06.628578 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ea855e-8713-4b13-93bf-992aaf7a013d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f646147bdad8476ba0ab9da5d9c50b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '513e6592cd83457b8ff461b0e5e1fd40', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 03:33:06.629225 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea855e-8713-4b13-93bf-992aaf7a013d service placement] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 03:33:06.629501 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea855e-8713-4b13-93bf-992aaf7a013d service placement] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 03:33:06.629771 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea855e-8713-4b13-93bf-992aaf7a013d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 03:33:06.631510 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-67ea855e-8713-4b13-93bf-992aaf7a013d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 03:33:06.642826 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ea855e-8713-4b13-93bf-992aaf7a013d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 03:33:06.644418 dv-cinder-830094-4-smb devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ea855e-8713-4b13-93bf-992aaf7a013d service placement] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 03:33:06.654605 dv-cinder-830094-4-smb devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1462/2900] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 10 03:33:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)